Journal directory listing - Volume 62(2017) - Journal of Research in Education Sciences【62(2)】June (Special Issue: Digital Learning: Retrospect and Prospect)

(Special Issue) Quality Assessment and Situational Analysis of Experimental E-Learning Designs:A Case Study of Mobile Learning Author: Han-Yueh Lee(Research Center for Psychological and Educational Testing, National Taiwan Normal University), Je-Ming Yang(Research Center for Psychological and Educational Testing, National Taiwan Normal University), Yao-Ting Sung(Department of Educational Psychology and Counseling, National Taiwan Normal University)

Vol.&No.:Vol. 62, No.2
Date:June 2017


Because of the substantial development of mobile devices and educational software in recent years, the results of mobile learning–based interventions represent a popular research topic for investigation. Although experiment quality is the basis of empirical research, few studies have explored this issue. Thus, the present study investigated the shortfalls in existing experimental research designs related to mobile learning over the past decade and offers suggestions in this paper. The researchers collected data from all 197 experimental studies on mobile learning published in the Education Resources Information Center and Institute of Science Index from 2003 to 2013. The findings of the present study are described as follows: (1) Quasi-experimental designs represent the most frequently used design type (61%); however, among the quasi-experimental studies, 25% did not consider baseline equivalence. (2) Over half of the studies may not have met basic statistical assumptions, and approximately 70% used insufficient sample sizes, leading to low statistical power and imprecise effect size estimation. (3) Half of the studies did not provide information on test reliability and validity. Finally, this paper discusses the results and their implications for future research and practice.

Keywords:experimental design, mobile learning, research quality

《Full Text》 檔名

  1. 張菀珍、葉榮木(2014)。應用多媒體行動學習系統輔助大學生情緒管理學習成效與評量之探究。教育科學研究期刊,59(4),99-136。doi:10.6209/JORIES.2014.59(4).04【Chang, W.-J., & Yeh, Z.-M. (2014). Exploration of learning effectiveness and assessment of emotion management for college students by using a multimedia mobile learning system. Journal of Research in Education Sciences, 59(4), 99-136. doi:10.6209/JORIES.2014.59(4).04】
  2. Ardito, C., Costabile, M. F., de Angeli, A., & Lanzilotti, R. (2012). Enriching archaeological parks with contextual sounds and mobile technology. ACM Transactions on Computer-Human Interaction, 19(4), 1-30. doi:10.1145/2395131.2395136
  3. Aron, A., & Aron, E. N. (1999). Statistics for psychology (2nd ed.). Upper Saddle River, NJ: Prentice-Hall.
  4. Basoglu, E. B., & Akdemir, O. (2010). A comparison of undergraduate students English vocabulary learning: Using mobile phones and flash cards. Turkish Online Journal of Educational Technology, 9(3), 1-7. Retrieved from
  5. Bebell, D., & O’Dwyer, L. M. (2010). Educational outcomes and research from 1:1 computing settings. Journal of Technology, Learning, and Assessment, 9(1), 5-15. Retrieved from
» More
APA FormatLee, H.-Y., Yang, J.-M., & Sung, Y.-T. (2017). Quality assessment and situational analysis of experimental e-learning designs: A case study of mobile learning. Journal of Research in Education Sciences, 62(2), 31-60. doi:10.6209/JORIES.2017.62(2).02