You are here:

Meta-analysis of the impact of Augmented Reality on students’ learning gains
ARTICLE

,

Educational Research Review Volume 27, Number 1, ISSN 1747-938X Publisher: Elsevier Ltd

Abstract

Existing literature reflects the multiple benefits of the integration of Augmented Reality (AR) technologies in educational settings. Many studies have been conducted to establish the tendencies, affordances, and challenges of this technology for education. However, most of these studies are qualitative studies that do not measure the extent of the impact of this technology on education. This study conducted a meta-analysis of 64 quantitative research papers (N = 4705) published between 2010 and 2018 in major journals. The main purpose of the study was to analyze the impact of AR on students’ learning gains. Furthermore, the study analyzed the influence of moderating variables such as control treatment, learning environment, learner type, and domain subject on the learning gains. The results identified that AR has a medium effect on the learning gains of students (d=.68,p<.001). Additionally, the study discusses the effect of AR on the moderating variables and establishes some possible routes of investigation for future work.

Citation

Garzón, J. & Acevedo, J. (2019). Meta-analysis of the impact of Augmented Reality on students’ learning gains. Educational Research Review, 27(1), 244-260. Elsevier Ltd. Retrieved August 5, 2024 from .

This record was imported from Educational Research Review on May 31, 2019. Educational Research Review is a publication of Elsevier.

Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.edurev.2019.04.001

Keywords

References

View References & Citations Map
  1. Aebersold, M., Voepel-Lewis, T., Cherara, L., Weber, M., Khouri, C., & Levine, R. (2018). Interactive anatomy-augmented virtual simulation training. Clinical Simulation in Nursing, 15, pp. 34-41. Available online: https://doi.org/10.1016/j.ecns.2017.09.008.
  2. Akçayir, M., & Akçayir, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, pp. 1-11. Available online: https://doi.org/10.1016/j.edurev.2016.11.002.
  3. Akçayir, M., Akçayir, G., Pektaş, H.M., & Ocak, M.A. (2016). Augmented reality in science laboratories: The effects of augmented reality on university students' laboratory skills and attitudes toward science laboratories. Computers in Human Behavior, 57, pp. 334-342. Available online: https://doi.org/10.1016/j.chb.2015.12.054.
  4. Antonioli, M., Blake, C., & Sparks, K. (2014). Augmented reality applications in education. Journal of Technology Studies, 40(1), pp. 96-107.
  5. Azuma, R. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4), pp. 355-385. Available online: https://doi.org/https://doi.org/10.1162/pres.1997.6.4.355.
  6. Bacca, J., Fabregat, R., Baldiris, S., Graf, S., & Kinshuk (2014). Augmented reality trends in education: A systematic review of research and applications. Educational Technology & Society, 17(4), pp. 133-149.
  7. Baldiris, S., Fabregat, R., Bacca, J., Avila, C., & Zervas, P. (2014). Inclusive learning project: “Supporting trainers for an inclusive vocational education - R13-validation trials. Available online: http://www.inclusive-learning.eu/.
  8. Barma, S., Daniel, S., Bacon, N., Gingras, M.-A., & Fortin, M. (2015). Observation and analysis of a classroom teaching and learning practice based on augmented reality and serious games on mobile platforms. International Journal of Serious Games, 2(2) Available online: https://doi.org/10.17083/ijsg.v2i2.66.
  9. Becker, B.J. (1988). Synthesizing standardized mean-change measures. British Journal of Mathematical and Statistical Psychology, 41(2), pp. 257-278.
  10. Bernard, R.M., Abrami, P.C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research, 74(3), pp. 379-439. Available online: https://doi.org/10.3102/00346543074003379.
  11. Billinghurst, M., Clark, A., & Lee, G. (2015). A survey of augmented reality. Foundations and Trends® in Human-Computer Interaction, 8(2–3), pp. 73-272. Available online: https://doi.org/10.1561/1100000049.
  12. Bitter, G., & Corral, A. (2014). The pedagogical potential of augmented reality apps. International Journal of Engineering Science Invention, 3(10), pp. 13-17.
  13. Borenstein, M., Hedges, L.V., Higgins, J.P.T., & Rothstein, H.R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), pp. 97-111. Available online: https://doi.org/10.1002/jrsm.12.
  14. Bower, M., Howe, C., McCredie, N., Robinson, A., & Grover, D. (2014). Augmented reality in education-cases, places and potentials. Educational Media International, 51(1), pp. 1-15. Available online: https://doi.org/10.1080/09523987.2014.889400.
  15. Cai, S., Chiang, F.K., Sun, Y., Lin, C., & Lee, J.J. (2017). Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interactive Learning Environments, 25(6), pp. 778-791. Available online: https://doi.org/10.1080/10494820.2016.1181094.
  16. Cai, S., Chiang, F.K., & Wang, X. (2013). Using the augmented reality 3D technique for a convex imaging experiment in a physics course. International Journal of Engineering Education, 29(4), pp. 856-865.
  17. Cai, S., Wang, X., & Chiang, F.K. (2014). A case study of Augmented Reality simulation system application in a chemistry course. Computers in Human Behavior, 37, pp. 31-40. Available online: https://doi.org/10.1016/j.chb.2014.06.014.
  18. Calle-Bustos, A.M., Juan, M.C., García-García, I., & Abad, F. (2017). An augmented reality game to support therapeutic education for children with diabetes. PLoS One, 12(9), p. e0184645. Available online: https://doi.org/10.1371/journal.pone.0184645.
  19. Card, N.A. (2011). Applied meta-analysis for social science research. Available online: https://doi.org/10.1017/CBO9781107415324.004.
  20. Carlson, K.D., & Schmidt, F.L. (1999). Impact of experimental design on effect size: Findings from the research literature on training kevin. Journal of Applied Psychology, 84(6), pp. 851-862.
  21. Cascales-Martínez, A., Martínez-Segura, M.J., Pérez-López, D., & Contero, M. (2017). Using an augmented reality enhanced tabletop system to promote learning of mathematics: A case study with students with special educational needs. EURASIA Journal of Mathematics, Science and Technology Education, 13(2), pp. 355-380. Available online: https://doi.org/10.12973/eurasia.2017.00621a.
  22. Caudell, T.P., & Mizell, D.W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, 2, pp. 659-669. Available online: https://doi.org/10.1109/HICSS.1992.183317.
  23. Cepeda, N., Pashler, H., Vul, E., Wixted, J., & Rohrer, D. (2006). Distributed practice in verbal recall Tasks : A review and quantitative synthesis. Psychological Bulletin, 132(3), p. 354.
  24. Chang, K.E., Chang, C.T., Hou, H.T., Sung, Y.T., Chao, H.L., & Lee, C.M. (2014). Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Computers & Education, 71, pp. 185-197. Available online: https://doi.org/10.1016/j.compedu.2013.09.022.
  25. Chang, Y.L., Hou, H.T., Pan, C.Y., Sung, Y.T., & Chang, K.E. (2015). Apply an augmented reality in a mobile guidance to increase sense of place for heritage places. Educational Technology & Society, 18(2), pp. 166-178.
  26. Chang, S.C., & Hwang, G.J. (2018). Impacts of an augmented reality-based flipped learning guiding approach on students' scientific project performance and perceptions. Computers & Education, 125, pp. 226-239. Available online: https://doi.org/10.1016/j.compedu.2018.06.007.
  27. Chang, H.Y., Wu, H.K., & Hsu, Y.S. (2013). Integrating a mobile augmented reality activity to contextualize student learning of a socioscientific issue. British Journal of Educational Technology, 44(3), pp. 95-99. Available online: https://doi.org/10.1111/j.1467-8535.2012.01379.x.
  28. Chao, W.H., & Chang, R.C. (2018). Using Augmented Reality to enhance teaching and learning. Advances in Social Sciences Research Journal, 5(12), pp. 455-464.
  29. Chauhan, S. (2016). A meta-analysis of the impact of technology on learning effectiveness of elementary students. Computers & Education, 105, pp. 14-30. Available online: https://doi.org/10.1016/j.compedu.2016.11.005.
  30. Chen, Y.C., Chi, H.L., Hung, W.H., & Kang, S.C. (2011). Use of tangible and augmented reality models in engineering graphics courses. Journal of Professional Issues in Engineering Education and Practice, 137(4), pp. 267-276. Available online: https://doi.org/10.1061/(ASCE)EI.1943-5541.0000078.
  31. Chen, C.-H., Chou, Y.-Y., & Huang, C.-Y. (2016). An augmented-reality-based concept map to support mobile learning for science. The Asia-Pacific Education Researcher, 25(4), pp. 567-578. Available online: https://doi.org/10.1007/s40299-016-0284-3.
  32. Chen, C.H., Lee, I.J., & Lin, L.Y. (2016). Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55, pp. 477-485. Available online: https://doi.org/10.1016/j.chb.2015.09.033.
  33. Cheng, M.T., Lin, Y.W., & She, H.C. (2015). Learning through playing Virtual Age: Exploring the interactions among student concept learning, gaming performance, in-game behaviors, and the use of in-game characters. Computers & Education, 86, pp. 18-29. Available online: https://doi.org/10.1016/j.compedu.2015.03.007.
  34. Chen, C., ping, & Wang, C.H. (2015). Employing augmented-reality-embedded instruction to disperse the imparities of individual differences in earth science learning. Journal of Science Education and Technology, 24(6), pp. 835-847. Available online: https://doi.org/10.1007/s10956-015-9567-3.
  35. Chen, C.M., & Tsai, Y.N. (2012). Interactive augmented reality system for enhancing library instruction in elementary schools. Computers & Education, 59(2), pp. 638-652. Available online: https://doi.org/10.1016/j.compedu.2012.03.001.
  36. Chiu, J.L., DeJaegher, C.J., & Chao, J. (2015). The effects of augmented virtual science laboratories on middle school students' understanding of gas properties. Computers & Education, 85, pp. 59-73. Available online: https://doi.org/10.1016/j.compedu.2015.02.007.
  37. Clark, R.E. (1994). Media will never influence learning. Educational Technology Research & Development, 42(2), pp. 21-29.
  38. Cohen, J. (1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), p. 213.
  39. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York: Academic Press.
  40. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), pp. 155-159. Available online: https://doi.org/10.1037/0033-2909.112.1.155.
  41. Cohen, J. (1992). Quantitative methods in psychology. Psychological Bulletin, 112(1), pp. 155-159. Available online: https://doi.org/10.1037/0033-2909.112.1.155.
  42. Cortina, J.M., & Nouri, H. (2000). Effect size for ANOVA designs.
  43. Di Serio, Á., Ibáñez, M.B., & Kloos, C.D. (2013). Impact of an augmented reality system on students' motivation for a visual art course. Computers & Education, 68, pp. 585-596. Available online: https://doi.org/10.1016/j.compedu.2012.03.002.
  44. Diegmann, P., Schmidt-Kraepelin, M., Eynden, S., Van Den, & Basten, D. (2015). Benefits of augmented reality in educational environments – a systematic literature review. Wirtschaftsinformatik Proceedings, pp. 1542-1556.
  45. Dunlap, W.P., Cortina, J.M., Vaslow, J.B., & Burke, M.J. (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1(2), pp. 170-177. Available online: https://doi.org/10.1037/1082-989X.1.2.170.
  46. Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18(1), pp. 7-22. Available online: https://doi.org/10.1007/s10956-008-9119-1.
  47. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), pp. 455-463.
  48. Egger, M., Smith, G.D., Schneider, M., & Minder, C. (1997). Bias in meta - analysis detected by a simple, graphical test. BMJ, 315(7109), pp. 629-634. Available online: https://doi.org/.
  49. Enyedy, N., Danish, J.A., Delacruz, G., & Kumar, M. (2012). Learning physics through play in an augmented reality environment. International Journal of Computer-Supported Collaborative Learning, 7(3), pp. 347-378. Available online: https://doi.org/10.1007/s11412-012-9150-3.
  50. Ferrer-Torregrosa, J., Torralba, J., Jimenez, M.A., García, S., & Barcia, J.M. (2015). ARBOOK: Development and assessment of a tool based on augmented reality for anatomy. Journal of Science Education and Technology, 24(1), pp. 119-124. Available online: https://doi.org/10.1007/s10956-014-9526-4.
  51. FitzGerald, E., Ferguson, R., Adams, A., Gaved, M., Mor, Y., & Thomas, R. (2013). Augmented reality and mobile learning : The state of the art. International Journal of Mobile and Blended Learning, 5(4), pp. 43-58.
  52. Fonseca, D., Redondo, E., Villagrasa, S., & Canaleta, X. (2015). Assessment of augmented visualization methods in multimedia engineering education. International Journal of Engineering Education, 31(3), pp. 736-750.
  53. Freeman, S., Eddy, S.L., McDonough, M., Smith, M.K., Okoroafor, N., & Jordt, H. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), pp. 8410-8415. Available online: https://doi.org/10.1073/pnas.1319030111.
  54. Garzón, J., Acevedo, J., Pavón, J., & Baldiris, S. (2018). ARtour: Augmented reality-based game to promote agritourism. Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2018. Lecture Notes in Computer Science, 10850, pp. 413-422. Available online: https://doi.org/https://doi.org/10.1007/978-3-319-95270-3_35.
  55. Garzón, J., Pavón, J., & Baldiris, S. (2019). Systematic review and meta-analysis of augmented reality in educational settings. Virtual Reality, pp. 1-13. Available online: https://doi.org/10.1007/s10055-019-00379-9.
  56. Gibbons, R.D., Hedeker, D.R., & Davis, J.M. (1993). Estimation of effect size from a series of experiments involving paired comparisons. Journal of Educational Statistics, 18(3), pp. 271-279. Available online: https://doi.org/10.2307/1165136.
  57. Glass, G.V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), pp. 3-8. Available online: https://doi.org/10.3102/0013189X005010003.
  58. Glass, G.V., Smith, M.L., & McGaw, B. (1981). Meta-analysis in social research. Incorporated: Sage Publications.
  59. Grace, M., & Ratcliffe, M. (2002). The science and values that young people draw upon to make decisions about biological conservation issues. International Journal of Science Education, 24(11), pp. 1157-1169.
  60. Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G. (2018). Meta-analysis and the science of research synthesis. Nature, 555(7695), pp. 175-182. Available online: https://doi.org/10.1038/nature25753.
  61. Gutiérrez, J.M., & Meneses Fernández, M.D. (2014). Applying Augmented Reality in engineering education to improve academic performance & student motivation. International Journal of Engineering Education, 30(3), pp. 1-11.
  62. Harzing, A.W., & Alakangas, S. (2016). Google scholar, Scopus and the web of science: A longitudinal and cross-disciplinary comparison. Scientometrics, 106(2), pp. 787-804. Available online: https://doi.org/10.1007/s11192-015-1798-9.
  63. Hastings, N.B., & Tracey, M.W. (2005). Does media affect learning: Where are we now?. TechTrends, 49(2), pp. 28-30.
  64. Hedges, L.V. (1982). Estimation of effect size from a series of independent experiments. Psychological Bulletin, 92(2), p. 490.
  65. Hedges, L.V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
  66. Higgins, J., & Thompson, S. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), pp. 1539-1558. Available online: https://doi.org/10.1002/sim.1186.
  67. Hsiao, K.F. (2013). Using augmented reality for students health - case of combining educational learning with standard fitness. Multimedia Tools and Applications, 64(2), pp. 407-421. Available online: https://doi.org/10.1007/s11042-011-0985-9.
  68. Hsiao, K.F., Chen, N.S., & Huang, S.Y. (2012). Learning while exercising for science education in augmented reality among adolescents. Interactive Learning Environments, 20(4), pp. 331-349. Available online: https://doi.org/10.1080/10494820.2010.486682.
  69. Hsu, T.C. (2017). Learning English with augmented reality: Do learning styles matter?. Computers & Education, 106, pp. 137-149. Available online: https://doi.org/10.1016/j.compedu.2016.12.007.
  70. Hsu, Y.C., Hung, J.L., & Ching, Y.H. (2013). Trends of educational technology research: More than a decade of international research in six SSCI-indexed refereed journals. Educational Technology Research & Development, 61(4), pp. 685-705. Available online: https://doi.org/10.1007/s11423-013-9290-9.
  71. Huang, T.C., Chen, C.C., & Chou, Y.W. (2016). Animating eco-education: To see, feel, and discover in an augmented reality-based experiential learning environment. Computers & Education, 96, pp. 72-82. Available online: https://doi.org/10.1016/j.compedu.2016.02.008.
  72. Huedo-Medina, T.B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006). Assessing heterogeneity in meta-analysis: Q statistic or I2 index?. Psychological Methods, 11(2), pp. 193-206. Available online: https://doi.org/10.1037/1082-989X.11.2.193.
  73. Hung, Y.-H., Chen, C.-H., & Huang, S.-W. (2016). Applying augmented reality to enhance learning: A study of different teaching materials. Journal of Computer Assisted Learning, pp. 1-15. Available online: https://doi.org/10.1111/jcal.12173.
  74. Hwang, G.J., & Chen, C.H. (2017). Influences of an inquiry-based ubiquitous gaming design on students' learning achievements, motivation, behavioral patterns, and tendency towards critical thinking and problem solving. British Journal of Educational Technology, 48(4), pp. 950-971. Available online: https://doi.org/10.1111/bjet.12464.
  75. Ibáñez, M.B., Di Serio, Á., Villarán, D., & Delgado Kloos, C. (2014). Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness. Computers & Education, 71, pp. 1-13. Available online: https://doi.org/10.1016/j.compedu.2013.09.004.
  76. Ibanez, M.B., Di Serio, A., Villaran, D., & Delgado Kloos, C. (2016). Support for augmented reality simulation systems: The effects of scaffolding on learning outcomes and behavior patterns. IEEE Transactions on Learning Technologies, 9(1), pp. 46-56. Available online: https://doi.org/10.1109/TLT.2015.2445761.
  77. Jee, H.K., Lim, S., Youn, J., & Lee, J. (2014). An augmented reality-based authoring tool for E-learning applications. Multimedia Tools and Applications, 68(2), pp. 225-235. Available online: https://doi.org/10.1007/s11042-011-0880-4.
  78. Joo-Nagata, J., Martinez Abad, F., García-Bermejo Giner, J., & García-Peñalvo, F.J. (2017). Augmented reality and pedestrian navigation through its implementation in m-learning and e-learning: Evaluation of an educational program in Chile. Computers & Education, 111, pp. 1-17. Available online: https://doi.org/10.1016/j.compedu.2017.04.003.

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References