You are here:

Fostering oral presentation competence through a virtual reality-based task for delivering feedback
ARTICLE

, VR Lab of the Archimedes Institute ; , , , Department of Education and Learning Sciences ; , Groningen Institute for Evolutionary Life Sciences ; , NCOI Education Management ; , , CoVince ; , Department of Education and Learning Sciences

Computers & Education Volume 134, Number 1, ISSN 0360-1315 Publisher: Elsevier Ltd

Abstract

While previous studies have stressed the importance of feedback delivered by experts, it is unclear whether students' oral presentation competence can be fostered through innovative technology for delivering feedback. This experimental study examined the effectiveness of a virtual reality-based task, in which first-year undergraduate students practiced their presentation in a virtual environment and received feedback produced by the system, on their presentation competence components (i.e. cognition, behaviour and attitudes towards presenting). The effects were compared with a control condition, which was a face-to-face presentation task with expert feedback. The students’ performance was measured using pre- and post-test multiple-choice tests, validated rubrics, and self-evaluation instruments. Results revealed significant improvements from pre-test to post-test in all three presentation competence components, without a difference between the conditions. Furthermore, the self-evaluation tests showed that students who presented in virtual reality were appreciative of the detailed and analytical feedback they received. Because of sample size limitations, the effects found could not be generalised. Therefore, future research on a larger sample is needed to examine population effects. Follow-up studies should focus on the extent to which virtual reality-based tasks can encourage self-regulation skills for the effective and efficient integration of these tasks in presentation courses.

Citation

van Ginkel, S., Gulikers, J., Biemans, H., Noroozi, O., Roozen, M., Bos, T., van Tilborg, R., van Halteren, M. & Mulder, M. (2019). Fostering oral presentation competence through a virtual reality-based task for delivering feedback. Computers & Education, 134(1), 78-97. Elsevier Ltd. Retrieved August 7, 2024 from .

This record was imported from Computers & Education on March 15, 2019. Computers & Education is a publication of Elsevier.

Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.compedu.2019.02.006

Keywords

References

View References & Citations Map
  1. Anderson, P.L., Zimand, E., Hodges, L.F., & Rothbaum, B.O. (2005). Cognitive behavioral therapy for public‐speaking anxiety using virtual reality for exposure. Depression and Anxiety, 22(3), pp. 156-158.
  2. Andolsek, D.L. (1995). Virtual reality in education and training. International Journal of Instructional Media, 22(2), pp. 145-155.
  3. Attali, Y., & van der Kleij, F. (2017). Effects of feedback elaboration and feedback timing during computer-based practice in mathematics problem solving. Computers & Education, 110, pp. 154-169.
  4. Ayres, J. (2009). Situational factors and audience anxiety. Communication Education, 39(4), pp. 283-291.
  5. Batrinca, L., Stratou, G., Shapiro, A., Morency, L.P., & Scherer, S. (2013). Cicero-towards a multimodal virtual audience platform for public speaking training. International workshop on intelligent virtual agents, pp. 116-128. Berlin: Springer.
  6. Beatty, M.J., & Friedland, M.H. (2009). Public speaking state anxiety as a function of selected situational and predispositional variables. Communication Education, 39(2), pp. 142-147.
  7. Bower, M., Cavanagh, M., Moloney, R., & Dao, M. (2011). Developing communication competence using an online video reflection system: Pre-service teachers' experiences. Asia-Pacific Journal of Teacher Education, 39(4), pp. 311-326.
  8. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), pp. 77-101.
  9. Calcich, S., & Weilbaker, D. (1992). Selecting the optimum number of in-class sales presentations. Marketing Education Review, 2(1), pp. 31-33.
  10. Chan, V. (2011). Teaching oral communication in undergraduate science: Are we doing enough and doing it right?. Journal of Learning Design, 4(3), pp. 71-79.
  11. Chen, C., Toh, S., & Ismail, W. (2005). Are learning styles relevant to virtual reality?. Journal of Research on Technology in Education, 38(2), pp. 120-128.
  12. Chollet, M., Wörtwein, T., Morency, L.P., Shapiro, A., & Scherer, S. (2015). Exploring feedback strategies to improve public speaking: An interactive virtual audience framework. Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, pp. 1143-1154.
  13. Clarke, V., & Braun, V. (2013). Teaching thematic analysis: Overcoming challenges and developing strategies for effective learning. The Psychologist, 26(2), pp. 120-123.
  14. Coller, B.D., & Scott, M.J. (2009). Effectiveness of using a video game to teach a course in mechanical engineering. Computers & Education, 53(3), pp. 900-912.
  15. Coller, B.D., & Shernoff, D.J. (2009). Video game-based education in mechanical engineering: A look at student engagement. International of Engineering Education, 25, pp. 308-317.
  16. De Grez, L. (2009). Optimizing the instructional environment to learn presentation skills. Gent: Dissertation: Universiteit Gent.
  17. De Grez, L., Valcke, M., & Roozen, I. (2009). The impact of goal orientation, self-reflection and personal characteristics on the acquisition of oral presentation skills. European Journal of Psychology of Education, 24(3), pp. 293-306.
  18. De Jong, T. (1991). Learning and instruction with computer simulations. Education & Computing, 6, pp. 217-229.
  19. De Kleijn, R., Meijer, P.C., Brekelmans, M., & Pilot, A. (2012). Curricular goals and personal goals in master's thesis projects: Dutch student-supervisor dyads. International Journal of Higher Education, 2(1), pp. 1-11.
  20. Dubovi, I., Levy, S.T., & Dagan, E. (2017). Now I know how! the learning process of medication administration among nursing students with non-immersive desktop virtual reality simulation. Computers & Education, 113.
  21. Falchikov, N. (2005). Improving assessment through student involvement: Practical solutions for aiding learning in higher and further education. New York: RoutledgeFalmer.
  22. Galas, C., & Ketelhut, D.J. (2006). River City, the MUVE. Learning and Leading with Technology, 33(7), pp. 31-32.
  23. Haber, R.J., & Lingard, L.A. (2001). Learning oral presentation skills, a rhetorical analysis with pedagogical and professional implications. Journal of General Internal Medicine, 16(5), pp. 308-314.
  24. Harris, S.R., Kemmerling, R.L., & North, M.M. (2002). Brief virtual reality therapy for public speaking anxiety. CyberPsychology and Behavior, 5(6), pp. 543-550.
  25. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), pp. 81-112.
  26. Hawkins, D.G. (1995). Virtual reality and passive simulators: The future of fun. Communication in the age of virtual reality, pp. 159-189. Hillsdale, NJ: Lawrence Erlbaum.
  27. Hayes, N. (2000). Doing psychological research. Buckingham: Open University Press.
  28. Hew, K.F., & Cheung, W.S. (2010). Use of three‐dimensional (3‐D) immersive virtual worlds in K‐12 and higher education settings: A review of the research. British Journal of Educational Technology, 41(1), pp. 33-55.
  29. Hung, S.T.A. (2016). Enhancing feedback provision through multimodal video technology. Computers & Education, 98, pp. 90-101.
  30. Jang, S., Vitale, J.M., Jyung, R.W., & Black, J.B. (2017). Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment. Computers & Education, 106, pp. 150-165.
  31. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2, pp. 130-144.
  32. Kang, N. (2016). Public speaking in virtual reality: Audience design and speaker experiences. Dissertation: TU Delft, Delft.
  33. Kerby, D., & Romine, J. (2009). Develop oral presentation skills through accounting curriculum design and course-embedded assessment. Journal of Education for Business, 85(3), pp. 172-179.
  34. Kim, S., Kogan, J.R., Bellini, L., & Shea, J. (2005). A randomized-controlled study of encounter cards to improve oral case presentation skills of medical students. Journal of General Internal Medicine, 20(8), pp. 743-747.
  35. King, P., Young, M., & Behnke, R. (2000). Public speaking performance improvement as a function of information processing in immediate and delayed feedback interventions. Communication Education, 49(4), pp. 365-374.
  36. Krause, U.M., Stark, R., & Mandl, H. (2009). The effects of cooperative learning and feedback on e-learning in statistics. Learning and Instruction, 19(2), pp. 158-170.
  37. Lakens, D. (2017). Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Social Psychological and Personality Science, 8(4), pp. 355-362.
  38. LaViola, J.J., Kruijff, E., McMahan, R.P., Bowman, D.A., & Poupyrev, I. (2017). 3D user interfaces: Theory and practice. Boston: Addison-Wesley.
  39. Lee, J. (1999). Effectiveness of computer-based instructional simulation: A meta-analysis. International Journal of Instructional Media, 26(1), pp. 71-85.
  40. Lee, E.A.L., & Wong, K.W. (2014). Learning with desktop virtual reality: Low spatial ability learners are more positively affected. Computers & Education, 79, pp. 49-58.
  41. Lorenzo, G., Lledó, A., Pomares, J., & Roig, R. (2016). Design and application of an immersive virtual reality system to enhance emotional skills for children with autism spectrum disorders. Computers & Education, 98, pp. 192-205.
  42. Mayer, R.E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12(1), pp. 107-119.
  43. McKinney, M.E., Gatchel, R.J., & Paulus, P.B. (2010). The effects of audience size on high and low speech-anxious subjects during an actual speaking task. Basic and Applied Social Psychology, 4(1), pp. 73-87.
  44. McNamara, D.S., Jackson, G.T., & Graesser, A. (2009). Intelligent tutoring and games (ITAG). AIED, 14, pp. 44-65.
  45. Merchant, Z., Goetz, E.T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T.J. (2014). Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, pp. 29-40.
  46. Mixamo (2018). Mixamo. Animated 3D characters. No 3D knowledge required. Rapidly create, rig and animate unique characters for design projects. (2018). Available online: https://www.mixamo.com/#/.
  47. Mulder, M. (2014). Conceptions of professional competence. International Handbook on Research into professional and practice-based learning Dordrecht: Springer.
  48. Mulder, M., & Winterton, J. (2017). Introduction. Competence-based vocational and professional education. Bridging the worlds of work and education, pp. 1-43. Cham: Springer.
  49. Nichols, S., & Patel, H. (2002). Health and safety implications of virtual reality: A review of empirical evidence. Applied Ergonomics, 33(3), pp. 251-271.
  50. Noroozi, O., Biemans, H.J., & Mulder, M. (2016). Relations between scripted online peer feedback processes and quality of written argumentative essay. The Internet and Higher Education, 31, pp. 20-31.
  51. Noroozi, O., Biemans, H.J., Weinberger, A., Mulder, M., & Chizari, M. (2013). Scripting for construction of a transactive memory system in multidisciplinary CSCL environments. Learning and Instruction, 25(1), pp. 1-12.
  52. Noroozi, O., Weinberger, A., Biemans, H.J., Mulder, M., & Chizari, M. (2013). Facilitating argumentative knowledge construction through a transactive discussion script in CSCL. Computers & Education, 61, pp. 59-76.
  53. Opris, D., Pintea, S., García‐Palacios, A., Botella, C., Szamosközi, Ş., & David, D. (2012). Virtual reality exposure therapy in anxiety disorders: A quantitative meta‐analysis. Depression and Anxiety, 29(2), pp. 85-93.
  54. Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9(0), pp. 129-144.
  55. Pasqualotti, A., & Freitas, C.M.D.S. (2002). MAT3D: A virtual reality modeling language environment for the teaching and learning of mathematics. CyberPsychology & Behavior, 5(5), pp. 409-422.
  56. Pertaub, D.-P., Slater, M., & Barker, C. (2001). An experiment on fear of public speaking in virtual reality. Medicine meets virtual reality, pp. 372-378.
  57. Popov, V., Noroozi, O., Barrett, J.B., Biemans, H., Teasley, S.D., & Slof, B. (2014). Perceptions and experiences of, and outcomes for, university students in culturally diversified dyads in a computer-supported collaborative learning environment. Computers in Human Behavior, 32, pp. 186-200.
  58. Porte, M.C., Xeroulis, G., Reznick, R.K., & Dubrowski, A. (2007). Verbal feedback from an expert is more effective than self-accessed feedback about motion efficiency in learning new surgical skills. The American Journal of Surgery, 193(1), pp. 105-110.
  59. Prins, F.J., De Kleijn, R., & Van Tartwijk, J. (2015). Students' use of a rubric for research theses. Assessment & Evaluation in Higher Education.
  60. Reis, S.M., & Renzulli, J.S. (2010). Is there still a need for gifted education? An examination of current research. Learning and Individual Differences, 20(4), pp. 308-317.
  61. Reitmeier, C.A., & Vrchota, D.A. (2009). Self-assessment of oral communication presentations in food science and nutrition. Journal of Food Science Education, 8(4), pp. 88-92.
  62. Richards, D., & Taylor, M. (2015). A Comparison of learning gains when using a 2D simulation tool versus a 3D virtual world: An experiment to find the right representation involving the Marginal Value Theorem. Computers & Education, 86, pp. 157-171.
  63. Riva, G. (2003). Applications of virtual environments in medicine. Methods of Information in Medicine, 42, pp. 524-534.
  64. Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015). Presentation trainer: What experts and computers can tell about your nonverbal communication. Journal of Computer Assisted Learning, 33, pp. 164-177.
  65. Sitzmann, T. (2011). A meta‐analytic examination of the instructional effectiveness of computer‐based simulation games. Personnel Psychology, 64(2), pp. 489-528.
  66. Smith, C.M., & Sodano, T.M. (2011). Integrating lecture capture as a teaching strategy to improve student presentation skills through self-assessment. Active Learning in Higher Education, 12(3), pp. 151-162.
  67. Tanveer, M.I., Lin, E., & Hoque, M.E. (2015). Rhema: A real-time in-situ intelligent interface to help people with public speaking. Proceedings of the 20th international conference on intelligent user interfaces, pp. 286-295.
  68. Tobias, S., & Fletcher, J.D. (2010). Introduction. Computer games and instruction, pp. 3-16. Charlotte, NC: Information Age.
  69. Unity Technologies (2014). Unity. (2014). Available online: https://unity3d.com/.
  70. Van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2015). Towards a set of design principles for developing oral presentation competence: A synthesis of research in higher education. Educational Research Review, 14, pp. 62-80.
  71. Van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2015). The impact of the feedback source on developing oral presentation competence. Studies in Higher Education, pp. 1-15.
  72. Van Ginkel, S., Gulikers, J., Biemans, H., & Mulder, M. (2016). Fostering oral presentation performance: Does the quality of feedback differ when provided by the teacher, peers or peers guided by tutor?. Assessment and Evaluation in Higher Education, pp. 1-14.
  73. Van Ginkel, S., Laurentzen, R., Mulder, M., Mononen, A., Kyttä, J., & Kortelainen, M.J. (2017). Assessing oral presentation performance: Designing a rubric and testing its validity with an expert group. Journal of Applied Research in Higher Education, 9(3), pp. 474-486.
  74. Van Haaren, M., & Van der Rijst, R. (2014). Teaching talented students at a research-intensive university. Pursuit of excellence in a networked society: Theoretical and practical approaches, pp. 39-46. Münster: Waxmann.
  75. Vogel, J.J., Vogel, D.S., Cannon-Bowers, J., Bowers, C.A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), pp. 229-243.
  76. Washer, P. (2007). Revisiting key skills: A practical framework for higher education. Quality in Higher Education, 13(1), pp. 57-67.
  77. Wuensch, K. (2012). Equivalence tests for two means using differences. Available online: https://www.ncss.com/wp-content/themes/ncss/pdf/Procedures/PASS/Equivalence_Tests_for_Two_Means_using_Differences.pdf.
  78. Wuensch, K. (2014). Tests of equivalence and confidence intervals for effect sizes. Available online: http://core.ecu.edu/psyc/WuenschK/docs30/Equivalence-EffectSizeCI.pdf.

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References

Also Read

Pages You've Visited

Abstracts