You are here:

Examining Chocolate-Covered Broccoli: Eyetracking Evaluation of the ExMan Serious Game

, , , North-West University, South Africa

EdMedia + Innovate Learning, in Montreal, Quebec, Canada ISBN 978-1-939797-16-2 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC


Engaging users to playtest serious games during game design uncovers the value of design elements that contribute towards learning and fun during gameplay. During a first wire-frame test of the functionality of the ExMan serious game, students’ learning and their learning experiences increased. They indicated that they did not like reading information task passages. It was not obvious how students utilized these passages during gameplay to collect information to progress to a next game level. For the adequate depth of processing of information, fixation duration is necessary. We propose that eyetracking could record how users attended to a design element in serious games. The longer an area of interest (AOI) is visited, the higher the cognitive load, and the deeper the processing of the information. This paper analyses the extent to which foodservice management students at a South African university fixated on an AOI in a food service management serious game.


Blignaut, S., Matthew, G. & Botha-Ravyse, C. (2015). Examining Chocolate-Covered Broccoli: Eyetracking Evaluation of the ExMan Serious Game. In S. Carliner, C. Fulford & N. Ostashewski (Eds.), Proceedings of EdMedia 2015--World Conference on Educational Media and Technology (pp. 28-37). Montreal, Quebec, Canada: Association for the Advancement of Computing in Education (AACE). Retrieved December 16, 2018 from .


View References & Citations Map


  1. Alkan, S., & Cagiltay, K. (2007). Studying computer game learning experience through eye tracking. British Journal of Educational Technology, 38(3), 538-542.
  2. Anderson, C.W. (2007). Perspectives on science learning. In S.K. Abell& N.G. Lederman (Eds.), Handbook of research on science education (pp. 3-30). NY: Routledge.
  3. Botha-Ravyse, C.R., Blignaut, A.S., & Hanekom, S.M. (2015). “I fired the chef!” Simulation gameplay for enhancing management skills of health profession students. Simulation in Healthcare, In progress.
  4. Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., & Boyle, J.M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers& Education, 59(2012), 661686.
  5. Corcoran, P.M., Nanu, F., Petrescu, S., & Bigioi, P. (2012). Real-time eye gaze tracking for gaming design and consumer electronics systems. IEEE Transactions on Consumer Electronics, 58(May 2012), 347-355.
  6. Cutrell, E., & Guan, Z. (2007). What Are You Looking For? An Eye-tracking Study of Information Usage in Web Search. Paper presented at the CHI 2007: Gaze & Eye Tracking, San Juan, CA.
  7. Farber, M. (2014). Why serious games are not chocolate-covered broccoli Retrieved February 27, 2015, from Hansen, J.P. (1990). The use of eye mark recordings to support verbal retrospection. Acta Psychologica(1990), 31-49.
  8. Hornof, A.J., & Halverson, T. (2003). Cognitive strategies and eye movements for searching hierarchical computer displays. Paper presented at the Proc. CHI 2003, ACM Press.
  9. IBM Statistics. (2014). SPSS Statistics Desktop version 22.0 Retrieved March, 2015, from
  10. Jacob, R.J., & Karn, S.K. (2003). Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In J. Hyönä, R. Radach & H. Deubel (Eds.), The mind’s eye: Cognitive and applied aspects of eye movement research (pp. 573-605). Amsterdam: Elsevier Science.
  11. Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005). Accurately interpreting clickthrough data as implicit feedback. Paper presented at the Proc. SIGIR 2005, ACMPress.
  12. Johansen, S.A., Nørgaard, M., & Rau, J. (2006). Can eye tracking boost usability evaluation of computer games? Paper presented at the Proceedings of CHI, Http:// & Q=eye+tracking+%2B+video+games & Hl=en & As_sdt=0,5
  13. Johnson, L., Adams Becker, S., Estrada, V., & Freeman, A. (2015). NMC Horizon Report: 2015 Higher Education Edition. Austin, Texas: The New Media Consortium.
  14. Jönsson, E. (2005). If looks could kill – An evaluation of eye tracking in computer games. Master’s Degree Master’s Degree, Royal Institute of Technology Stockholm, Sweden.
  15. Kallinen, K., Salminen, M., Ravaja, N., Kedzior, R., & Sääksjärvi, M. (2007). Presence and emotion in computer game players during 1st person vs. 3rd person playing view: evidence from self-report, eyetracking, and facial muscle activity data. Paper presented at the?? http:///
  16. Kickmeier-Rust, M.D., Hillemann, E., & Albert, D. (2011). Tracking the UFO’s paths: Using eye-tracking for the evaluation of serious games. Virtual and Mixed Reality-New Trends, 6773(2011), 315-324.
  17. Kiili, K., Ketamo, H., & Kickmeier-Rust, M.D. (2014). Eye tracking in game-based learning research and game design. International Journal of Serious Games, 1(2, 2014), 51-65.
  18. Kumar, J.M., & Herger, M. (2013). Gamification at work: Designing engaging business software The Interaction Design Foundation (Ed.) Retrieved from
  19. LeCompte, M.D., & Preissle, J. (1993). Ethnography and qualitative design in educational research. San Diego: Academic Press.
  20. Lorigo, L., Pan, B., Hembrooke, H., Joachims, T., Granka, L., & Gay, G. (2006). The influence of task and gender on search and evaluation behavior using Google. Processing and Management: An International Journal, 42(2), 1123-1131.
  21. Marsh, T. (2007). Informing design and evaluation methodologies for serious games for learning Retrieved February, 19, 2015, from & Rct=j & Q= & Esrc=s & Source=web & Cd=2 & Ved=0CC0QFjAB & Url=http
  22. Moreno-Ger, P., Torrente, J., Hsieh, Y.G., & Lester, W.T. (2012). Usability Testing for Serious Games: Making Informed Design Decisions with User Data. Advances in Human-Computer Interaction, 2012, 13.
  23. Neill, T. (2009). Serious games: learning for the igeneration. Development and Learning in Organisations: An International Journal, 23(4), 12-15.
  24. Nørgaard, M., & Rau, J. (2007). User testing in the combat zone: Methods for evaluating games-How to measure usability and user experience in games. Paper presented at the Workshop of the International Conference on Advances in Computer Entertainment Technology (ACE2007).
  25. Peters, C., & Qureshi, A. (2010). Ahead movement propensity model for animating gaze shifts and blinks of virtual characters. [Article]. Computers& Graphics, 34(6), 677-687.
  26. Ramloll, R., Trepagnier, C., Sebrechts, M., & Beedasy, J. (2004). Gaze data visualization tools: opportunities and challenge. Paper presented at the The Eighth International Conference on Information Visualisation (IV’04). Http://,K.(1998).Eyemovement in reading and information processing: 20 years of research. Psychological Bulletins, 124(3), 372-422.
  27. Renshaw, T., Stevens, R., & Denton, P.D. (2009). Towards understanding engagement in games: an eyetracking study. On the Horizon, 17(4), 408-420.
  28. Satterthwaite, F.E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2(6), 110-114.
  29. Špakov, O. (2007). EyeChess: the tutoring game with visual attentive interface Retrieved February, 18, 2015, from Westera, W., Nadolski, R., Hummel, H., & Wopereis, I. (2008). Serious games for higher education: a framework for reducing design complexity. Journal of Computer Assisted Learning, 24(2008), 420432.
  30. Wolfram. (2015). How to perform a bootstrap analysis Retrieved March, 29, 2015, from

These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact