You are here:

Developing an evaluation framework for identifying globally shared and locally specific requirements for the design and use of educational technology

, University of Jyväskylä, Finland

Society for Information Technology & Teacher Education International Conference, in Las Vegas, NV, United States ISBN 978-1-939797-13-1 Publisher: Association for the Advancement of Computing in Education (AACE), Chesapeake, VA


This paper presents a preliminary evaluation framework for identifying globally shared and locally specific requirements for the design and use of educational technology. The framework was developed initially from a literature review, and subsequently further refined in international collaboration between Chile, Finland, Singapore, South Korea, Spain, and the United Arab Emirates. It consists of three partially overlapping parts: I) Education, teaching and learning; II) Culture and society; and III) Design and use of technological learning solutions. In addition to providing an evaluation tool for designers and researchers, the framework can support educators’ and student teachers’ cultural awareness and sensibility both when selecting and using educational technology.


Mäkelä, T. (2015). Developing an evaluation framework for identifying globally shared and locally specific requirements for the design and use of educational technology. In D. Rutledge & D. Slykhuis (Eds.), Proceedings of SITE 2015--Society for Information Technology & Teacher Education International Conference (pp. 1220-1226). Las Vegas, NV, United States: Association for the Advancement of Computing in Education (AACE). Retrieved March 24, 2019 from .


View References & Citations Map


  1. Connell, B.R., Jones, M., Mace, R., Mueller, J., Mullick, A., Ostroff, E., Sanford, J., Steinfeld, E., Story, M., & Vanderheiden, G. (1997). The principles of universal design, Version 2.0-4/1/97.
  2. Downey, S., Wentling, R.M., Wentling, T. & Wadsworth, A. (2005). The relationship between national culture and the usability of an e-learning system, Human Resource Development International, Vol. 8, No. 1, (pp. 47-64).
  3. Edmundson, A (2007). The Cultural Adaptation Process (CAP) Model: Designing E-Learning for Another Culture. In Edmundson, A. (Ed.) Globalized E-Learning, Cultural Challenges. Idea Group, U.S., (pp. 267-290).
  4. Fisher, D.L. & Waldrip, B.G. (1999). Cultural Factors of Science Classroom Learning Environments, TeacherStudent Interactions and Student Outcomes, Research in Science& Technological Education, 17:1 (pp. 83-96).
  5. Henderson, L. (1996). Instructional design of interactive multimedia: a cultural critique, Educational Technology Research and Development, 44 (4), (pp. 85-104).
  6. Hofstede, G. (1986). Cultural Differences in Teaching and Learning, International Journal of Intercultural Relations 10 (pp. 301-320).
  7. Inglehart, R. & Welzel, C. (2010). Changing Mass Priorities: The Link between Modernization and Democracy, World Values Survey. Retrieved on 03.01.2015 from ISO (2011). ISO/IEC 15897 Information technology-procedures for registration of cultural elements. International Organization for Standardization (ISO).
  8. Kankaanranta, M. & Mäkelä, T. (2014). Valuation of emerging learning solutions, World Conference on Educational Multimedia, Hypermedia and Telecommunications 2014, (pp. 168-172).
  9. Law, N., Kankaanranta, M. & Chow, A. (2005). Technology-supported education innovations in Finland and Hong Kong: A tale of two systems, Human Technology, 1 (2) (pp. 176-201).
  10. Lee, C.D. (2003). Toward a framework for culturally responsive design in multimedia computer environments: Cultural Modelling as a Case, Mind, Culture, and Activity, 10:1, (pp. 42-61).
  11. Lee, I., Woong Choi, G., Kim, J., Kim, S., Lee, K., Kim, D., Han, M., Yong Park, S., & An, Y. (2008). Cultural dimensions for user experience: Cross-country and cross-product analysis of users’ cultural characteristics, British Computer Society, (pp. 3-12).
  12. Marcus, A. & Gould, E.W. (2001). Crosscurrents: Cultural dimensions and global web user interface design, Interactions, 7:2, (pp. 32-46).
  13. Minkov, M. & Hofstede, G. (2011). The evolution of Hofstede’s doctrine, Cross cultural management: An International Journal 18 (1), (pp. 10-20).
  14. Mäkelä, T., Kankaanranta, M., Young, B. & Alshannag, Q. (2014). In Search of Localization Criteria for Learning Solutions: Examining the localization needs of Finnish learning solutions in the United Arab Emirates, World Conference on Educational Multimedia, Hypermedia and Telecommunications 2014, (pp. 2596-2603).
  15. Nikolopoulou, K. (2007). Early Childhood Educational Software: Specific Features and Issues of Localization, Early Childhood Education Journal, Vol. 35, Issue 2, (pp. 173-179).
  16. OECD (2014). TALIS 2013 Results: An International Perspective on Teaching and Learning. OECD Publishing.
  17. OECD (2013). PISA 2012 Results in Focus. OECD Publishing.
  18. OECD (2011). PISA 2009 results: Students onLine-Digital Technologies and performance. OECD Publishing.
  19. Reeves, T.C. (1994). Evaluating what really matters in computer-based education. In M. Wild, & D. Kirkpatrick, (Eds.), Computer education: New Perspectives. Perth, Australia: MASTEC, (pp. 219-246).
  20. Richter, T. & Pawlowski, J.M. (2007). The need for standardization of context metadata for e-Learning environments, Proceeding of e-ASEM Conference, Seoul, Korea.
  21. Rogers, P.C., Graham, C.R. & Mayes, C.T. (2007). Cultural Competence and Instructional Design: Exploration Research into the Delivery of Online Instruction Cross-culturally, Educational Technology Research& Development, 55 (2), (pp. 197-217).
  22. Trompenaars, F., Hampden-Turner, C. (1997). Riding the Waves of Culture. McGraw-Hill.
  23. Wallace, S., Reid, A., Clinciu, D. & Kang, J-S (2013). Culture and the importance of usability attributes, Information Technology& People, Vol. 26, No. 1, (pp. 77-93).
  24. Watkins, D. (2000). Learning and teaching. Across-cultural perspective, School Leadership and Management: Formerly School Organization, 20:2, (pp. 161-173).
  25. Young, P.A. (2008). The culture based model: Constructing a model of culture, Educational Technology& Society, 11 (2), (pp. 107-118).

These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact


Slides w/Audio View