You are here:

Testing a TPACK-Based Technology Integration Observation Instrument
PROCEEDINGS

, College of William and Mary, United States ; , University of Nebraska at Omaha, United States ; , College of William and Mary, United States ; , University of Kentucky, United States

Society for Information Technology & Teacher Education International Conference, in Nashville, Tennessee, USA ISBN 978-1-880094-84-6 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA

Full Text

Abstract

Teachers’ knowledge for technology integration – conceptualized as technological pedagogical content knowledge, or TPACK (Mishra & Koehler 2006) – is difficult to discern, much less assess. Given the complexity, situatedness and interdependence of the types of knowledge represented by the TPACK construct, well-triangulated ways to assess demonstrated technology integration knowledge are needed. In 2009, three of the authors created and tested a rubric that was found to be a valid and reliable instrument to assess the TPACK evident in teachers’ written lesson plans (Harris, Grandgenett & Hofer 2010). We have now also developed a TPACK-based observation rubric that testing has shown to be robust. The instrument’s interrater reliability coefficient (.802) was computed using both Intraclass Correlation and a percent score agreement (90.8%) procedure. Internal consistency (Cronbach’s Alpha) was .914. Test-retest reliability (score agreement) was 93.9%.

Citation

Hofer, M., Grandgenett, N., Harris, J. & Swan, K. (2011). Testing a TPACK-Based Technology Integration Observation Instrument. In M. Koehler & P. Mishra (Eds.), Proceedings of SITE 2011--Society for Information Technology & Teacher Education International Conference (pp. 4352-4359). Nashville, Tennessee, USA: Association for the Advancement of Computing in Education (AACE). Retrieved August 6, 2024 from .

Keywords

References

View References & Citations Map
  1. Allen, M.J. & Yen, W.M. (2002). Introduction to measurement theory. Long Grove, IL: Waveland Press.
  2. American Association of Colleges of Teacher Education (2008). The handbook of technological pedagogical content knowledge for educators. New York: Routledge.
  3. Archambault, L.M., & Barnett, J.H. (2010). Revisiting technological pedagogical content knowledge: Exploring the TPACK framework. Computers& Education, 55 (4), 1656-1662.
  4. Arter, J., & McTighe, J. (2001). Scoring rubrics in the classroom. Thousand Oaks: Corwin Press, Inc.
  5. Barab, S.A., Hay, K.E., & Duffy, T. (1999). Grounded constructions and how technology can help. TechTrends, 43 (2), 15-23.
  6. Brunvand, S. (2010). Best practices for producing video content for teacher education. Contemporary Issues in Technology and Teacher Education, 10 (2), 247-256.
  7. Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability of scores and profiles. New York: Wiley.
  8. De Olvieira, J.M. & Romero, M. (2010). Student teachers’ perceptions of knowledge and knowledge of perception. In J. Herrington& B. Hunter (Eds.), Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2010 (pp. 2351-2356). Chesapeake, VA: AACE.
  9. Field, A.P. (2005). Intraclass correlation. In B.S. Everitt & D.C. Howell (Eds.). Encyclopedia of statistics in the behavioral sciences (pp. 1296-1305). Chichester, England: Wiley.
  10. Fishman, B. (2003). Linking on-line video and curriculum to leverage community knowledge. In J. Brophy (Ed.), Advances in research on teaching: Using video in teacher education (Vol. 10, pp. 210-234). New York, NY: Elsevier Science.
  11. Graham, C.R., Burgoyne, N. & Borup, J. (2010). The decision-making processes of preservice teachers as they integrate technology. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3826-3832). Chesapeake, VA: AACE.
  12. Griffin, D., & Gonzalez, R. (1995). Correlational analysis of dyad-level data in the exchangeable case. Psychological Bulletin, 118, 430-439.
  13. Gronlund, N.E. (1985). Measurement and evaluation in teaching (5th ed.). New York: McMillian.
  14. Harris, J., Grandgenett, N., & Hofer, M. (2010). Testing a TPACK-based technology integration assessment rubric. In D. Gibson& B. Dodge (Eds.), Proceedings of Society for Information Technology& Teacher Education International Conference 2010 (pp. 3833-3840). Chesapeake, VA: AACE.
  15. Hechter, R. & Phyfe, L. (2010). Using online videos in the science methods classroom as context for developing preservice teachers’ awareness of the TPACK components. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3841-3848). Chesapeake, VA: AACE.
  16. Jaipal, K. & Figg, C. (2010). Expanding the practice-based taxonomy of characteristics of TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 38683875).
  17. Lee, M.-H., & Tsai, C.-C. (2010). Exploring teachers’ perceived self-efficacy and technological pedagogical content knowledge with respect to educational use of the WorldWide Web. Instructional Science, 38 (1), 1-21.
  18. Litwin, M.S. (2002). How to assess and interpret survey psychometrics. The Survey Kit Series (Vol. 8). Thousand Oaks, CA: Sage Publications.
  19. McGraw, K.O., & Wong, S.P. (1996). Forming inferences about some intraclass correlation coefficients, Psychological Methods, 1 (1), 30-46.
  20. Mishra, P., & Koehler, M.J. (2006). Technological pedagogical content knowledge: A new framework for teacher knowledge. Teachers College Record, 108 (6), 1017-1054.
  21. Moskal, B.M., & Leydens, J.A. (2000). Scoring rubric development: Validity and reliability. Practical Assessment, Research& Evaluation, 7, 71-81.
  22. Niess, M. & Gillow-Wiles, H. (2010). Advancing K-8 mathematics and science teachers knowledge for teaching with technology through an online graduate program. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3911-3919). Chesapeake, VA: AACE.
  23. Northwest Educational Technology Consortium (2004). Observation protocol for technology integration in the classroom (OPTIC). Portland, OR: NETC. Retrieved from http://www.netc.org/assessing/home/integration.php
  24. Novak, J.R., Herman, J.L., & Gearhart, M. (1996). Establishing validity for performance-based assessments: An illustration for collections of student writing. Journal of Educational Research, 89 (4), 220-233.
  25. Putnam, R.T. & Borko, H. (2000). What do new views of knowledge and thinking have to say about research on teacher learning? Educational Researcher, 29 (1), 4-15.
  26. Robertshaw, M.B. & Gillam, R.B. (2010). Examining the validity of the TPACK framework from the ground up: Viewing technology integration through teachers’ eyes. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3926-3931). Chesapeake, VA: AACE.
  27. Schmidt, D., Baran, E., Thompson, A., Koehler, M.J., Shin, T, & Mishra, P. (2009, April). Technological Pedagogical Content Knowledge (TPACK): The development and validation of an assessment instrument for preservice teachers. Paper presented at the 2009 Annual Meeting of the American Educational Research Association, San Diego, CA. Retrieved from http://mkoehler.educ.msu.edu/unprotected_readings/TPACK_Survey/Schmidt_et_al_Survey_v1.pdf
  28. Schrader, P.G., & Lawless, K.A. (2004). The knowledge, attitudes, and behaviors (KAB) approach: How to evaluate performance and learning in complex environments. Performance Improvement, 43 (9), 8–15.
  29. Shulman, L. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15 (2), 4-14.
  30. Shulman, L.S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57 (1). 1-22.
  31. Stoilescu, D. & McDougall, D. (2010). Case studies of teachers integrating computer technology in mathematics. In J. Herrington& B. Hunter (Eds.), Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2010 (pp. 2944-2952). Chesapeake, VA: AACE.
  32. Ward, G. & Overall, T. (2010). Pre-service teacher technology integration: The team-taught cohort model and TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3944-3951). Chesapeake, VA: AACE.
  33. Williams, M.K., Foulger, T. & Wetzel, K. (2010). Aspiring to reach 21st century ideals: Teacher educators’ experiences in developing their TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3960-3967). Chesapeake, VA: AACE.
  34. Zambo, R., Wetzel, K., Buss, R., Padgett, H. (2003). Measuring the integration of technology through observation. In C. Crawford, N. Davis, J. Price, R. Weber, & D. Willis. (Eds.) Technology and Teacher Education Annual (pp. 3933-3936).

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References

Cited By

View References & Citations Map

These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.

Also Read

Related Collections

Pages You've Visited

Abstracts