Testing a TPACK-Based Technology Integration Observation Instrument
PROCEEDINGS
Mark Hofer, College of William and Mary, United States ; Neal Grandgenett, University of Nebraska at Omaha, United States ; Judi Harris, College of William and Mary, United States ; Kathy Swan, University of Kentucky, United States
Society for Information Technology & Teacher Education International Conference, in Nashville, Tennessee, USA ISBN 978-1-880094-84-6 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA
Abstract
Teachers’ knowledge for technology integration – conceptualized as technological pedagogical content knowledge, or TPACK (Mishra & Koehler 2006) – is difficult to discern, much less assess. Given the complexity, situatedness and interdependence of the types of knowledge represented by the TPACK construct, well-triangulated ways to assess demonstrated technology integration knowledge are needed. In 2009, three of the authors created and tested a rubric that was found to be a valid and reliable instrument to assess the TPACK evident in teachers’ written lesson plans (Harris, Grandgenett & Hofer 2010). We have now also developed a TPACK-based observation rubric that testing has shown to be robust. The instrument’s interrater reliability coefficient (.802) was computed using both Intraclass Correlation and a percent score agreement (90.8%) procedure. Internal consistency (Cronbach’s Alpha) was .914. Test-retest reliability (score agreement) was 93.9%.
Citation
Hofer, M., Grandgenett, N., Harris, J. & Swan, K. (2011). Testing a TPACK-Based Technology Integration Observation Instrument. In M. Koehler & P. Mishra (Eds.), Proceedings of SITE 2011--Society for Information Technology & Teacher Education International Conference (pp. 4352-4359). Nashville, Tennessee, USA: Association for the Advancement of Computing in Education (AACE). Retrieved August 7, 2024 from https://www.learntechlib.org/primary/p/37015/.
Keywords
References
View References & Citations Map- Allen, M.J. & Yen, W.M. (2002). Introduction to measurement theory. Long Grove, IL: Waveland Press.
- American Association of Colleges of Teacher Education (2008). The handbook of technological pedagogical content knowledge for educators. New York: Routledge.
- Archambault, L.M., & Barnett, J.H. (2010). Revisiting technological pedagogical content knowledge: Exploring the TPACK framework. Computers& Education, 55 (4), 1656-1662.
- Arter, J., & McTighe, J. (2001). Scoring rubrics in the classroom. Thousand Oaks: Corwin Press, Inc.
- Barab, S.A., Hay, K.E., & Duffy, T. (1999). Grounded constructions and how technology can help. TechTrends, 43 (2), 15-23.
- Brunvand, S. (2010). Best practices for producing video content for teacher education. Contemporary Issues in Technology and Teacher Education, 10 (2), 247-256.
- Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability of scores and profiles. New York: Wiley.
- De Olvieira, J.M. & Romero, M. (2010). Student teachers’ perceptions of knowledge and knowledge of perception. In J. Herrington& B. Hunter (Eds.), Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2010 (pp. 2351-2356). Chesapeake, VA: AACE.
- Field, A.P. (2005). Intraclass correlation. In B.S. Everitt & D.C. Howell (Eds.). Encyclopedia of statistics in the behavioral sciences (pp. 1296-1305). Chichester, England: Wiley.
- Fishman, B. (2003). Linking on-line video and curriculum to leverage community knowledge. In J. Brophy (Ed.), Advances in research on teaching: Using video in teacher education (Vol. 10, pp. 210-234). New York, NY: Elsevier Science.
- Graham, C.R., Burgoyne, N. & Borup, J. (2010). The decision-making processes of preservice teachers as they integrate technology. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3826-3832). Chesapeake, VA: AACE.
- Griffin, D., & Gonzalez, R. (1995). Correlational analysis of dyad-level data in the exchangeable case. Psychological Bulletin, 118, 430-439.
- Gronlund, N.E. (1985). Measurement and evaluation in teaching (5th ed.). New York: McMillian.
- Harris, J., Grandgenett, N., & Hofer, M. (2010). Testing a TPACK-based technology integration assessment rubric. In D. Gibson& B. Dodge (Eds.), Proceedings of Society for Information Technology& Teacher Education International Conference 2010 (pp. 3833-3840). Chesapeake, VA: AACE.
- Hechter, R. & Phyfe, L. (2010). Using online videos in the science methods classroom as context for developing preservice teachers’ awareness of the TPACK components. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3841-3848). Chesapeake, VA: AACE.
- Jaipal, K. & Figg, C. (2010). Expanding the practice-based taxonomy of characteristics of TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 38683875).
- Lee, M.-H., & Tsai, C.-C. (2010). Exploring teachers’ perceived self-efficacy and technological pedagogical content knowledge with respect to educational use of the WorldWide Web. Instructional Science, 38 (1), 1-21.
- Litwin, M.S. (2002). How to assess and interpret survey psychometrics. The Survey Kit Series (Vol. 8). Thousand Oaks, CA: Sage Publications.
- McGraw, K.O., & Wong, S.P. (1996). Forming inferences about some intraclass correlation coefficients, Psychological Methods, 1 (1), 30-46.
- Mishra, P., & Koehler, M.J. (2006). Technological pedagogical content knowledge: A new framework for teacher knowledge. Teachers College Record, 108 (6), 1017-1054.
- Moskal, B.M., & Leydens, J.A. (2000). Scoring rubric development: Validity and reliability. Practical Assessment, Research& Evaluation, 7, 71-81.
- Niess, M. & Gillow-Wiles, H. (2010). Advancing K-8 mathematics and science teachers knowledge for teaching with technology through an online graduate program. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3911-3919). Chesapeake, VA: AACE.
- Northwest Educational Technology Consortium (2004). Observation protocol for technology integration in the classroom (OPTIC). Portland, OR: NETC. Retrieved from http://www.netc.org/assessing/home/integration.php
- Novak, J.R., Herman, J.L., & Gearhart, M. (1996). Establishing validity for performance-based assessments: An illustration for collections of student writing. Journal of Educational Research, 89 (4), 220-233.
- Putnam, R.T. & Borko, H. (2000). What do new views of knowledge and thinking have to say about research on teacher learning? Educational Researcher, 29 (1), 4-15.
- Robertshaw, M.B. & Gillam, R.B. (2010). Examining the validity of the TPACK framework from the ground up: Viewing technology integration through teachers’ eyes. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3926-3931). Chesapeake, VA: AACE.
- Schmidt, D., Baran, E., Thompson, A., Koehler, M.J., Shin, T, & Mishra, P. (2009, April). Technological Pedagogical Content Knowledge (TPACK): The development and validation of an assessment instrument for preservice teachers. Paper presented at the 2009 Annual Meeting of the American Educational Research Association, San Diego, CA. Retrieved from http://mkoehler.educ.msu.edu/unprotected_readings/TPACK_Survey/Schmidt_et_al_Survey_v1.pdf
- Schrader, P.G., & Lawless, K.A. (2004). The knowledge, attitudes, and behaviors (KAB) approach: How to evaluate performance and learning in complex environments. Performance Improvement, 43 (9), 8–15.
- Shulman, L. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15 (2), 4-14.
- Shulman, L.S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57 (1). 1-22.
- Stoilescu, D. & McDougall, D. (2010). Case studies of teachers integrating computer technology in mathematics. In J. Herrington& B. Hunter (Eds.), Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2010 (pp. 2944-2952). Chesapeake, VA: AACE.
- Ward, G. & Overall, T. (2010). Pre-service teacher technology integration: The team-taught cohort model and TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3944-3951). Chesapeake, VA: AACE.
- Williams, M.K., Foulger, T. & Wetzel, K. (2010). Aspiring to reach 21st century ideals: Teacher educators’ experiences in developing their TPACK. In D. Gibson& B. Dodge (Eds.), Proceedings of the Society for Information Technology& Teacher Education International Conference 2010 (pp. 3960-3967). Chesapeake, VA: AACE.
- Zambo, R., Wetzel, K., Buss, R., Padgett, H. (2003). Measuring the integration of technology through observation. In C. Crawford, N. Davis, J. Price, R. Weber, & D. Willis. (Eds.) Technology and Teacher Education Annual (pp. 3933-3936).
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to ReferencesCited By
View References & Citations Map-
Conducting Classroom Observations to Understand TPACK: Moving Beyond Self-reported Data
Shu-Ju Diana Tai & Denise Crawford, Center for Technology in Learning & Teaching, Iowa State University, United States
Society for Information Technology & Teacher Education International Conference 2014 (Mar 17, 2014) pp. 2661–2664
-
Using Technology Pedagogical Content Knowledge Development to Enhance Learning Outcomes
Agyei Douglas, University of Cape Coast, Ghana; Jared Keengwe, University of North Dakota, United States
Society for Information Technology & Teacher Education International Conference 2014 (Mar 17, 2014) pp. 2473–2481
-
Measuring TPACK... Yes! But how? A working session
Petra Fisser, National Institute for Curriculum Development, Netherlands; Lara Ervin, San Jose State University, United States; Joke Voogt, University of Amsterdam, Netherlands; Matt Koehler, Michigan State University, United States
Society for Information Technology & Teacher Education International Conference 2014 (Mar 17, 2014) pp. 907–908
-
Understanding the Effectiveness of ICT Professional Learning through the TPACK Conceptual Framework: A Case Study
Jennifer de Vries & Tania Broadley, Curtin University, Australia
EdMedia + Innovate Learning 2013 (Jun 24, 2013) pp. 506–514
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.