Selecting teachers and prospective teachers: A meta-analysis
ARTICLE
Robert M. Klassen, Lisa E. Kim
Educational Research Review Volume 26, Number 1, ISSN 1747-938X Publisher: Elsevier Ltd
Abstract
The purpose of this review article was to examine the methods used for the selection of teachers for employment and prospective teachers entering initial teacher education (ITE) programs, and to assess the predictive validity of these methods. We reviewed 32 studies reporting selection methods administered in high-stakes conditions and that included an external (not self-reported) teacher effectiveness outcome measure. The overall effect size was small but significant (r = 0.12, p < .001). Moderator analyses showed that academic and non-academic predictors were both significantly associated with teacher effectiveness measures and that effect sizes were small (but significant) for selection into employment and ITE. We conclude the review by proposing a research agenda that has the potential to enhance educational outcomes by improving the selection of prospective teachers.
Citation
Klassen, R.M. & Kim, L.E. (2019). Selecting teachers and prospective teachers: A meta-analysis. Educational Research Review, 26(1), 32-51. Elsevier Ltd. Retrieved March 5, 2021 from https://www.learntechlib.org/p/204433/.
This record was imported from
Educational Research Review
on March 15, 2019.
Educational Research Review is a publication of Elsevier.
Keywords
References
View References & Citations Map- Abdelfattah, F. (2010). The relationship between motivation and achievement in low-stakes examinations. Social Behavior and Personality: International Journal, 38, pp. 159-167.
- Antoniou, P., Kyriakides, L., & Creemers, B.P.M. (2015). The dynamic integrated approach to teacher professional development: Rationale and main characteristics. Teacher Development, 19, pp. 535-552.
- Atteberry, A., Loeb, S., & Wyckoff, J. (2015). Do first impressions matter? Predicting early career teacher effectiveness. AERA Open, 1(4), pp. 1-23.
- Bahr, N., & Mellor, S. (2016). Building quality in teaching and teacher education. Camberwell, Australia: ACER Press.
- Bangerter, A., Konig, C.J., Blatti, S., & Salvisberg, A. (2009). How widespread is graphology in personnel selection practice? A case study of a job market myth. International Journal of Selection and Assessment, 17, pp. 219-230.
- Barber, M., & Mourshed, M. (2007). How the world's best performing school systems come out on top. London: McKinsey & Company.
- Beier, M.E., & Ackerman, P.L. (2012). Time in personnel selection. The Oxford handbook of personnel assessment and selection, pp. 721-739. Oxford: Oxford University Press.
- Bieri, C., & Schuler, P. (2011). Cross-curricular competencies of student teachers: A selection model based on assessment centre admission tests and study success after the first year of teacher training. Assessment & Evaluation in Higher Education, 36, pp. 399-415.
- Bingham, P.J. (2000). The concurrent and predictive validity of elementary school teacher pre-employment success indicators (Unpublished doctoral dissertation). Austin, Texas: The University of Texas.
- Booth, A., Sutton, A., & Papaioannou, D. (2016). Systematic approaches to a successful literature review. London: Sage.
- Borenstein, M., Hedges, L.V., Higgins, J.P., & Rothstein, H.R. (2009). Introduction to meta-analysis. Chichester: John Wiley & Sons, Ltd.
- Bowles, T., Hattie, J., Dinham, S., Scull, J., & Clinton, J. (2014). Proposing a comprehensive model for identifying teaching candidates. Australian Educational Researcher, 41, pp. 365-380.
- Buresh, R.J. (2003). The predictive validity of the Teacher Perceiver Interview in selecting effective elementary teachers in a mid-sized midwestern school district (Unpublished doctoral dissertation). Grand Forks, North Dakota: University of North Dakota.
- Byrnes, D.A., Kiger, G., & Shechtman, Z. (2003). Evaluating the use of group interviews to select students into teacher-education programs. Journal of Teacher Education, 54, pp. 163-172.
- Casebolt, P.C. (2016). Teacher hiring explored: Examining the effectiveness of educator selection processes. Nashville, TN: Trevecca Nazarene University.
- Casey, C., & Childs, R. (2011). Teacher education admission criteria as measure of preparedness for teaching. Canadian Journal of Education, 34, pp. 3-20.
- Casey, C., & Childs, R.A. (2017). Teacher education program admission criteria and what beginning teachers need to know to be successful teachers. Canadian Journal of Educational Administration and Policy, 67, pp. 1-24.
- Caskey, M.M., Peterson, K.D., & Temple, J.B. (2001). Complex admission selection procedures for a graduate preservice teacher education program. Teacher Education Quarterly, 28(4), pp. 7-21.
- Chamorro-Premuzic, T., & Furnham, A. (2010). The psychology of personnel selection. New York: Cambridge University Press.
- Chesley, D. (2004). The validity of teacher employment success predictors (Unpublished doctoral dissertation). Washington, D. C: George Washington University.
- Chetty, R., Friedman, J.N., & Rockoff, J.E. (2014). Measuring the impacts of teachers I: Evaluating bias in teacher value-added estimates. The American Economic Review, 104, pp. 2593-2632.
- Christian, M.S., Edwards, B.D., & Bradley, J.C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology, 63, pp. 83-117.
- Clemons, B.L. (2010). A correlational study of the Ventures for Excellence Interview-rating system and first year teacher evaluations (Unpublished doctoral dissertation). St. Charles, MO: Lindenwood University.
- Coe, R. (2002). September). It's the effect size, stupid: What effect size is and why it is important. Paper presented at the annual conference of the British educational research association.
- Cook, M. (2009). Personnel selection: Adding value through people. Chichester, UK: Wiley-Blackwell.
- Dana, J., Dawes, R., & Peterson, N. (2013). Belief in the unstructured interview: The persistence of an illusion. Judgment and Decision Making, 8, pp. 512-520.
- Darling-Hammond, L. (2010). Teacher education and the American future. Journal of Teacher Education, 61, pp. 35-47.
- Darling-Hammond, L., & Youngs, P. (2002). Defining “highly qualified teachers:” what does “scientifically-based research” actually tell us?. Educational Researcher, 31, pp. 13-25.
- Davies, P., Connolly, M., Nelson, J., Hulme, M., Kirkman, J., & Greenway, C. (2016). ‘Letting the right one in’: Provider contexts for recruitment to initial teacher education in the United Kingdom. Teaching and Teacher Education, 60, pp. 291-302.
- Denner, P., Norman, A., & Lin, S.Y. (2009). Fairness and consequential validity of teacher work samples. Educational Assessment, Evaluation and Accountability, 21, pp. 235-254.
- Denner, P.R., Salzman, S.A., & Newsome, J.D. (2001). Selecting the qualified: A standards-based teacher education admission process. Journal of Personnel Evaluation in Education, 15, pp. 165-180.
- Ebmeier, H., Dillon, A., & Ng, J. (2007). Employment selection instruments—what we have learned from ten years of research. A paper presented at the annual conference of the American Association of School Personnel Administrators.
- Ebmeier, H., & Ng, J. (2005). Development and field test of an employment selection instrument for teachers in urban school districts. Journal of Personal Evaluation in Education, 18, pp. 201-218.
- Egger, M., Smith, G.D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, pp. 629-634.
- Evans, K.E. (2016). The role of teacher TeacherInsight scores and teacher demographic characteristics in the identification of effective teachers: Using student performance as a validation tool.
- Ferguson, C.J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40, pp. 532-538.
- Fry, T. (2013). Exploring the relationship between the TeacherInsight score and the Teacher Growth Index (Unpublished doctoral dissertation). Ashland, Ohio: Ashland University.
- Gallup Organization (2001). Teacher Perceiver predictive validity study. Lincoln, NE: Author.
- Gayton, S.D., & Kehoe, J.E. (2015). A prospective study of character strengths as predictors of selection into the Australian Army Special Force. Military Medicine, 180, pp. 151-157.
- Gill, B., Shoji, M., Coen, T., & Place, K. (2016). The content, predictive power, and potential bias in widely used teacher observation instruments (REL 2017–191). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. Available online: http://ies.ed.gov/ncee/edlabs.
- Gimbert, B.G., & Chesley, D. (2009). Predicting teacher success using teacher selection practices and classroom performance assessment. Journal of School Leadership, 19, pp. 49-80.
- Goldhaber, D. (2015). Exploring the potential of value-added performance measures to affect the quality of the teacher workforce. Educational Researcher, 44, pp. 87-95.
- Goldhaber, D., Grout, C., & Huntington-Klein, N. (2014). It's selective but is it effective? Exploring the predictive validity of teacher selection tools . CEDR policy brief 2014-9. Seattle, WA: University of Washington.
- Gottheil, E., & Michael, C.M. (1957). Predictor variables employed in research on the selection of medical students. Academic Medicine, 32, pp. 131-147.
- Greenberg, J., McKee, A., & Walsh, K. (2015). Teacher prep review: A review of the nation's teacher preparation programs. Available online: http://www.nctq.org/dmsView/Teacher_Prep_Review_2014_Report.
- Grissom, J.A., & Loeb, S. (2017). Assessing principals' assessments: Subjective evaluations of teacher effectiveness in low- and high-stakes environments. Education Finance and Policy, 12, pp. 369-395.
- Hamre, B.K., Pianta, R.C., Downer, J.T., DeCoster, J., Mashburn, A.J., Jones, S.M., (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 113, pp. 461-487.
- Hanushek, E.A. (2014). Boosting teacher effectiveness. What lies ahead for America's children and their schools, pp. 23-35. Stanford, CA: Hoover Institution Press.
- Hanushek, E.A., & Rivkin, S.G. (2012). The distribution of teacher quality and implications for policy. Annual Review of Economics, 4, pp. 131-157.
- Harris, D.N., & Rutledge, S.A. (2010). Models and predictors of teacher effectiveness: A comparison of research about teaching and other occupations. Teachers College Record, 112, pp. 914-960.
- Hattie, J.A. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Oxford: Routledge.
- Hedges, L.V., & Hedberg, E.C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29, pp. 60-87.
- Heinz, M. (2013). Tomorrow's teachers—selecting the best: An exploration of the quality rationale behind academic and experiential selection criteria for initial teacher education programmes. Educational Assessment, Evaluation and Accountability, 25, pp. 93-114.
- Henry, G.T., Campbell, S.L., Thompson, C.L., Patriarca, L.A., Luterbach, K.J., & Lys, D.B. (2013). The predictive validity of measures of teacher candidate programs and performance: Toward an evidence-based approach to teacher preparation. Journal of Teacher Education, 64, pp. 439-453.
- Higgins, J.P.T., Thompson, S.G., Deeks, J.J., & Altman, D.G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, pp. 557-560.
- Hindman, J., & Stronge, J. (2009). The $2 million decision: Teacher selection and principals' interviewing practice. Educational Research Service Spectrum, 27, pp. 1-10. Available online: http://humanresourcesportfolio.wikispaces.com/.
- Hobson, A.J., Ashby, P., McIntyre, J., & Malderez, A. (2010). International approaches to teacher selection and recruitment. OECD education working papers. Paris: OECD Publishing.
- Jackson, C.K., Rockoff, J.E., & Staiger, D.O. (2014). Teacher effects and teacher-related policies. Annual Review of Economics, 6, pp. 801-825.
- Juracek, T. (2016). Predictability of hiring mechanisms for elementary teachers. Omaha, NE: University of Nebraska.
- Kane, T.J., McCaffrey, D.F., Miller, T., & Staiger, D.O. (2013). Have we identified effective teachers? Validating measures of effective teaching using random assignment. Seattle, WA: Bill and Melinda Gates Foundation.
- Kane, T.J., & Staiger, D.O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Seattle, WA: Bill & Melinda Gates Foundation.
- Kausel, E.E., Culbertson, S.S., & Madrid, H.P. (2016). Overconfidence in personnel selection: When and why unstructured interview information can hurt hiring decisions. Organizational Behavior and Human Decision Processes, 137, pp. 27-44.
- Kidder, W.C. (2001). Does the LSAT mirror or magnify racial and ethnic differences in educational attainment? A study of equally achieving" elite" college students. California Law Review, 1055, pp. 1074-1124.
- Klassen, R.M., & Dolan, R. (2015). Selection for teacher education in the UK and the Republic of Ireland: A proposal for innovation. Presented at the meeting of the European Conference on Educational Research, Budapest, Hungary.
- Klassen, R.M., & Durksen, T.L. (2014). Weekly self-efficacy and work stress during the final teaching practicum: A mixed methods study. Learning and Instruction, 33, pp. 158-169.
- Klassen, R.M., Durksen, T.L., Kim, L.E., Patterson, F., Rowett, E., & Warwick, J. (2017). Developing a proof-of-concept selection test for entry into primary teacher education programs. International Journal of Assessment Tools in Education, 4, pp. 96-114.
- Klassen, R.M., & Kim, L.E. (2018). Development of an online construct-informed situational judgment test for screening applicants for initial teacher education. Retrieved from https://doi.org/10.31234/osf.io/64hry.
- Klassen, R.M., & Tze, V.M.C. (2014). Teachers' self-efficacy, personality, and teaching effectiveness: A meta-analysis. Educational Research Review, 12, pp. 59-76.
- Koerner, R.J. (2007). The relationship between the TeacherInsight score and student performance as measured by the Texas Growth Index (Unpublished doctoral dissertation). Denton, Texas: University of North Texas.
- Kosnik, C., Brown, R., & Beck, C. (2005). The preservice admissions process: What qualities do future teachers need and how can they be identified in applicants?. The New Educator, 1, pp. 101-123.
- Kreifels, R.G. (2003). A study of selected teacher interview characteristics and student achievement (Unpublished doctoral dissertation). St. Louis, MO: Saint Louis University.
- Kunter, M., Kleickmann, T., Klusmann, U., & Richter, D. (2013). The development of teachers' professional competence. Cognitive activation in the mathematics classroom and professional competence of teachers, pp. 63-77. New York: Springer U.S.
- Kuykendall, L., Tay, L., & Ng, V. (2015). Leisure engagement and subjective well-being: A meta-analysis. Psychological Bulletin, 141, pp. 364-403.
- van der Lans, R.M., van de Grift, W.J., & van Veen, K. (2018). Developing an instrument for teacher feedback: Using the Rasch model to explore teachers' development of effective teaching strategies and behaviors. The Journal of Experimental Education, 86, pp. 247-264.
- Lievens, F., & Patterson, F. (2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. Journal of Applied Psychology, 96, pp. 927-940.
- Lievens, F., Patterson, F., Corstjens, J., Martin, S., & Nicholson, S. (2016). Widening access in selection using situational judgment tests: Evidence from the UKCAT. Medical Education, 50, pp. 624-636.
- Lievens, F., & Sackett, P.R. (2012). The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. Journal of Applied Psychology, 97, pp. 460-468.
- Lipsey, M.W., & Wilson, D.B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
- Liu, E., & Johnson, S.M. (2006). New teachers' experiences of hiring: Late, rushed, and information poor. Educational Administration Quarterly, 42, pp. 324-360.
- Loyd, D.E. (2004). The effect of a screening instrument to determine teacher effectiveness as measured by academic gain scores (Unpublished doctoral dissertation). Knoxville, TN: The University of Tennessee.
- Marks, A.B., & Moss, S.A. (2016). What predicts law student success? A longitudinal study correlating law student applicant data and law school outcomes. Journal of Empirical Legal Studies, 13, pp. 205-265.
- McDaniel, M.A., Morgeson, F.P., Finnegan, E.B., Campion, M.A., & Braverman, E.P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, pp. 730-740.
- McKinley, K.J. (2009). Exploring the efficiency and effectiveness of teacher selection tools: The effects on the total group with a focus on the experience sub-groups (Unpublished doctoral dissertation). St. Charles, MO: Lindenwood University.
- McWhirter, A.B. (2014). The correlation between a teacher selection instrument and teacher quality in Tennessee (Unpublished doctoral dissertation). Phoenix, AZ: Grand Canyon University.
- Mertz, N.T. (2010). Teacher selection and school leader effects. Journal of School Leadership, 20, pp. 184-207.
- Metzger, S.A., & Wu, M.-J. (2008). Commercial teacher selection instruments: The validity of selecting teachers through beliefs, attitudes, and values. Review of Educational Research, 78, pp. 921-940.
- Mikitovics, A., & Crehan, K.D. (2002). Pre-Professional Skills Test scores as college of education admission criteria. The Journal of Educational Research, 95(4), pp. 215-223.
- Mills, S.A. (2007). An investigation of the predictive validity of a structured teacher-interview instrument (Unpublished doctoral dissertation). West Lafayette: Purdue University.
- Morgesen, F.P., Campion, M.A., Dipboye, R.L., Hollenbeck, J.R., Murphy, K., & Schmitt, N. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60, pp. 683-729.
- Muijs, D., Kyriakides, L., van der Werf, G., Creemers, B., Timperley, H., & Earl, L. (2014). State of the art – teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25, pp. 231-256.
- Muijs, D., Reynolds, D., Sammons, P., Kyriakides, L., Creemers, B.P.M., & Teddlie, C. (2018). Assessing individual lessons using a generic teacher observation instrument: How useful is the international system for teacher observation and feedback (ISTOF)?. ZDM, 50, pp. 395-406.
- Nelson, B. (2013). Exploring the relationship between the Ventures for Excellence Teacher Style Profile data and teacher performance (Unpublished doctoral dissertation). St. Charles, MO: Lindenwood University.
- Novotny, M.T. (2009). The relationship between TeacherInsight scores and professional development and appraisal system domain scores (Unpublished doctoral dissertation). Denton, TX: University of North Texas.
- OECD (2005). Teachers matter: Attracting, developing and retaining effective teachers. Paris, France: OECD Publishing. Available online: http://www.oecd.org/education/school/attractingdevelopingandretainingeffectiveteachers-finalreportteachersmatter.htm.
- OECD (2017). Education and training. Paris, France: OECD Publishing. Available online: https://stats.oecd.org/Index.aspx?DataSetCode=EAG_TS_STA.
- Oestreich, T.A. (2016). A study of the effectiveness of the Applitrack Teacherfit hiring selection tool when compared with a teacher's summative evaluation. Bloomington, IN: Indiana University.
- Patrick, H., & Mantzicopoulos, P. (2016). Is effective teaching stable?. The Journal of Experimental Education, 84, pp. 23-47.
- Patterson, F., Ashworth, V., Mehra, S., & Falcon, H. (2012). Could situational judgement tests be used for selection into dental foundation training?. British Dental Journal, 213, pp. 23-26.
- Patterson, F., Knight, A., Dowell, J., Nicholson, S., Cousans, F., & Cleland, J. (2016). How effective are selection methods in medical education? A systematic review. Medical Education, 50, pp. 36-60.
- Paufler, N.A., & Amrein-Beardsley, A. (2014). The random assignment of students into elementary classrooms implications for value-added analyses and interpretations. American Educational Research Journal, 51, pp. 328-362.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References