Adapting for Scalability: Automating the Video Assessment of Instructional Learning
Online Learning Journal Volume 21, Number 1, ISSN 2472-5730
Although scalable programs, such as online courses, have the potential to reach broad audiences, they may pose challenges to evaluating learners\u2019 knowledge and skills. Automated scoring offers a possible solution. In the current paper, we describe the process of creating and testing an automated means of scoring a validated measure of teachers\u2019 observational skills, known as the Video Assessment of Instructional Learning (VAIL). Findings show that automated VAIL scores were consistently correlated with scores assigned by the hand scoring system. In addition, the automated VAIL replicated intervention effects found in the hand scoring system. The automated scoring technique appears to offer an efficient and reliable assessment. This study may offer additional insight into how to utilize similar techniques in other large-scale programs and interventions.
Roberts, A., LoCasale-Crouch, J., Hamre, B. & Buckrop, J. (2017). Adapting for Scalability: Automating the Video Assessment of Instructional Learning. Online Learning Journal, 21(1),.