You are here:

Development and Evaluation of a Confidence-Weighting Computerized Adaptive Testing
ARTICLE

, , , ,

Journal of Educational Technology & Society Volume 13, Number 3, ISSN 1176-3647 e-ISSN 1176-3647

Abstract

The purpose of this study was to examine whether the efficiency, precision, and validity of computerized adaptive testing (CAT) could be improved by assessing confidence differences in knowledge that examinees possessed. We proposed a novel polytomous CAT model called the confidence-weighting computerized adaptive testing (CWCAT), which combined a confidence-weighting scoring scheme with the graded response model (GRM). The CWCAT provided a more interactive testing environment by focusing on the examinees' confidence in their responses. An experiment was conducted to evaluate the comparison between the CWCAT and conventional CAT in terms of efficiency, precision, and validity. As expected, the polytomous method provided better discrimination among individual differences in the confidence in knowledge and required fewer items per examinee. Results also showed that CWCAT yielded ability estimates that were higher and better correlated to examinees' performance in English learning. Furthermore, the ability measured by CWCAT was not as likely to be affected by guessing as on conventional CAT, and, therefore, was more consistent with examinees' true ability. (Contains 9 tables and 9 figures.)

Citation

Yen, Y.C., Ho, R.G., Chen, L.J., Chou, K.Y. & Chen, Y.L. (2010). Development and Evaluation of a Confidence-Weighting Computerized Adaptive Testing. Journal of Educational Technology & Society, 13(3), 163-176. Retrieved October 18, 2019 from .

This record was imported from ERIC on April 19, 2013. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.

Keywords