Abstract

Mantel-Haenszel and SIBTEST, which have known difficulty in detecting non-unidirectional differential item functioning (DIF), have been adapted with some success for computerized adaptive testing (CAT). This study adapts logistic regression (LR) and the item-response-theory-likelihood-ratio test (IRT-LRT), capable of detecting both unidirectional and non-unidirectional DIF, to the CAT environment in which pretest items are assumed to be seeded in CATs but not used for trait estimation. The proposed adaptation methods were evaluated with simulated data under different sample size ratios and impact conditions in terms of Type I error, power, and specificity in identifying the form of DIF. The adapted LR and IRT-LRT procedures are more powerful than the CAT version of SIBTEST for non-unidirectional DIF detection. The good Type I error control provided by IRT-LRT under extremely unequal sample sizes and large impact is encouraging. Implications of these and other findings are discussed.

Citation

Lei, P.W., Chen, S.Y. & Yu, L. (2006). Comparing Methods of Assessing Differential Item Functioning in a Computerized Adaptive Testing Environment. Journal of Educational Measurement, 43(3), 245-264. Retrieved August 14, 2024 from https://www.learntechlib.org/p/94211/.

This record was imported from ERIC on April 18, 2013. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.

Keywords

• Adaptive Testing
• Comparative Analysis
• Computer Assisted Testing
• EVALUATION METHODS
• evaluation research
• Item response theory
• Multiple Regression Analysis
• Pretests Posttests
• Sample Size
• simulation
• Test Bias