Dissertation/Thesis Abstract

Robust Latent Ability Estimation Based on Item Response Information and Model Fit
by Maeda, Hotaka, Ph.D., The University of Wisconsin - Milwaukee, 2017, 107; 10620703
Abstract (Summary)

Aberrant testing behaviors may result in inaccurate person trait estimation. To counter its effects, a new robust ability estimation procedure called downweighting of aberrant responses estimation (DARE) is developed. This procedure downweights both uninformative items and model-misfitting response patterns. The purpose of this study is to present DARE and to evaluate its performance against other robust methods, including biweight (Mislevy & Bock, 1982) and biweight-MAP (BMAP; Maeda & Zhang, 2017b). The traditional maximum likelihood (MLE) and maximum a-posteriori (MAP) methods are also included as baseline methods. A Monte Carlo simulation is conducted with the design variables being test length, type of aberrant behaviors, percentage of aberrant examinees, and percentage of aberrant items. Person-fit analyses using lz* (Snijders, 2001) and HT (Sijtsma, 1986) are incorporated as a realistic initial step to determine the aberrant examinees that might benefit from robust estimation methods. Results showed that DARE effectively decreased the root-mean-squared-error (RMSE) and bias of the estimates compared to MAP among examinees detected using the lz * at the .01 α cutoff. DARE was the most accurate method in many conditions involving aberrant behavior when the test length was 40 or 60 items. At 20 items, all robust methods were ineffective. DARE performs well when 1) a high-achieving examinee show a mild spuriously low scoring behavior, or 2) a low-achieving examinee show a mild spuriously high scoring behavior. When used appropriately, DARE is superior to all pre-existing methods in limiting the negative consequences of aberrant behavior.

Supplemental Files

Some files may require a special program or browser plug-in. More Information

Indexing (document details)
Advisor: Zhang, Bo
Commitee: Azen, Razia, Brondino, Michael J., Wollack, James A.
School: The University of Wisconsin - Milwaukee
Department: Educational Psychology
School Location: United States -- Wisconsin
Source: DAI-B 79/02(E), Dissertation Abstracts International
Source Type: DISSERTATION
Subjects: Statistics, Quantitative psychology
Keywords: Aberrant behavior, Bayesian, Cheating, Dare, Item response theory, Person fit
Publication Number: 10620703
ISBN: 9780355241891
Copyright © 2019 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy
ProQuest