Dissertation/Thesis Abstract

Relationships between examinee pacing and observed item responses: Results from a multi -factor simulation and an operational high stakes assessment
by Klaric, John S., III, Ph.D., The University of North Carolina at Greensboro, 2009, 156; 3368874
Abstract (Summary)

The use of response time in testing has a relatively long history, ranging from concerns over test speededness to using response times as performance indicators (e.g., speed and accuracy). This model-based investigation examined the relationship between item response times and examinee performance, focusing on semi-partial covariance between time indices and residual errors of measurement. Residual errors were estimated as deviations between observed item response scores on a multiple-choice test and item response theory (IRT) model-based expected response scores. In the first study, simulation was used to determine whether this relationship is detectable with either semi-partial correlation coefficients or with a measure of local item dependence, Q3 statistics. The impact of this relationship on recovery of proficiency score estimates was studied with root mean square error (RMSE) statistics. Simulation results indicated that mean item semi-partial correlation coefficients were low, but increased as temporal manipulations increased in strength. Variability systematically decreased. Impacts on recovery of EAP proficiency estimates were small, with slight increases in estimate recovery as temporal manipulations increased in strength. In a companion study, simulation results were validated with results from an operational online assessment.

Indexing (document details)
Advisor: Luecht, Richard M.
Commitee: Ackerman, Terry A., Henson, Robert A., Richter, Scott J., Willse, John T.
School: The University of North Carolina at Greensboro
Department: School of Education: Educational Research Methodology
School Location: United States -- North Carolina
Source: DAI-A 70/08, Dissertation Abstracts International
Subjects: Educational tests & measurements
Keywords: Computer-based testing, Examinee pacing, High-stakes testing, Item response, Multidimensional IRT, Q3, Response times, Semi-partial correlation, Speededness
Publication Number: 3368874
ISBN: 9781109299199
Copyright © 2019 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy