The use of response time in testing has a relatively long history, ranging from concerns over test speededness to using response times as performance indicators (e.g., speed and accuracy). This model-based investigation examined the relationship between item response times and examinee performance, focusing on semi-partial covariance between time indices and residual errors of measurement. Residual errors were estimated as deviations between observed item response scores on a multiple-choice test and item response theory (IRT) model-based expected response scores. In the first study, simulation was used to determine whether this relationship is detectable with either semi-partial correlation coefficients or with a measure of local item dependence, Q3 statistics. The impact of this relationship on recovery of proficiency score estimates was studied with root mean square error (RMSE) statistics. Simulation results indicated that mean item semi-partial correlation coefficients were low, but increased as temporal manipulations increased in strength. Variability systematically decreased. Impacts on recovery of EAP proficiency estimates were small, with slight increases in estimate recovery as temporal manipulations increased in strength. In a companion study, simulation results were validated with results from an operational online assessment.
|Advisor:||Luecht, Richard M.|
|Commitee:||Ackerman, Terry A., Henson, Robert A., Richter, Scott J., Willse, John T.|
|School:||The University of North Carolina at Greensboro|
|Department:||School of Education: Educational Research Methodology|
|School Location:||United States -- North Carolina|
|Source:||DAI-A 70/08, Dissertation Abstracts International|
|Subjects:||Educational tests & measurements|
|Keywords:||Computer-based testing, Examinee pacing, High-stakes testing, Item response, Multidimensional IRT, Q3, Response times, Semi-partial correlation, Speededness|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be