Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study varied several aspects: the item discrimination parameter, test length, sample size, and the correlation between the single-item assessment and its corresponding multi-item assessment. Results suggest that using method CA, method MS, and method FA concurrently, researchers can obtain the most precise estimate of the range of single-item assessment’s reliability in 94.44% of cases. The range of single-item assessments’ population reliability is (.28, .59), the range of estimated single-item assessments’ reliability is (.15, .70). Test length, the item discrimination parameter, sample size, and the correlation between the single-item assessment and its corresponding multi-item assessment do not have a clear impact method choice, these four aspects do not have consistent relation with the estimate of single-item assessment’s reliability.
|Commitee:||Keller, Lisa, Moeyaert, Mariola|
|School:||State University of New York at Albany|
|Department:||Educational Psychology and Methodology|
|School Location:||United States -- New York|
|Source:||DAI-A 82/2(E), Dissertation Abstracts International|
|Subjects:||Educational psychology, Psychology, Quantitative psychology|
|Keywords:||Reliability, Single-item assessment, Factor analysis, Correction for attenuation, Molenaar and Sijtsma’s theory|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be