The current study explored ways to improve reading comprehension assessments. Available assessments appeared misaligned with views of comprehension that are emerging in the reading research literature. Further, the measurement models as currently applied to comprehension assessment do not take into account the cognitive perspective of the construct when estimating proficiency. It has been argued that an assessment, an evidentiary argument, when based on a theory of the construct can offer more informative estimates of proficiency and improve validity of the inferences drawn from those estimates (Mislevy, Steinberg, & Almond, 2003).
For this study, the design and the analytic approach for an assessment of comprehension were grounded on a premise that comprehension is influenced by task attributes (e.g., text type or target mental representation) as well as reader attributes (e.g., prior knowledge or interest). Construction of the comprehension measure and the ensuing psychometric analyses were framed following Kintsch's (1998) Construction-Integration model and Alexander's (1997) Model of Domain Learning.
The resulting measure was administered to 160 eighth-grade students with no known status of receiving services for special education. In completing the comprehension task, the students read four text passages and answered a set of text passage-related questions, eight per passage. Those passages varied by text type and text topic, and questions varied by the target mental representations of a text and relations among the events of a situation described in the text. In addition, participants answered a set of questions for self-reporting about their familiarity with and interest in the topic of a text passage that they had read.
In synthesizing the data, a particular form of the Linear Logistic Test Model introduced by Fischer (1973) was applied within a Bayesian framework. When the attributes were incorporated in the measurement model, the comprehension proficiency estimates changed in a way that reflected positive effects of topic familiarity and topic interest. Further, the task and reader attributes considered in the study contributed to estimates of item difficulties. Thus, the study, based on empirical evidence, suggests that developing a comprehension assessment more aligned with views of the construct offered in the literature is indeed viable.
|Advisor:||Alexander, Patricia A.|
|Commitee:||Dreher, Mariam J., Kulikowich, Jonna M., Mislevy, Robert J., Wentzel, Kathryn R.|
|School:||University of Maryland, College Park|
|School Location:||United States -- Maryland|
|Source:||DAI-A 74/11(E), Dissertation Abstracts International|
|Subjects:||Educational tests & measurements, Educational psychology|
|Keywords:||Assessment, Eighth grade, Linear logistic test model, Prior knowledge and interest, Reading comprehension, Textbase and situation model|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be