Meta-analyses are used in all fields of research, and they are typically assumed to be the same regardless of field or time. This paper explores changes in the meta-analytic process over time as well as across the fields of Computer Science, Education, Medicine, and Psychology on a representative sample of meta-analyses. Facets of the process of meta-analysis were also examined as well as how they impact meta-analytic Rigor, interrater agreement (IRA) and interrater reliability (IRR). Data visualization, ANOVAs, multiple regression, and path analysis were used to connect variables and make sense of relationships. Surprisingly, IRA and Rigor were not related, and IRR had a strong negative correlation with Rigor. Furthermore, the reporting rates of IRA and IRR were very low across all fields.
In terms of procedure, meta-analyses in the field of Medicine were the most well-developed and offer several ideas for improving meta-analyses in the social sciences. Suggestions for improving IRA and IRR process and reporting are included. In examining many meta-analyses from different fields, some surprising discoveries were made. Most notably, studies labeled as meta-analyses in Computer Science frequently failed to include the analyses that typify meta-analysis; instead, they would be better described as vote-counting studies or qualitative reviews.
|Advisor:||Wilson, Mark A.|
|School:||North Carolina State University|
|School Location:||United States -- North Carolina|
|Source:||DAI-B 78/08(E), Dissertation Abstracts International|
|Subjects:||Psychobiology, Behavioral Sciences, Quantitative psychology|
|Keywords:||Interrater agreement, Interrater reliability|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be