Cross-cultural adaptations of psychological tests are common internationally. The International Test Commission Guidelines for Translating and Adapting Tests (2017) provide a framework to facilitate this process. However, research indicates that these guidelines are used inconsistently. The aim of the present study is to develop an evaluative tool based on the guidelines to increase their utility.
Development of an 18-item rubric, the X-CAGAM, occurred over several phases. An expert review of the X-CAGAM established its content validity. Next, an expert pilot was used to generate expert X-CAGAM scores for several vignettes describing a fictional, adapted measure. The main phase of the study was a psychometric investigation of the X-CAGAM. Participants used the X-CAGAM to rate the vignettes and their accuracy was examined. The X-CAGAM demonstrated strong construct validity. Evidence of incremental validity was mixed. Use of the tool improved accuracy for two of the three vignettes. The X-CAGAM displayed poor inter-rater reliability, but strong internal consistency. In the overall sample, there were no significant relationships between cross-cultural experience factors and participant ratings, suggesting that a variety of practitioners can accurately use the tool. Item analyses indicated that the best items were short and specific, while problematic items were lengthy and multipart.
Overall, this study provides initial evidence of the X-CAGAM’s utility for assessing adapted tests. However, item revisions and training strategies to improve inter-rater reliability are necessary before publication. The present study may assist others in developing practice guideline rubrics and increase awareness of appropriate test adaptation practices. Limitations and practice implications are described.
|Advisor:||Terjesen, Mark D.|
|Commitee:||Hogan, John D., Ortiz, Samuel O., Hettrich, Emma Leah|
|School:||St. John's University (New York)|
|Department:||CLAS School Psychology|
|School Location:||United States -- New York|
|Source:||DAI-B 82/5(E), Dissertation Abstracts International|
|Subjects:||Psychology, Clinical psychology|
|Keywords:||Adaptation, Cross-cultural, Guidelines, Rubric, Test|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be