Dissertation/Thesis Abstract

Developing a Rubric to Measure Adherence to the International Test Commission Guidelines for Translating and Adapting Tests
by Duke, Deborah Helene, Psy.D., St. John's University (New York), 2019, 194; 22623277
Abstract (Summary)

Cross-cultural adaptations of psychological tests are common internationally. The International Test Commission Guidelines for Translating and Adapting Tests (2017) provide a framework to facilitate this process. However, research indicates that these guidelines are used inconsistently. The aim of the present study is to develop an evaluative tool based on the guidelines to increase their utility.

Development of an 18-item rubric, the X-CAGAM, occurred over several phases. An expert review of the X-CAGAM established its content validity. Next, an expert pilot was used to generate expert X-CAGAM scores for several vignettes describing a fictional, adapted measure. The main phase of the study was a psychometric investigation of the X-CAGAM. Participants used the X-CAGAM to rate the vignettes and their accuracy was examined. The X-CAGAM demonstrated strong construct validity. Evidence of incremental validity was mixed. Use of the tool improved accuracy for two of the three vignettes. The X-CAGAM displayed poor inter-rater reliability, but strong internal consistency. In the overall sample, there were no significant relationships between cross-cultural experience factors and participant ratings, suggesting that a variety of practitioners can accurately use the tool. Item analyses indicated that the best items were short and specific, while problematic items were lengthy and multipart.

Overall, this study provides initial evidence of the X-CAGAM’s utility for assessing adapted tests. However, item revisions and training strategies to improve inter-rater reliability are necessary before publication. The present study may assist others in developing practice guideline rubrics and increase awareness of appropriate test adaptation practices. Limitations and practice implications are described.

Indexing (document details)
Advisor: Terjesen, Mark D.
Commitee: Hogan, John D., Ortiz, Samuel O., Hettrich, Emma Leah
School: St. John's University (New York)
Department: CLAS School Psychology
School Location: United States -- New York
Source: DAI-B 82/5(E), Dissertation Abstracts International
Subjects: Psychology, Clinical psychology
Keywords: Adaptation, Cross-cultural, Guidelines, Rubric, Test
Publication Number: 22623277
ISBN: 9798691254314
Copyright © 2021 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy