Dissertation/Thesis Abstract

Estimating Performance Mean and Variability with Distributional Ratings Scales: A Field Study Towards Enhanced Performance Measurement
by Colatat, Mahyulee Chang, Ph.D., Bowling Green State University, 2008, 59; 10630867
Abstract (Summary)

Research on distributional rating scales is mixed on whether they represent an improvement in performance measurement over traditional Likert-type scales. The present study attempted to reconcile the mixed results by suggesting that distributional ratings provide estimates of mean performance comparable to Likert-type ratings, yet also contribute conceptually critical estimates of performance variability unavailable from Likert-type ratings. Approximately 2,090 undergraduate students in 95 classes rated their instructors' performance. Data were collected in a between-classes design with random assignment to either distributional or Likert-type rating scale conditions. Results indicated no significant differences in estimates of mean performance or interrater agreement for mean performance between distributional and Likert-type rating scales. Further, raters used the distributional scale to report some degree of performance variability, and surprisingly, they agreed on variability estimates as much as or more than they agreed on mean estimates. Thus, distributional rating scales indeed have the potential to capture richer performance information than Likert-type scales.

Indexing (document details)
Advisor:
Commitee: Carroll, Michael C., Hakel, Milton D., Musher-Eizenman, Dara, Zickar, Michael J.
School: Bowling Green State University
Department: Psychology/Industrial-Organizational
School Location: United States -- Ohio
Source: DAI-B 78/11(E), Dissertation Abstracts International
Source Type: DISSERTATION
Subjects: Psychology
Keywords: Interrater agreement, Job performance, Performance distribution, Performance ratings, Variability
Publication Number: 10630867
ISBN: 9780355011975
Copyright © 2019 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy
ProQuest