This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Lee, J. Search for Related Content Social Bookmarking                         What's this?

Outlier Aversion in Subjective Evaluation

Evidence From World Figure Skating Championships

Florida International University

The quality of subjective performance evaluation is dependent on the incentive structures evaluators face. Figure skating competitions provide a unique opportunity to study subjective evaluation. Using scoring data from World Figure Skating Championships between 2001 and 2003, I test for the existence of "outlier aversion" in which subjective evaluators avoid submitting outlying judgments. I find that judges manipulate scores to achieve a targeted level of agreement with the other judges. Agreement may not be a good criterion for the validity of an evaluation system, consistent with the recent applied psychology and management literature.

Key Words: subjective performance evaluation • outlier aversion • figure skating

Journal of Sports Economics, Vol. 9, No. 2, 141-159 (2008)
DOI: 10.1177/1527002507299203


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				T. Coupe, V. Ginsburgh, and A. Noury Are leading papers of better quality? Evidence from a natural experiment Oxf. Econ. Pap., June 19, 2009; (2009) gpp019v1. [Abstract] [Full Text] [PDF]