Are ordinal rating scales better than percent ratings? a statistical and “psychological” view

Hartung, K. and Piepho, H.P. (2007) Are ordinal rating scales better than percent ratings? a statistical and “psychological” view. Euphytica, 155 (1-2). pp. 15-26.

[img] PDF - Published Version
Restricted to ICRISAT researchers only

Abstract

Disease incidence and severity are often assessed by either an ordinal rating scale, e.g., with scores from 1 to 9, or a percentage rating scale. This paper compares three different rating scales regarding accuracy, precision, and time needed for scoring. Pictograms of mildew diseased cereal leaves were generated following a right skewed beta-distribution. Persons with different rating experience were asked to rate the leaves on three different scales: two different percentage scales [1%-steps (P1) and 5%-steps (P5)] and an ordinal 9-point rating scale (R9) where thresholds followed a logarithmic pattern with respect to the underlying percentage scale. A transformed value of the estimated disease severity as well as the transformed time needed to estimate per leaf was documented and evaluated using mixed models. In most cases both percent ratings performed better than the ordinal rating scale. For the time needed per leaf by the untrained group, method R9 was better. With the trained group P5 performed better than both other methods. The raters mostly preferred R9, especially when untrained. Nevertheless, the results suggest that P5 can be recommended in terms of accuracy.

Item Type: Article
Uncontrolled Keywords: accuracy; disease severity; mixed model; percentages; precision; visual assessment
Author Affiliation: Institute fur Pflanzenbau und Grunland (340c), Universitat Hohenheim, Fruwirthstr. 23, 70599 Stuttgart, Germany
Subjects: Plant Production
Divisions: General
Depositing User: Sandhya Gir
Date Deposited: 18 Jul 2011 04:37
Last Modified: 18 Jul 2011 04:40
Official URL: http://dx.doi.org/10.1007/s10681-006-9296-z
URI: http://eprints.icrisat.ac.in/id/eprint/2395

Actions (login required)

View Item View Item