Premium
Concordance between ratings using different scales for the same variable
Author(s) -
Svensson Elisabeth
Publication year - 2000
Publication title -
statistics in medicine
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.996
H-Index - 183
eISSN - 1097-0258
pISSN - 0277-6715
DOI - 10.1002/1097-0258(20001230)19:24<3483::aid-sim786>3.0.co;2-a
Subject(s) - categorical variable , concordance , consistency (knowledge bases) , statistics , scale (ratio) , mathematics , variable (mathematics) , scaling , econometrics , level of measurement , rating scale , ordinal scale , data mining , computer science , medicine , geography , mathematical analysis , geometry , cartography
Abstract Qualitative variables are commonly measured by means of different types of rating scales that produce ordered categorical data. The number of response categories in a scale can be chosen arbitrarily according to different operational definitions of the attribute to be measured. In the present paper classical measures based on the difference between the probabilities of concordant and discordant pairs of classifications were compared with a novel approach for assessment of order consistency between rating scales. In the new approach, illustrated by an assessment of pain, the concordant and discordant pairs are related to the pattern of total order consistency, irrespective of the scaling and the categorical distributions. The level of order consistency between a visual analogue scale (VAS) and a discrete scale for the same variable was evaluated. The non‐linear properties of VAS assessments were demonstrated. The inter‐scale consistency between the discrete scale and different approaches to grouping VAS responses into discrete scales showed that equidistant rescaling of VAS assessments resulted in an inter‐scale bias. Copyright © 2000 John Wiley & Sons, Ltd.