Premium
AGREEMENT AND RELIABILITY ASSESSMENTS FOR PERFORMANCE OF SENSORY DESCRIPTIVE PANEL
Author(s) -
BI JIAN
Publication year - 2003
Publication title -
journal of sensory studies
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.61
H-Index - 53
eISSN - 1745-459X
pISSN - 0887-8250
DOI - 10.1111/j.1745-459x.2003.tb00373.x
Subject(s) - reliability (semiconductor) , statistics , descriptive statistics , quality (philosophy) , sample (material) , mathematics , measure (data warehouse) , psychology , computer science , econometrics , data mining , power (physics) , physics , philosophy , chemistry , epistemology , chromatography , quantum mechanics
In the present paper, two indices, agreement coefficient and reliability coefficient, are introduced and proposed to measure quality of ratings data given by a sensory descriptive panel. Agreement coefficient describes variation of ratings for a single target (product), whereas reliability coefficient reflects discrimination ability of a descriptive panel for a sample of products. The two indices, which profoundly describe inherent characteristics of ratings data, are based on classical reliability theory and recent advances in psychological measurement. In the paper, estimates and tests for the two indices are provided. Confidence intervals for the indices are derived. A space with the two indices as dimensions, which is referred as rating quality space, gives visual presentation of performances of a descriptive panel or individual panelists. Numerical examples illustrate the use and interpretation of the indices.