Open AccessAGREEMENT OF EXPERT ESTIMATES
Author(s) -
Valentinas Podvezko
Publication year - 2005
Publication title -
technological and economic development of economy
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.634
H-Index - 47
eISSN - 2029-4921
pISSN - 2029-4913
DOI - 10.3846/13928619.2005.9637688
Subject(s) - ranking (information retrieval) , concordance , statistics , expert system , concordance correlation coefficient , computer science , mathematics , econometrics , data mining , machine learning , artificial intelligence , medicine
The application of multicriteria methods largely depends on the calculation of the criteria weights based on expert evaluation. The results obtained can be used for practical purposes if expert judgments are in good agreement. This may be determined by the concordance of a coefficient obtained by ranking the available alternatives. The paper considers a possibility to apply the concordance coefficient in cases when expert evaluation is not based on ranking. The calculations reveal the dependence of the agreement of expert estimates on a particular method used. The highest degree of agreement has been obtained by using the direct ranking method. The effect of equally assessed criteria, i. e. the tied ranks on the concordance coefficient and thereby on the level of expert judgments agreement is usually insignificant and cannot change the results of rating.