Open AccessAugmenting Expert Elicitation with Structured Visual Deliberation
Author(s) -
Gelder Timothy,
Vodicka Roger,
Armstrong Nicholas
Publication year - 2016
Publication title -
asia and the pacific policy studies
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.529
H-Index - 14
ISSN - 2050-2680
DOI - 10.1002/app5.145
Subject(s) - expert elicitation , deliberation , photo elicitation , delphi method , preference elicitation , task (project management) , computer science , process (computing) , quality (philosophy) , attrition , delphi , management science , knowledge management , data science , artificial intelligence , political science , epistemology , engineering , preference , mathematics , statistics , medicine , philosophy , systems engineering , dentistry , politics , law , operating system
Policy decisions frequently depend on quantitative judgements made by domain experts. The quality of those judgements depends in turn on the nature of the procedures used to obtain them. Procedures designed for this task are known as expert elicitation. This article explores how expert elicitation can be enhanced by supporting the deliberations of expert groups with diagrammatic methods for displaying the structure of those deliberations. It describes an elicitation exercise in which a team from the Defence Science and Technology Group estimated rates of loss of an aircraft that might be acquired for the Australian Defence Force. A structured visual deliberation method, dialogue mapping, was used to facilitate the discussions of the panel of experts in between two rounds of estimations in a Delphi‐type elicitation process. The enhanced elicitation approach worked well for the attrition estimation project, and a similar approach may be useful in many other contexts.