Premium
In defense of Pratt's variable importance axioms: A response to Gromping
Author(s) -
Thomas D. Roland,
Kwan Ernest,
Zumbo Bruno D.
Publication year - 2018
Publication title -
wiley interdisciplinary reviews: computational statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.693
H-Index - 38
eISSN - 1939-0068
pISSN - 1939-5108
DOI - 10.1002/wics.1433
Subject(s) - metric (unit) , computer science , variable (mathematics) , exploratory data analysis , heuristic , inference , statistical inference , grasp , data science , machine learning , simple (philosophy) , axiom , variables , data mining , artificial intelligence , statistics , mathematics , programming language , geometry , mathematical analysis , philosophy , operations management , epistemology , economics
In a recent paper Gromping provided a wide‐ranging review of metrics for assessing variable importance in regression analysis. There are, however, several flaws in Gromping's criticism of the well‐known metric attributed to Pratt. Among the metrics she reviewed, Pratt's metric stands out because it is the only one that provides both a theoretically based definition of variable importance, and a simple method of estimation and inference. Our response is an effort to re‐evaluate this unique metric. We give a simplified and abbreviated account of Pratt's original derivation, based on which we address the flaws in Gromping's presentation. We also discuss heuristic interpretations of Pratt's metric, and suggest a new approach for selecting one from among the many available metrics for assessing importance. This approach is intended to supplement that suggested by Gromping. Accordingly, the goal of this response is to help practitioners better understand and choose between available metrics for assessing variable importance. This article is categorized under: Statistical and Graphical Methods of Data Analysis > Multivariate Analysis Statistical Learning and Exploratory Methods of the Data Sciences > Exploratory Data Analysis