Premium
Prediction: Coveted, Yet Forsaken? Introducing a Cross‐Validated Predictive Ability Test in Partial Least Squares Path Modeling
Author(s) -
Liengaard Benjamin Dybro,
Sharma Pratyush Nidhi,
Hult G. Tomas M.,
Jensen Morten Berg,
Sarstedt Marko,
Hair Joseph F.,
Ringle Christian M.
Publication year - 2021
Publication title -
decision sciences
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.238
H-Index - 108
eISSN - 1540-5915
pISSN - 0011-7315
DOI - 10.1111/deci.12445
Subject(s) - predictive power , benchmark (surveying) , computer science , partial least squares regression , pairwise comparison , predictive modelling , field (mathematics) , econometrics , monte carlo method , complement (music) , machine learning , structural equation modeling , path (computing) , artificial intelligence , data mining , statistics , mathematics , programming language , philosophy , biochemistry , chemistry , geodesy , epistemology , complementation , pure mathematics , gene , phenotype , geography
Management researchers often develop theories and policies that are forward‐looking. The prospective outlook of predictive modeling, where a model predicts unseen or new data, can complement the retrospective nature of causal‐explanatory modeling that dominates the field. Partial least squares (PLS) path modeling is an excellent tool for building theories that offer both explanation and prediction. A limitation of PLS, however, is the lack of a statistical test to assess whether a proposed or alternative theoretical model offers significantly better out‐of‐sample predictive power than a benchmark or an established model. Such an assessment of predictive power is essential for theory development and validation, and for selecting a model on which to base managerial and policy decisions. We introduce the cross‐validated predictive ability test (CVPAT) to conduct a pairwise comparison of predictive power of competing models, and substantiate its performance via multiple Monte Carlo studies. We propose a stepwise predictive model comparison procedure to guide researchers, and demonstrate CVPAT's practical utility using the well‐known American Customer Satisfaction Index (ACSI) model.