Premium
Estimating Promotion Effects Using Big Data: A Partially Profiled LASSO Model with Endogeneity Correction *
Author(s) -
Sun Luping,
Zheng Xiaona,
Jin Ying,
Jiang Minghua,
Wang Hansheng
Publication year - 2019
Publication title -
decision sciences
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.238
H-Index - 108
eISSN - 1540-5915
pISSN - 0011-7315
DOI - 10.1111/deci.12354
Subject(s) - lasso (programming language) , endogeneity , promotion (chess) , econometrics , benchmark (surveying) , product (mathematics) , computer science , regression analysis , economics , marketing , business , machine learning , mathematics , geometry , geodesy , politics , world wide web , political science , law , geography
Retailers are interested in understanding which price promotions are profitable and which are not. However, simultaneously estimating the promotion effects of a large number of products on retailer sales and profits is technically challenging for both researchers and practitioners. To address this challenge, this study proposes a Partially Profiled Least Absolute Shrinkage and Selection Operator (Partially Profiled LASSO) model, which can estimate ultra‐high‐dimensional regression relationships at a low computational cost and control for the endogeneity of promotion depth. The model can flexibly incorporate the time‐varying promotion effects and the cross‐over effects among the promotions of different products. We conduct an empirical study using data provided by a large retailer over a 5‐month period. Our model efficiently identifies products with promotion effects and the promotion effects are significantly associated with certain promotion, product, and category characteristics. The results also show that our model with cross‐over effects outperforms the benchmark models that are widely used to handle the high‐dimensional predictor matrix (e.g., the standard LASSO and principal component regression methods). This article contributes to the related literature on price promotion and marketing analytics in data‐rich environments, and provides implications for retailers to make more informed promotion strategies.