Premium
Workload portfolio optimization for virtualized computer systems based on semiparametric quantile function estimation
Author(s) -
Li TaHsin
Publication year - 2011
Publication title -
journal of the royal statistical society: series c (applied statistics)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.205
H-Index - 72
eISSN - 1467-9876
pISSN - 0035-9254
DOI - 10.1111/j.1467-9876.2011.00764.x
Subject(s) - quantile , computer science , estimator , virtualization , quantile function , mathematical optimization , econometrics , cumulative distribution function , probability density function , statistics , cloud computing , mathematics , operating system
Summary. The latest technologies of server virtualization allow multiple computer workloads to share the same physical system dynamically while protecting them from interference from each other. Consolidation of workloads from stand‐alone systems into virtualized systems requires accurate capacity sizing and optimal portfolio design to maximize the benefit of virtualization. This requirement often translates into a demand for accurate estimation of high quantiles from a limited amount of data for hundreds of workloads with diverse statistical characteristics. To deal with the problem, a semiparametric method of quantile function estimation is considered. The method employs the generalized Pareto distribution to model the high quantiles that exceed a certain threshold and retains the sample quantiles below the threshold. An automatic procedure is proposed for adaptive threshold and estimator selection and for adaptive data trimming. A simulation study shows that the procedure proposed is superior to the non‐parametric sample quantile method for a variety of distributions. The procedure is applied to a portfolio optimization problem for computer workload consolidation with real data.