Premium
Density Approximation by Summary Statistics: An Information‐theoretic Approach
Author(s) -
Gilula Zvi,
Haberman S. J.
Publication year - 2000
Publication title -
scandinavian journal of statistics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.359
H-Index - 65
eISSN - 1467-9469
pISSN - 0303-6898
DOI - 10.1111/1467-9469.00204
Subject(s) - exponential family , mathematics , minimax , exponential function , natural exponential family , statistics , density estimation , minimax approximation algorithm , probability density function , simple (philosophy) , sample size determination , mathematical optimization , mathematical analysis , philosophy , epistemology , estimator
In the case of exponential families, it is a straightforward matter to approximate a density function by use of summary statistics; however, an appropriate approach to such approximation is far less clear when an exponential family is not assumed. In this paper, a maximin argument based on information theory is used to derive a new approach to density approximation from summary statistics which is not restricted by the assumption of validity of an underlying exponential family. Information‐theoretic criteria are developed to assess loss of predictive power of summary statistics under such minimal knowledge. Under these criteria, optimal density approximations in the maximin sense are obtained and shown to be related to exponential families. Conditions for existence of optimal density approximations are developed. Applications of the proposed approach are illustrated, and methods for estimation of densities are provided in the case of simple random sampling. Large‐sample theory for estimates is developed.