Open AccessOn Entropy-type Measures and Divergences with Applications in Engineering, Management and Applied Sciences
Author(s) -
C. Koukoumis,
Alex Karagrigoriou
Publication year - 2021
Publication title -
international journal of mathematical, engineering and management sciences
Language(s) - English
Resource type - Journals
ISSN - 2455-7749
DOI - 10.33889/ijmems.2021.6.3.043
Subject(s) - kullback–leibler divergence , entropy (arrow of time) , mathematics , statistical physics , computer science , statistics , physics , thermodynamics
In this work we review Entropy-type measures and Divergences, discuss their properties and unfold their diverse applicability. In addition, we compare distances between populations and distributions via weighted Entropy-type measures relying mainly on Relative Entropy and Jeffrey’s Distance with weights. Finally, we introduce the Absolute Weighted Relative Entropy and the Absolute Weighted Jeffrey’s Distance. Two applications are presented for illustration, one from Geosciences and one from Financial Mathematics.