Shannon entropy: axiomatic characterization and application | Zendy

C. G. Chakrabarti | Zendy; Indranil Chakrabarty | Zendy

AI Assistant Blog Pricing

Home ZAIA Blog

Open Access

Shannon entropy: axiomatic characterization and application

Author(s) -

C. G. Chakrabarti,

Indranil Chakrabarty

Publication year - 2005

Publication title -

international journal of mathematics and mathematical sciences

Language(s) - English

Resource type - Journals

SCImago Journal Rank - 0.21

H-Index - 39

eISSN - 1687-0425

pISSN - 0161-1712

DOI - 10.1155/ijmms.2005.2847

Subject(s) - mathematics , maximum entropy probability distribution , differential entropy , rényi entropy , min entropy , shannon's source coding theorem , maximum entropy thermodynamics , joint quantum entropy , joint entropy , entropy power inequality , entropy (arrow of time) , axiom , axiomatic system , binary entropy function , principle of maximum entropy , statistical physics , transfer entropy , statistics , thermodynamics , geometry , physics

We have presented a new axiomatic derivation of Shannon entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function. We have then modified Shannon entropy to take account of observational uncertainty.The modified entropy reduces, in the limiting case, to the form of Shannon differential entropy. As an application, we have derived the expression for classical entropy of statistical mechanics from the quantized form of the entropy

The content you want is available to Zendy users.

Already have an account? Click here to sign in.

Having issues? You can contact us here

Accelerating Research