Entropy Calculator 1.0

Calculates entropy for data (probability of events) in an array. In information theory, entropy is a measure of the uncertainty associatedwith a random variable. In this context, the term usually refers to theShannon entropy, which quantifies the expected value of the information% contained in a message, usually in units such as bits. In this context, a'message' means a specific realization of the random variable.Shannon denoted the entropy H of a discrete random variable X with possiblevalues {x1, ..., xn} as,H(X) = E(I(X)).E is the expected value,I is the information content of XExample usage-------------in = [.25 .25 .25 .25];b = 'bit';Entropy = info_entropy (in, b)

Requirements:	No special requirements
Platforms:	Matlab
Keyword:	Contained,  Denoted,  Discrete,  Means,  Message,  Realization,  Specific,  Units,  Usage
Users rating:	0/10