On Upper Bounding Discrete Entropy
Alnakhli , Razan
MetadataShow full item record
Two upper bounds on the entropy of a discrete random variable are studied. The standard upper bound is derived based on the differential entropy bound for a Gaus- sian random variable. A tighter bound is proved using the transformation formula of the Jacobi theta function and Shannon's inequality. Numerical examples are provided to illustrate their tightness.