On Renyi Divergence Measures for Continuous Alphabet Sources
MetadataShow full item record
The idea of `probabilistic distances' (also called divergences), which in some sense assess how `close' two probability distributions are from one another, has been widely employed in probability, statistics, information theory, and related fields. Of particular importance due to their generality and applicability are the Renyi divergence measures. While the closely related concept of Renyi entropy of a probability distribution has been studied extensively, and closed-form expressions for the most common univariate and multivariate continuous distributions have been obtained and compiled, the literature currently lacks the corresponding compilation for continuous Renyi divergences. The present thesis addresses this issue for analytically tractable cases. Closed-form expressions for Kullback-Leibler divergences are also derived and compiled, as they can be seen as an extension by continuity of the Renyi divergences. Additionally, we establish a connection between Renyi divergence and the variance of the log-likelihood ratio of two distributions, which extends the work of Song (2001) on the relation between Renyi entropy and the log-likelihood function, and which becomes practically useful in light of the Renyi divergence expressions we have derived. Lastly, we consider the Renyi divergence rate between two zero-mean stationary Gaussian processes.
URI for this recordhttp://hdl.handle.net/1974/6680
Request an alternative formatIf you require this document in an alternate, accessible format, please contact the Queen's Adaptive Technology Centre
Showing items related by title, author, creator and subject.
Sperm morphology and hybridization of two genetically divergent lineages of the Spring Peeper, Pseudacris crucifer Wang, Rachel (2012-04-24)Understanding the impacts of microevolutionary forces on patterns of intraspecific divergence in all aspects of phenotypes provides insight into the evolution of (complete) reproductive isolation and thus speciation. Most ...
Burke, Kevin (2017-04-18)Understanding the mechanisms underlying resource partitioning that permits the coexistence of species is essential to better understanding how local diversity is shaped. Co-occurring species with similar ecologies are ...
Bothwell, Emma (2012-04-24)Body size is often associated with resource use. Closely related species with similar body size may therefore overlap in their use of resources, a phenomenon that may result in interspecific competition in sympatry. The ...