Gaussian bounds for discrete entropies - Télécom Paris Access content directly
Conference Papers Year : 2022

Gaussian bounds for discrete entropies

Abstract

It is well known that the Gaussian distribution has the largest differential entropy amongst all distributions of equal variance. In this paper, we derive similar (generalized) Gaussian upper bounds for discrete (Rényi) entropies of integer-valued variables. Using a mixed discrete-continuous bounding technique and the Poisson summation formula from Fourier analysis, it is proved that in many cases, such Gaussian bounds hold with an additive term that vanishes exponentially as the variance increases.
Fichier principal
Vignette du fichier
202205rioul.pdf (752.44 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03718693 , version 1 (12-08-2022)

Identifiers

  • HAL Id : hal-03718693 , version 1

Cite

Olivier Rioul. Gaussian bounds for discrete entropies. IEEE Information Theory and Applications Workshop (ITA 2022), May 2022, San Diego, United States. ⟨hal-03718693⟩
66 View
26 Download

Share

Gmail Facebook Twitter LinkedIn More