The interplay between error, total variation, alpha-entropy and guessing: Fano and Pinsker direct and reverse inequalities
Abstract
Using majorization theory via “Robin Hood” elementary operations, optimal lower and upper bounds are derived on Rényi and guessing entropies with respect to either error probability (yielding reverse-Fano and Fano inequalities) or total variation distance to the uniform (yielding reverse-Pinsker and Pinsker inequalities). This gives a general picture of how the notion of random- ness can be measured in many areas of computer science.
Domains
Information Theory [math.IT]Origin | Files produced by the author(s) |
---|