Back to Search Start Over

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality.

Authors :
Anantharam, Venkat
Jog, Varun
Nair, Chandra
Source :
IEEE Transactions on Information Theory. Dec2022, Vol. 68 Issue 12, p7665-7684. 20p.
Publication Year :
2022

Abstract

The entropy power inequality (EPI) and the Brascamp-Lieb inequality (BLI) are fundamental inequalities concerning the differential entropies of linear transformations of random vectors. The EPI provides lower bounds for the differential entropy of linear transformations of random vectors with independent components. The BLI, on the other hand, provides upper bounds on the differential entropy of a random vector in terms of the differential entropies of some of its linear transformations. In this paper, we define a family of entropy functionals, which we show are subadditive. We then establish that Gaussians are extremal for these functionals by adapting a proof technique from Geng and Nair (2014). As a consequence, we obtain a new entropy inequality that generalizes both the BLI and EPI. By considering a variety of independence relations among the components of the random vectors appearing in these functionals, we also obtain families of inequalities that lie between the EPI and the BLI. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00189448
Volume :
68
Issue :
12
Database :
Academic Search Index
Journal :
IEEE Transactions on Information Theory
Publication Type :
Academic Journal
Accession number :
160651290
Full Text :
https://doi.org/10.1109/TIT.2022.3192913