Bibliography
Conference Paper (international conference)
Minimization of Entropy Functionals Revisited
,
: Proceedings of the IEEE International Symposium on Information Theory Proceedings (ISIT), 2012, p. 150-154
: IEEE International Symposium on Information Theory Proceedings (ISIT), 2012, (Cambridge, US, 01.07.2012-06.07.2015)
: GA201/08/0539, GA ČR, GAP202/10/0618, GA ČR
: maximum entropy, moment constraint, primal/dual solutions, normal integrand, convex duality, Bregman projection, generalized exponential family
: http://library.utia.cas.cz/separaty/2012/MTR/matus-minimization of entropy functionals revisited.pdf
(eng): Integral functionals based on convex normal integrands are minimized subject to finitely many moment constraints. The integrands are assumed to be strictly convex but not autonomous or differentiable. The effective domain of the value function is described by a modification of the concept of convex core. The minimization is viewed as a primal problem and studied together with a dual one in the framework of convex duality. Main results assume a dual constraint qualification but dispense with the primal constraint qualification. Minimizers and generalized minimizers are explicitly described whenever the primal value is finite. Existence of a generalized dual solution is established whenever the dual value is finite. A generalized Pythagorean identity is presented using Bregman distance and a correction term. Results are applied to minimization of Bregman distances.
: BA