Mutual Information Saddle Points in Channels of Exponential Family Type

Date Added: Apr 2010
Format: PDF

This paper extends the authors' prior work on "E-type" (Exponential family type) channels. The channels considered here have transition kernels induced by an exponential family with a two-component sufficient statistic composed of an input-output distortion function and an output cost function. They demonstrate the existence of a mutual information saddle point in any E-type channel for which there exists a source distribution such that the induced output distribution is maximum-entropy under an output cost constraint. For additive-noise E-type channels, they provide necessary and sufficient conditions on the existence of saddle points which coincide with convolution divisibility of the additive noise law.