R?nyi Information Dimension: Fundamental Limits of Almost Lossless Analog Compression

Date Added: Aug 2010
Format: PDF

In Shannon theory, lossless source coding deals with the optimal compression of discrete sources. Compressed sensing is a lossless coding strategy for analog sources by means of multiplication by real-valued matrices. In this paper the authors study almost lossless analog compression for analog memory-less sources in an information-theoretic framework, in which the compressor or decompressor is constrained by various regularity conditions, in particular linearity of the compressor and Lipschitz continuity of the decompressor. The fundamental limit is shown to be the information dimension proposed by R?nyi in 1959.