Low density codes achieve the rate-distortion bound

Abstract: We propose a new construction for low-density source codes with multiple parameters that can be tuned to optimize the performance of the code. In addition, we introduce a set of analysis techniques for deriving upper bounds for the expected distortion of our construction, as well as more general low-density constructions. We show that (with an optimal encoding algorithm) our codes achieve the rate-distortion bound for a binary symmetric source and Hamming distortion. Our methods also provide rigorous upper bounds on the minimum distortion achievable by previously proposed low-density constructions.

• Type: Journal
• Year: 2006
• Where: CORR
• Authors: Emin Martinian, Martin J. Wainwright
• Keywords: CORR 2006, Education, Low-density Constructions, Low-density Source Codes, Upper Bounds