Variable lenght lossy coding using an LDPC code

Junya Honda, Hirosuke Yamamoto

IEEE Transactions on Information Theory, Vol. 60, No.1, pp.762-775, Jan. 2014

In this paper, a new variable length coding scheme using a low density parity check (LDPC) code is proposed for the lossy compression of general i.i.d. finite sources. It is proved that the proposed scheme achieves the rate-distortion function asymptotically for an LDPC ensemble. For our setting, Miyake–Muramatsu already proposed an asymptotically optimal LDPC coding scheme. In their scheme, a source sequence is first vector-quantized using an LDPC matrix and then it is compressed losslessly by fixed length coding with another LDPC matrix. However, it is not shown whether their scheme can attain good performance practically. This is mainly because of the difficulty of lossless coding by a fixed length code. In the proposed scheme, the lossless compression is performed by arithmetic coding instead of the fixed length code. Combined with vector-quantization using the reinforced belief propagation, the proposed scheme attains performance near the rate-distortion function practically with time complexity roughly equal to O(n log n) for length n source sequences.

Index Terms : Asymmetric sources, LDPC codes, lossy source coding, variable length coding.

Published version (IEEE Xplore)
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

DOI: 10.1109/TIT.2013.2288335