ECE 259B --- Probabilistic Coding

SELECTED ADDITIONAL READINGS

Many of these readings are available from the ECE259C Electronic Course Reserves. You can access the Science and Engineering Library electronic reserves HERE. Academic Computing Services can help you set up the UCSD Proxy needed to access the course reserves remotely.

Surveys and Special Issues

  1. Kenneth.S. Andrews, Dariush Divsalar, Sam Dolinar, Jon Hamkins, Christopher R. Jones, Fabrizio Pollara, "The Development of Turbo and LDPC Codes for Deep-Space Applications," Proceedings of the IEEE, Vol. 95, No. 11, pp. 2142-2156, November 2007.

  2. Daniel J. Costello, Jr. and G. David Forney, Jr., "Channel Coding: The Road to Channel Capacity," Proceedings of the IEEE, Vol. 95, No. 6, pp. 1150-1177, June 2007.

  3. "Concatenated Coding Techniques And Iterative Decoding: Sailing Toward Channel Capacity," IEEE Journal on Special Areas in Communications, S. Benedetto, D. Divsalar, and J. Hagenauer (Eds.), Volume 16, Issue 2, Feb 1998.

  4. "Special Issue on Codes on Graphs and Iterative Algorithms," IEEE Transactions on Information Theory, February 2001.

Convolutional Codes

  1. A.J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimal decoding algorithm," IEEE Transactions on Information Theory, vol. IT-13, 260-269, 1967.

  2. G. D. Forney, Jr., "Convolutional codes I: Algebraic structure ", IEEE Transactions on Information Theory, vol. 16, no. 6, pp. 720-738, Nov. 1970. (Correction: vol. 17, no. 3, p. 360, May 1971.)

  3. G. D. Forney, Jr., "Maximum-likelihood sequence estimation of digital sequences in the presence of intersymbol interference", IEEE Transactions on Information Theory, vol. 18, no. 3, pp. 363-378, May 1972.

  4. G. D. Forney, Jr., "The Viterbi algorithm", Proc. IEEE, vol. 61, pp. 268-278, 1973.

  5. R.J. McEliece, Chapter 9: Convolutional Codes, and Appendix D: Path Enumeration in Directed Graphs, in "The Theory of Information Theory and Coding," Encyclopedia of Mathematics and its Applications, vol. 4, Addison-Wesley Pub. Co., 1977. (Note: This classic text is out of print. A revised edition of this book was published by Cambridge University Press in March 2002. A Student Edition was published in 2004.)

  6. Y. Yasuda, Y. Hirata, K. Nakamura, and S. Otani, "Development of variable-rate Viterbi decoder and its performance characteristics," Sixth International Conference on Digital Satellite Communications, (Phoenix, Arizona, September 19-23, 1983), pp. 1-8.

  7. R.J. McEliece, "The Algebraic Theory of Convolutional Codes," in Handbook of Coding Theory, V.S. Pless and W.C. Huffman (editors), vol. 1, Chapter 12, pp. 1065-1138, North-Holland -Elsevier, Amsterdam, 1998. pdf .

Turbo Codes

  1. L.R. Bahl, J. Cocke, F. Jelinek, and J. Raviv, "Optimal Decoding of Linear Codes for Minimizing Symbol Error Rate," IEEE Transactions on Information Theory, vol. IT-20, pp. 284-287, 1974.

  2. C. Berrou, A. Glavieux, and P. Thitimajshima, "Near Shannon Limit Error-Correcting Coding and Decoding: Turbo Codes," Proceedings of the 1993 International Conference on Communications (ICC'93), pp. 1064-1070.

  3. C. Berrou and A. Glavieux, "Near Optimum Error Correcting Coding and Decoding: Turbo Codes," IEEE Transactions on Communications, vol. COM-44, no. 10, pp. 1261-1271, October 1996.

  4. S. Benedetto and G. Montorsi, "Unveiling Turbo Codes: Some Results on Parallel Concatenated Coding Schemes ," IEEE Transactions on Information Theory, vol. 42, no. 2, pp. 409-428, March 1996.

  5. S. Benedetto, D. Divsalar, G. Montorsi, and F. Pollara, "Serial Concatenation of Interleaved Codes: Performance Analysis, Design, and Iterative Decoding," IEEE Transactions on Information Theory, vol. 44, no. 3, pp. 909-926, May 1998.

  6. M. Oberg and P. H. Siegel, "Performance Analysis of Turbo-Equalized Dicode Partial Response Channel,'' Proc. 36th Allerton Conference on Communication, Control and Computing, Monticello, Illinois, pp. 230-239, September 1998

  7. C. Heegard and S.B. Wicker, "Turbo Coding," Norwell, MA: Kluwer Academic Publishers, 1999.

  8. T. Souvignier, M. Oberg, P.H. Siegel, R.E. Swanson, and J.K. Wolf, "Turbo Decoding for Partial Response Channels," IEEE Trans. Commun., vol. 48, no. 8, pp. 1297-1308, August 2000.

  9. H. D. Pfister and P. H. Siegel, "The Serial Concatenation of Rate-1 Codes Through Uniform Random Interleavers," IEEE Transactions on Information Theory, vol. 49, no. 6, pp. 1425-1438, June 2003.

LDPC Codes and Iterative Decoding

  1. R.G. Gallager, Low-Density Parity-Check Codes. Cambridge, MA: MIT Press, 1963 (Sc.D. MIT, 1960).

  2. R. M. Tanner, "A recursive approach to low complexity codes," IEEE Trans. Inform. Theory, vol. IT-27, no. 9, pp. 533-547, Sep. 1981.

  3. D. J. C. MacKay and R. M. Neal, "Good codes based on very sparse matrices," in Proc. Cryptography Coding. 5th IMA Conf., C. Boyd, Ed., Berlin, Germany, 1995, pp. 100-111, Springer.

  4. D. J. C. MacKay and R. M. Neal, "Near Shannon limit performance of low-density parity-check codes," Elect. Lett., vol. 32, pp. 1645-1646, Aug. 1996

  5. S-Y Chung, et al., "On the design of low-density parity-check codes within 0.0045 dB of the Shannon limit," IEEE Commun. Letters, vol. 5, no. 2, pp. 58-60, February 2001.

  6. T. Richardson and R. Urbanke, Modern Coding Theory. Cambridge University Press (2008)

Trellis-Coded Modulation

Ungerboeck Codes, Multidimensional TCM, Coset Codes

  1. G. Ungerboeck, "Channel Coding with Multilevel/Phase Signals", IEEE Transactions on Information Theory, vol. IT-28, No. 1, pp 55-67, January 1982.

  2. G. D. Forney, Jr., R. G. Gallagher, G. R. Lang, F. M. Longstaff, and S. U. Qureshi, "Efficient Modulation for Band-limited Channels," IEEE Journal on Selected Areas in Communications, vol. SAC-2, no. 5, pp. 632-647, September 1984.

  3. H. K. Thapar, "Real-time Application of Trellis Coding to High-speed Voiceband," IEEE Journal on Selected Areas in Communications, vol. SAC-2, no. 5, pp. 648-658, September 1984.

  4. L.-F. Wei, "Rotationally Invariant Convolutional Channel Coding with Expanded Signal Space - Part I: 180," IEEE Journal on Selected Areas in Communications, vol. SAC-2, no. 5, pp. 659-671, September 1984.

  5. L.-F. Wei, "Rotationally Invariant Convolutional Channel Coding with Expanded Signal Space - Part II: Nonlinear Codes," IEEE Journal on Selected Areas in Communications, vol. SAC-2, no. 5, pp. 672-686, September 1984.

  6. A. Gersho and V. B. Lawrence, "Multidimensional Signal Constellations for Voiceband Data," IEEE Journal on Selected Areas in Communications, vol. SAC-2, no. 5, pp. 687-702, September 1984.

  7. J. K. Wolf and G. Ungerboeck, "Trellis Coding for Partial-Response Channels," IEEE Transactions on Communications, vol. COM-34, no. 8, August 1986.

  8. G. Ungerboeck, "Trellis-coded Modulations with Redundant Signal Sets Part I: Introduction", IEEE Communications Magazine, vol. 25, no. 2, pp. 5-11, February 1987.

  9. G. Ungerboeck, "Trellis-coded Modulations with Redundant Signal Sets Part II: State of the Art," IEEE Magazine, vol. 25, no. 2, pp. 12-21, February 1987.

  10. A. R. Calderbank and N. J. A. Sloane, "New Trellis Codes Based on Lattices and Cosets," IEEE Transactions on Information Theory, vol. IT-33, no. 2, pp. 177-195, March 1987.

  11. E. Zehavi and J. K. Wolf, "On the Performance Evaluation of Trellis Codes," IEEE Transactions on Information Theory, vol. IT-32, no. 2, pp. 196-202, March 1987.

  12. L.-F. Wei, "Trellis-coded Modulation with Multidimensional Constellations," IEEE Transactions on Information Theory, vol. IT-33, no. 4, pp. 483-501, July 1987.

  13. Pahlavan and J. L. Holsinger, "Voice-band Data Communication Modems A Historical Review: 1919 - 1988," IEEE Communications Magazine, vol. 26, no. 1, pp. 16-27, January 1988.

  14. G. D. Forney, Jr., "Coset Codes - Part I: Introduction and Geometrical Classification," IEEE Transactions on Information Theory, vol. 34, no. 5, pp. 1123-1151, September 1988.

  15. G. D. Forney, Jr., "Coset Codes - Part II: Binary Lattices and Related Codes," IEEE Transactions on Information Theory, vol. 34, no. 5, pp. 1152-1187, September 1988.

  16. A. J. Viterbi, J. K. Wolf, E. Zehavi, and R. Padovani, "A Pragmatic Approach to Trellis-coded Modulation," IEEE Communications Magazine, vol. 27, no. 7, pp. 11-19, July 1989.

  17. G.D. Forney, Jr; L.-F. Wei,, "Multidimensional constellations-Part I: Introduction, figures of merit, and generalized cross constellations," IEEE Journal on Selected Areas in Communications, vol. 7, no. 6, pp 877-892, August 1989.

  18. G.D. Forney, Jr., "Multidimensional constellations-Part II: Voronoi constellations" IEEE Journal on Selected Areas in Communications, vol. 7, no. 6, pp. 941-958, August 1989.

  19. G. D. Forney, Jr., "Coded Modulation for Band-limited Channels," IEEE Information Theory Society Newsletter, December 1990.

  20. R. Karabed and P. H. Siegel, "Matched Spectral Null Codes for Partial-Response Channels," IEEE Trans. Inform. Theory, vol. 37, no. 3, pp. 818–855, May 1991.

  21. G. D. Forney, Jr., "Geometrically Uniform Codes," IEEE Transactions on Information Theory, vol. 37, no. 5, pp. 241-260, September 1991.

  22. Kato, M. Morijura, and S. Kubota, "Implementation of Coded Modems," IEEE Communications Magazine, vol. 29, no. 12, pp. 88-97, December 1991.

  23. M. V. Eyuboglu, G. D. Forney, Jr., P. Dong, and G. Long, "Advanced Modulation Techniques for V.Fast," European Transactions on Telecommunications, vol. 4, no. 3, pp. 9-22, May-June 1993.

  24. S. Benedetto, M. Mondin, and G. Montorsi, "Performance Evaluation of Trellis-Coded Modulation Schemes," Proceedings of the IEEE, vol. 82, no. 6, pp. 833-855, June 1994.

  25. J. K. Wolf and E. Zehavi, "P^2 Codes: Pragmatic Trellis Codes Utilizing Punctured Convolutional Codes," IEEE Communications Magazine, pp. 94-99, February 1995.

  26. Telecommunication Standardization Sector (ITU-T) of International Telecommunication Union (ITU), "Series V: Data communication Over the Telephone Network, Recommendation V.34," 71 pages, October 1996.

  27. G. D. Forney, Jr., L. Brown, M. V. Eyuboglu, J. L. Moran III, and Motorola, Inc., "The V.34 High-speed Modem Standard," IEEE Communications Magazine, vol. 34, no. 12, pp. 28-33, December 1996.

  28. G. D. Forney, Jr., and G. Ungerboeck, "Modulation and Coding for Linear Gaussian Channels," IEEE Transactions on Information Theory, vol. 44, no. 6, pp. 2384-2415, October 1998.

Constellation Shaping

  1. G.R. Lang and F.M. Longstaff, "A Leech lattice modem," IEEE Journal on Selected Areas of Communications, vol. 7, no. 6, pp. 968-973, August 1989.

  2. A.R. Calderbank and L.H. Ozarow, "Nonequiprobable signaling on the Gaussian channel," IEEE Transactions on Information Theory, vol. 36, no. 4, pp. 726-740, July 1990.

  3. G.D. Forney, Jr., "Trellis Shaping," IEEE Transactions on Information Theory, vol. 38, no. 2, pp. 281-300, March 1992.

  4. F.R. Kschischang and S. Pasupathy, "Optimal nonuniform signaling for Gaussian channels," IEEE Transactions on Information Theory, vol. 39, no. 3, pp. 913-929, May 1993.

  5. A.K. Khandani and P. Kabal, "Shaping multidimensional signal spaces-Part I: Optimum shaping, shell mapping," IEEE Transactions on Information Theory, vol. 39, no. 6, pp. 1799-1808, November 1993.

  6. A.K. Khandani and P. Kabal, "Shaping multidimensional signal spaces-Part II. Shell-addressed constellations," IEEE Transactions on Information Theory, vol. 39, no. 6, pp. 1809-1819, November 1993.

  7. F.R. Kschischang and S. Pasupathy, "Optimal shaping properties of the truncated polydisc," IEEE Transactions on Information Theory, vol. 40,no. 3, pp. 892-903, May 1994.

  8. R. Laroia, N. Farvardin, and S.A. Tretter, "On optimal shaping of multidimensional constellations," IEEE Transactions on Information Theory, vol.40,no.4, pp. 1044-1056, July 1994.

Precoding for Channels with ISI

  1. M. Tomlinson, "New Automatic equaliser employing modulo arithmetic, " Electronics Letters, vol.7, pp. 138-139, March 1971.

  2. R. Price, "Optimized PAM vs. Capacity for Low-noise filter channels," Conference Record of the IEEE International Conference on Communications, vol.7, pp. 5-7 -- 5-13, 1971.

  3. R. Price, "Nonlinearly Feedback-equalized PAM vs. Capacity for noisy filter channels," Conference Record of the IEEE International Conference on Communications, vol.8, pp. 22-12 -- 22-17, June 19-21, 1972.

  4. H. Harashima and H. Miyakawa, "Matched-Transmission Technique for Channels With Intersymbol Interference," IEEE Transactions on Communications, vol.20, no.4, pp. 774-780, August 1972.

  5. M.V. Eyuboglu, "Detection of coded modulation signals on linear, severely distorted channels using decision-feedback noise prediction with interleaving," IEEE Transactions on Communications, vol. 36,no.4, pp. 401-409, April 1988.

  6. P.R. Chevillat and E. Eleftheriou, "Decoding of trellis-encoded signals in the presence of intersymbol interference and noise," IEEE Transactions on Communications, vol. 37, no.7, pp. 669-676, July 1989.

  7. M.V. Eyuboglu and S.U.H. Qureshi, "Reduced-state sequence estimation for coded modulation of Intersymbol Interference Channels," IEEE Transactions on Communications, vol.7, no.6, pp. 989-995, August 1989.

  8. G.D. Forney, Jr. and M.V. Eyuboglu, "Combined equalization and coding using precoding," IEEE Communications Magazine, vol. 29, no.12, pp. 25-34, December 1991.

  9. M.V. Eyuboglu and G.D. Forney, Jr., "Trellis precoding: combined coding, precoding and shaping for intersymbol interference channels," IEEE Transactions on Information Theory, vol.38, no.2, pp. 301-314, March 1992.

  10. R. Laroia, S.A. Tretter, and N. Farvardin, "A simple and effective precoding scheme for noise whitening on intersymbol interference channels," IEEE Transactions on Communications, vol. 41, no.10, pp. 1460-1463, October 1993.

  11. R. Laroia, "Coding for intersymbol interference channels-combined coding and precoding," IEEE Transactions on Information Theory, vol.42, no.4, pp. 1053-1061, July 1996.

Nonlinear Constellation Warping

  1. K. Pahlavan, "Nonlinear quantization and the design of coded and uncoded signal constellations," IEEE Transactions on Communications, vol.39, no.8, pp. 1207-1215, August 1991.

  2. W. Betts, A.R. Calderbank, and R. Laroia, "Performance of nonuniform constellations on the Gaussian Channel," IEEE Transactions on Information Theory, vol.40, no.5, pp. 1633-1638, September 1994.

Multilevel Codes and Multistage Decoding

  1. H. Imai and S. Hirakawa, "A new multilevel coding method using error-correcting codes," IEEE Transactions on Information Theory, vol. 23, no.3, pp. 371-377, May 1977.

  2. G.J. Pottie and D.P. Taylor, "Multilevel codes based on partitioning," IEEE Transactions on Information Theory, vol.35, no.1, pp. 87-98, January 1989.

  3. A.R. Calderbank, "Multilevel codes and multistage decoding," IEEE Transactions on Communications, vol.37, no.3, pp. 222-229, March 1989.

  4. Y. Kofman, E. Zehavi, and S. Shamai, "Performance analysis of a multilevel coded modulation system," IEEE Transactions on Communications, vol.42, no.2, pp. 299-31, Feb./Mar./Apr. 1994.

ITU Modem Standards

  1. "Series V: Data Communication Over the Telephone Network, Recommendation," Telecommunication Standardization Sector (ITU-T) of International Telecommunication Union (ITU), vol. 34, (Oct 1996), Part 1

  2. "Series V: Data Communication Over the Telephone Network, Recommendation," Telecommunication Standardization Sector (ITU-T) of International Telecommunication Union (ITU), vol. 34, (Oct 1996), Part 2

  3. "Series V: Data Communication Over the Telephone Network, Recommendation," Telecommunication Standardization Sector (ITU-T) of International Telecommunication Union (ITU), vol. 34, (Oct 1996), Part 3


Trellis and Turbo Coding (Schlegel and Perez)

  1. Chapter 1 Introduction pdf .

  2. Chapter 2 Communication Theory Basics pdf .

  3. Chapter 3 Trellis-Coded Modulation pdf .

  4. Chapter 4 Convolutional Codes pdf .

  5. Chapter 5 Link to Block Codes pdf .

  6. Chapter 6 Performance Bounds pdf .

  7. Chapter 7 Decoding Strategies pdf .

  8. Chapter 8 Factor Graphs pdf .

  9. Chapter 9 Low-Density Parity Check Codes (not available)

  10. Chapter 10 Parallel Concatentation (Turbo Codes) pdf .

  11. Chapter 11 Serial Concatenation (not available)

  12. Chapter 12 Turbo-Coded Modulation pdf .

    13. ECE 259C Home Page