California State Polytechnic University, Pomona

Department of Electrical and Computer Engineering

EGR 560 Information Theory and Coding (4)

Syllabus

Prerequisite: Upper-division course in probability theory.

Instructor: Dr. James S. Kang

Office: 9 - 321

Office Telephone: (909) 869 - 2532

Office Hours:

Text: Shu Lin and Daniel J. Costello, Jr., Error Control Coding, 2nd ed., Prentice-Hall, 2004, ISBN 0-13-042672-5

Text: James S. Kang, Information Theory and Coding Lecture Notes

Grading: Midterm – 45%, Final – 45%, Homeworks and Computer Assignments – 10%.

Topic Reading

Introduction Ch 1

Entropy and Mutual Information Ch 2

Markov Sources

Capacity of the Discrete Noiseless Channel Ch 2

Coding for Discrete Sources Ch 2

Discrete Memoryless Channel and Capacity Ch 2

Source–Channel Coding Theorem Ch 2

Vector Spaces, Matrices

Linear Block Codes Ch 5

Cyclic Codes Ch 5

Groups, Fields, Binary Field Arithmetic

Galois Field

BCH Codes Ch 5

Burst–Error–Correcting Codes

Convolutional Codes Ch 6

Maximum Likelihood Decoding of Covolutional Codes Ch 6

Sequential Decoding of Convolutional Codes Ch 6

Burst–Error–Correcting Convolutional Codes Ch 6

Practical Applications of Convolutional Codes Ch 6

Turbo Codes Ch 6

LDPC Codes Ch 6

COMPUTER ASSIGNMENTS

• Computer Assignment #1
• Computer Assignment #2
• Computer Assignment #3
• Computer Assignment #4
• Computer Assignment #5
• Computer Assignment #6
• Computer Assignment #7
• Computer Assignment #8

FILES ON REED-SOLOMON CODES

• Systematic RS Codes
• High-Speed Architecture
• RS Codes
• RS Spartan II

IMAGES

• Baboon.tif

REFERENCES

Information Theory

[1] C. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, IL: University of Illinois Press, 1949.

[2] R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.

[3] R. J. McEliece, The Theory of Information and Coding. Reading, MA: Addison–Wesley, 1977.

[4] R. Ash, Information Theory. New York: Wiley, 1965.

[5] N. Abramson, Information Theory and Coding. New–York: McGraw–Hill, 1963.

[6] R. M. Fano, Transmission of Information. New York: Wiley, 1961.

[7] F. Jelinek, Probabilistic Information Theory. New York: McGraw–Hill, 1968.

[8] T. Berger, Rate Distortion Theory. Englewood Cliffs,N.J.: Prentice–Hall, 1971.

[9] D. Slepian, ed., Key Papers in the Development of Information Theory. New York: IEEE Press, 1961.

[10] R. W. Hamming, Coding and Information Theory, 2nd ed. Englewood Cliffs, N.J.: Prentice–Hall, 1986.

[11] M. Mansuripur, Introduction to Information Theory. Englewood Cliffs, N.J.: Prentice–Hall, 1987.

Coding Theory

[12] S. Lin and D. J. Costello, Jr, Error Control Coding: Fundamentals and Applications. Englewood Cliffs, N.J.: Prentice-Hall, 1983.

[13] W. W. Peterson and E. J. Weldon, Jr., Error–Correcting Codes, 2nd ed., Cambridge, MA: MIT Press, 1972.

[14] E. R. Berlekamp, Algebraic Coding Theory. New York: McGraw–Hill, 1968.

[15] F. I. MacWilliams and N. J. A. Sloane, The Theory of Error–Correcting Codes. New York: North–Holland, 1978.

[16] R. E. Blahut, Theory and Practrice of Error Control Codes. Reading, MA: Addison–Wesley, 1983.

[17] G. C. Clark, Jr. and J. B. Cain, Error–Correction Coding for Digital Communications. New York: Plenum Press, 1981.

[18] A. M. Michelson and A. H. Levesque, Error–Control Techniques for Digital Communication. New York: Wiley, 1985.

[19] A. J. Viterbi and J. K. Omura, Principles of Digital Communication ans Coding. New York: McGraw–Hill, 1979.

E-mail Dr. Kang

This is a personal homepage and does not necessarily represent the opinions of the California State Polytechnic University, Pomona.