The textbook is Elements of Information Theory.
Sections of the following books may be useful in parts of the course.
R. B. Ash, Information Theory, Dover, 1990.
T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression, Prenice Hall, 1971.
T. M. Cover and J. A. Thomas, Elements of Information Theory, John Wiley, 1991.
I. Csiszar and J. Korner, Infromation Theory: Coding Theorems for Discrete Memoryless Systems, Academic Press, 1981.
R. G. Gallager, Information Theory and Reliable Communication, Wiley, 1968.
Abbas El Gamal and Young-Han Kim, Network Information Theory, Cambridge University Press, 2012.
Center for Science of Information
An interesting US News article: Quantitative Approach to Information Processing