EE 276: Information Theory

Stanford University, Tsachy Weissman, Winter Quarter 2023-24


  • Welcome to the EE276 course!

  • We will be using Piazza for announcements and discussion. Please sign up here.

  • Lecture videos from Winter 2020 are available for the course. You can access them from the course Canvas under “Panopto Course Videos -> Winter 2020- EE276 Lectures”.

Course Overview

This course is about how to measure, represent, and communicate information effectively. Why bits have become the universal currency for information exchange. How information theory bears on the design and operation of modern-day systems such as smartphones and the Internet. What are entropy and mutual information, and why are they so fundamental to data representation, communication, and inference. Practical compression and error correction.