ENGR 76: Information Science and Engineering

Stanford University, Ayfer Özgür, Spring Quarter 2023–24

Approximate Lecture Plan

  • Lecture 1: Introduction

  • Lecture 2: What is Information? Probability and Entropy

  • Lecture 3: Lossless Compression and Huffman Coding

  • Lecture 4: Fundamental Limits of Compression

  • Lecture 5: Joint Entropy and Block Coding

  • Lecture 6: Signals and Frequency Representation

  • Lecture 7: Fourier Series and Fourier Cosine Series

  • Lecture 8: Fourier Transform and Discrete Fourier Transform

  • Lecture 9: Analog to Digital: the Sampling Theorem

  • Lecture 10: Digital to Analog: Interpolation and the Stroboscopic Effect

  • Lecture 11: Communication Channels and Systems

  • Lecture 12: Modulation and Bandwidth, On-Off Keying, Upconversion,

  • Lecture 13: Error Correcting Codes

  • Lecture 14: Hamming codes, Hadamard codes, Convolutional codes

  • Lecture 15: Convolutional Codes and Viterbi Decoding

  • Lecture 16: “The Bit Player”

  • Lecture 17: Conditional Probability, Bit Error Rates

  • Lecture 18: Decision Making with noisy observations, MAP and ML Rules

  • Lecture 19: TBD

  • Lecture 20: TBD

Further topics TBD depending on time and interest:

  • Storage for/in DNA

  • Wireless Communication and 5G

  • Group Testing for COVID

  • Polar Codes

  • Mutual Information

  • Compression and Unsupervised Learning