Topics in Multimedia Computing and Networking

Lecture Slides


Multimedia applications are often characterized by large datatypes, real-time processing, and low-latency delivery requirements. One of our most effective tools for dealing with these challenges is to exploit the abundance of structure within these datatypes (i.e., video and audio) in order to align the underlying networking mechanisms with the higher-level semantics and organization of the data. This is embodied by design principles such as application-level framing and joint source/channel coding. In this course, students will study the concepts and principles of multimedia computing and networking by reading, presenting, and discussing seminal papers in the field as well as the recent research literature.The course will be taught by Prof. Ketan Mayer-Patel who is visiting Berkeley on sabbatical from the University of North Carolina.


Familiarity and experience with networking protocols and distributed systems will be helpful. I anticipate, however, that motivated students who are less familiar with these subjects will also be able to participate. If you have any questions as to whether this class would be appropriate for you, please feel free to email me.

Grading and Course Credit

The course is worth 2 credits. There will be no problem sets, midterm, or final. Instead, grades will be determined on class participation, presenting one or more research papers, leading a discussion about those papers, and one quiz designed to determine whether you are keeping up with the reading and paying attention.


Each week, one or more research papers, articles, and/or excerpts from books will be assigned. The resources will be posted on the website or copied and distributed to students as needed.


Below is a brief outline of topics that will be covered:
  • Introduction to Multimedia Computing and Networking
  • Video As A Datatype
  • Video Compression
    • Overview of general techniques.
    • Details of MPEG as a specific example.
  • Audio As A Datatype
  • Application-Level Framing
  • Adaptive Playout Delay and Jitter Control
  • Synchronization
  • Media Scaling
  • Layered Coding
  • TCP-Friendliness and TCP-Based Streaming.
  • Periodic Broadcasting
  • Peer-to-peer Streaming