Multimedia applications are often characterized by large
datatypes, real-time processing, and low-latency delivery
requirements. One of our most effective tools for dealing with
these challenges is to exploit the abundance of structure within
these datatypes (i.e., video and audio) in order to align the
underlying networking mechanisms with the higher-level semantics
and organization of the data. This is embodied by design
principles such as application-level framing and joint
source/channel coding. In this course, students will study the
concepts and principles of multimedia computing and networking
by reading, presenting, and discussing seminal papers in the
field as well as the recent research literature.The course will
be taught by Prof. Ketan Mayer-Patel who is visiting Berkeley on
sabbatical from the University of North Carolina.
Familiarity and experience with networking protocols and distributed
systems will be helpful. I anticipate, however, that
motivated students who are less familiar with these subjects will
also be able to participate. If you have any questions as to whether
this class would be appropriate for you, please feel free to email
Grading and Course Credit
The course is worth 2 credits. There will be no problem sets, midterm,
or final. Instead, grades will be determined on class participation,
presenting one or more research papers, leading a discussion about
those papers, and one quiz designed to determine whether
you are keeping up with the reading and paying attention.
Each week, one or more research papers, articles, and/or excerpts from
books will be assigned. The resources will be posted on the website
or copied and distributed to students as needed.
Below is a brief outline of topics that will be covered:
- Introduction to Multimedia Computing and Networking
- Video As A Datatype
- Video Compression
- Overview of general techniques.
- Details of MPEG as a specific example.
- Audio As A Datatype
- Application-Level Framing
- Adaptive Playout Delay and Jitter Control
- Media Scaling
- Layered Coding
- TCP-Friendliness and TCP-Based Streaming.
- Periodic Broadcasting
- Peer-to-peer Streaming