Full HTML for

Basic foilset Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications

Given by Greg Lewandowski at Defense of 5 CIS Master's Theses on Dec 15 1997. Foils prepared April 13 98
Outside Index Summary of Material

Architecture and performance of low-bitrate multimedia codecs
  • The Internet
  • Technologies
  • Architectures
  • Comparison

Table of Contents for full HTML of Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications

 Denote Foils where Image Critical
Denote Foils where HTML is sufficient
1 Comparison of architecture and performance of low-bitrate multimedia codecs for Internet applications
2 Presentation
3 The Internet
4 Technologies
5 Low-bitrate Video Compression
6 Low-bitrate Video Compression
7 Audio Compression
8 Runtimes
9 Runtimes
10 Applications
11 Architectures
12 Architectures
13 Example of Architecture
14 Example of Architecture
15 Example of Architecture
16 Example of Architecture
17 Example of Architecture
18 Example of Architecture
19 Comparison of Architectures
20 Comparison of Performance
21 Comparison of Performance
22 Conclusions

Outside Index Summary of Material

HTML version of Basic Foils prepared April 13 98

Foil 1 Comparison of architecture and performance of low-bitrate multimedia codecs for Internet applications

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Grzegorz Lewandowski
HTML version of Basic Foils prepared April 13 98

Foil 2 Presentation

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Architecture and performance of low-bitrate multimedia codecs
  • The Internet
  • Technologies
  • Architectures
  • Comparison
HTML version of Basic Foils prepared April 13 98

Foil 3 The Internet

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Global Area Network
  • many connected computers
  • many incompatible operating systems
Characteristics of the Internet
  • low bandwidth
  • unreliable transfer
  • no guarantee of quality
Ideal Internet application
HTML version of Basic Foils prepared April 13 98

Foil 4 Technologies

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Compression
  • video compression (H.263)
  • audio compression (ADPCM)
Runtimes
  • ActiveMovie
  • Java Virtual Machine
HTML version of Basic Foils prepared April 13 98

Foil 5 Low-bitrate Video Compression

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Why do we need it?
Low bitrate - depends on:
  • original video sequence
  • resolution
  • frame rate
High CPU utilization
Poor quality
  • lower resolution
  • lower frame rate
HTML version of Basic Foils prepared April 13 98

Foil 6 Low-bitrate Video Compression

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
ITU-T H.263 Compression
  • coding algorithm
    • inter-picture prediction
    • DCT coding
  • INTRA vs. INTER frames
  • negotiable options
    • Advanced Prediction
    • Unrestricted Motion Vector
    • Syntax Arithmetic Coding
    • BP frames
HTML version of Basic Foils prepared April 13 98

Foil 7 Audio Compression

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Do we really need it?
Low bandwidth
  • sampling rate
  • sample width
  • number of channels
Poor quality
CPU utilization
HTML version of Basic Foils prepared April 13 98

Foil 8 Runtimes

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
ActiveMovie
  • Win32 platform; based on COM architecture
HTML version of Basic Foils prepared April 13 98

Foil 9 Runtimes

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Java
  • offers multi-platform capability - compiled binaries can be run anywhere
  • limited functionality
    • does not provide certain functionality (e.g. video and audio capturing)
    • native methods
  • poor performance
    • native methods
    • Just-In-Time compilers
HTML version of Basic Foils prepared April 13 98

Foil 10 Applications

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Internet telephony
  • audio (sometimes video) communication between two users
Videoconferencing
  • audio and video conference between multiple users
Video-On-Demand
  • audio and video delivery from video repository
  • full interaction
Presentation
  • simple case of VoD
HTML version of Basic Foils prepared April 13 98

Foil 11 Architectures

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Videoconference
  • real-time constraints
  • performance of video encoder - this is the most CPU intensive job
  • quality control and synchronization - is it necessary?
  • multiple users (streams)
HTML version of Basic Foils prepared April 13 98

Foil 12 Architectures

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Video-On-Demand
  • random access - how to overcome dependency between frames?
  • off-line encoding - performance of encoders is not critical
  • audio-video synchronization
  • quality management - handling CPU overload
  • single stream
HTML version of Basic Foils prepared April 13 98

Foil 13 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
BuenaVista videoconferencing system
HTML version of Basic Foils prepared April 13 98

Foil 14 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
BuenaVista videoconferencing system
HTML version of Basic Foils prepared April 13 98

Foil 15 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Telenor codec
File
H.263 Encoder
File
HTML version of Basic Foils prepared April 13 98

Foil 16 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
ActiveMovie codec
Source Filter
H.263 Decoder
H.263
YUV to RGB Converter
Video Renderer
...
YUV
RGB24
Source Filter
ADPCM Decoder
Audio Renderer
ADPCM
PCM
synchronization data
HTML version of Basic Foils prepared April 13 98

Foil 17 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
ActiveMovie codec
RGB to YUV Converter
Frame Clipper
H.263 Encoder
File Renderer
ADPCM Encoder
File Renderer
RGB24
RGB24
YUV
H.263
PCM
ADPCM
HTML version of Basic Foils prepared April 13 98

Foil 18 Example of Architecture

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Java decoder
Audio Provider
ADPCM Decoder
Audio Stream
Audio Player
Video Provider
H.263 Decoder
Video Player
Synchronizer
ADPCM
PCM
PCM
PCM
H.263
RGB
synchr. data
synchr. data
HTML version of Basic Foils prepared April 13 98

Foil 19 Comparison of Architectures

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Functionality
Complexity
  • runtime support vs. `from scratch' implementation
  • functionality offered
Flexibility
  • code flexibility
  • code reuse
  • binary reuse
Multi-platform
  • Java
  • C/C++
HTML version of Basic Foils prepared April 13 98

Foil 20 Comparison of Performance

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Decoders
HTML version of Basic Foils prepared April 13 98

Foil 21 Comparison of Performance

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Encoders
HTML version of Basic Foils prepared April 13 98

Foil 22 Conclusions

From Architecture and Performance of Low-bitrate Multimedia Codecs for Internet Applications Defense of 5 CIS Master's Theses -- Dec 15 1997. *
Full HTML Index
Are codecs feasible?
  • Performance barrier
  • Bandwidth barrier
Future
  • New compression formats (H.263+, H.263++)
  • New runtimes (Java Media Framework, COM for UNIX)
  • Better hardware (faster CPUs, Internet 2)
© Northeast Parallel Architectures Center, Syracuse University, npac@npac.syr.edu

If you have any comments about this server, send e-mail to webmaster@npac.syr.edu.

Page produced by wwwfoil on Mon Apr 13 1998