Networked multimedia communications: theory, principles,
practical techniques, and examples.
- Networked multimedia: theory, principles, techniques,
standards, and examples
- Audio-visual integration, multimedia processing,
organization, storage, and retrieval
- Emerging MPEG standards, including MPEG-4, MPEG-7, and
MPEG-21
- New solutions for network/traffic management, service
deployment, and QoS
- Contains over 200 illustrations and over 400
references
As networks converge and bandwidth availability
increases, networked multimedia communications systems are
becoming increasingly powerful and ubiquitous.
Multimedia Communication Systems is a comprehensive
guide to the theory, principles, and practical techniques
associated with implementing these systems. Three of the
field's leading researchers review today's key developments
in multimedia communications, ranging from the latest
multimedia architectures to the implications of Internet2
for advanced multimedia delivery. They cover every aspect
of multimedia communications system development,
emphasizing emerging standards, advanced processing
techniques, and network/traffic management.
- Networked multimedia systems: models and elements
- Audio-visual integration: media integration, lip
synchronization, audio-to-visual mapping, and joint
audio-video coding
- Multimedia processing, in depth: perceptual coding;
transform and audio subband coders; CD audio coding; image
and video coding; and watermarking
- Practical techniques for organization, storage, and
retrieval —including advanced neural network
processing systems
- New approaches to service deployment and ensuring
consistent Quality of Service (QoS)
With over 200 figures, more than 400 references, and an
exceptionally wide range of practical examples, this book
is a unique resource for every professional working with
advanced multimedia technologies.
Table of Contents
Preface.
Acknowledgments.
List of Acronyms.
1. Multimedia Communications.
Introduction. Multimedia
Communication Model. Elements of Multimedia Systems. User
Requirements. Network Requirements. Packet Transfer
Concept. Multimedia Requirements and ATM Networks.
Multimedia Terminals. Concluding Remarks.
2. Audio-Visual Integration. Introduction. Media
Interaction. Bimodality of Human Speech. Lip Reading.
Speech-Driven Talking Heads. Lip Synchronization. Lip
Tracking. Audio-to-Visual Mapping. Bimodal Person
Verification. Joint Audio-Video Coding. Concluding
Remarks.
3. Multimedia Processing in Communications. Introduction. Digital
Media. Signal-Processing Elements. Challenges of Multimedia
Information Processing. Texture-Based Methods. Shape-Based
Methods. Color-Based Methods. Perceptual Coding of Digital
Audio Signals. Absolute Threshold of Hearing. Critical Band
Frequency Analysis. Simultaneous Masking and the Spread of
Masking. Temporal Masking. PE. Transform Audio Coders.
Audio Subband Coders. Speech Coder Attributes. CD Audio
Coding for Multimedia Applications. Image Coding. Video
Coding. Watermarking. Organization, Storage and Retrieval
Issues. Signal Processing for Networked Multimedia. NNs for
Multimedia Processing. Multimedia Processors. Concluding
Remarks.
4. Distributed Multimedia Systems. Introduction. Main
Features of a DMS. Resource Management of DMS. Networking.
IP Networking. IP Multicast. Resource ReservationProtocol
(RSVP). RTP. Performance Management. Fault Management.
Configuration Management. Security Management. Accounting
and Billing Management. Multimedia Operating Systems. CPU
Management. Memory Management. I/O Management. File System
Management. Distributed Multimedia Servers. Distributed
Multimedia Applications. VoD. Telecooperation
Infrastructure. Telecooperative Applications. Telemedicine.
Basic Features of a Hypermedia System. The Web. Concluding
Remarks.
5. Multimedia Communication Standards. Introduction. MPEG
Approach to Multimedia Standardization. MPEG-1 (Coding of
Moving Pictures and Associated Audio). MPEG-2 (Generic
Coding of Moving Pictures and Associated Audio). MPEG-2
Video-The Basics. MPEG-2 Video Syntax. MPEG-2 Video
Scalability. MPEG-2 Video: Profiles and Levels.
MPEG-4-Coding of Audiovisual Objects. Media_Objects. MPEG-4
Version 1. MPEG-4 Version_2. Extensions to MPEG-4 Beyond
Version 2. Profiles in MPEG-4. Verification Testing:
Checking MPEG's Performance. MPEG-4 Standardization
Process. Requirements for MPEG-4. MPEG-4 Systems
Architecture. Elementary Stream Management (ESM). Auxiliary
Descriptors and Streams. Structuring Content by Grouping of
Streams. Managing Content Complexity. Distributed
Content-Handling Considerations. System Decoder Model (SDM)
for ES Synchronization. MPEG-4 Systems BIFS. DMIF
Computational Model. Shape-Coding Tools for MPEG-4 Natural
Video. Motion Estimation and Compensation. Texture-Coding
Tools. Multifunctional Coding. Sprite Coding. Scalability.
Error Resilience. Relationship Between Natural and
Synthetic Video Coding. Synthetic Images. Integration of
Face Animation with Natural Video. FAPs. Face Model. Coding
of FAPs. FIT. Integration of Face Animation and
Text-to-Speech (TTS) Synthesis. BIFS for Facial Animation.
2D Mesh Coding. VO Tracking. 2D-Mesh Object
Encoder/Decoder. MPEG-4 Natural Audio Coding. General Audio
Coding (Advanced Audio Coding Based). Twin VQ. Speech
Coding in MPEG-4 Audio. Scalability in MPEG-4 Natural
Audio. Synthetic Audio in MPEG-4. Audio BIFS. Visual Object
Types. Visual Profiles. Audio Object Types. Audio Profiles.
Graphics. Systems Profiles. MPEG-4 Visual Texture Coding
(VTC) and JPEG 2000 Image Compression Standards. MPEG-4
VTC. JPEG. PNG. Region of Interest (ROI) Coding.
Scalability. Error Resilience. IPRs. Error Resilience.
MPEG-7 Standardization Process of Multimedia Content
Description. MPEG-7 Systems. MPEG-7 DDL. MPEG-7 Audio.
MPEG-7 Visual. MPEG-7 MMDSs. MPEG-7 Reference Software
(XM). MPEG-7 Conformance. MPEG-21 Multimedia Framework.
MPEG-21 Digital Item Declaration. Content Representation.
Digital Item Identification and Description. Content
Management and Usage. Intellectual Property Management and
Protection. Terminals and Networks. Event Reporting. ITU-T
Standardization of Audiovisual Communication Systems
(H.310, H.320, H.321, H.322, H.323, and H.324). H.320
Standard. Standards for Audiovisual Services Across ATM
H.310 and H.321. Standard H.322-Guaranteed QoS LAN Systems.
ITU-T H.323 Standard. H.324 Standard. H.261 Standard. H.263
Standard. H.263+ (H.263 Version 2) Standard. H.263++
Standard Development. H.26L Standard. Bit Rate_. Delay.
Complexity. Quality. ITU-T Recommendation H.221. ITU-T
Recommendation H.223. ITU-T Recommendation H.225. Common
Control Protocol H.245_. IETF and Internet Standards.
Classical IP Stack. IP Version 6_. Priority Field. Flow
Label. IPv6 Addresses. Hop-by-Hop Options Header. Fragment
Header_. Routing Header. IPv6 Security. Signaling. Session
Control. Transport_. Network Infrastructure_. Multimedia
Data for Network Use. Use of RTP_. System Architecture.
MPEG-4 Server. MPEG-4 Client. Concluding Remarks.
6. Multimedia Communications Across Networks.
Packet Audio/Video in the
Network Environment. Video Transport Across Generic
Networks. Layered Compression. Layered Transmission.
Error-Resilient Encoding. Decoder Error Concealment.
Error-Resilient Entropy Code. Rate Control Techniques.
Theoretical Foundation of the SRC. Video Compression.
Requirements Imposed by Streaming Applications. Application
Layer QoS Control. Continuous Media Distribution Services.
Streaming Servers. Media Synchronization. Protocols for
Streaming Video. Multimedia Transport Across ATM Networks.
Multimedia Across IP Networks. MPEG Video Transmission on
the Internet. Video Coding for Multimedia Across IP.
Multimedia Across DSLs. Serial Transmission: TDM. Parallel
Transmission Frequency Division Multiplexing. Internet
Access Networks. Multimedia Across Wireless. Communication
System (WBCS) for Multimedia. Speech Transmission in GSM.
Video Across GSM. Mobile ATM. Mobile IP. Wireless
Multimedia Delivery. SIP in Mobile Environment. Multicast
Routing in Cellular Networks. Broadband Wireless Mobile.
Digital Video Broadcasting (DVB). Data Transmission Using
MPEG-2 and DVB. MPEG Program Stream. MPEG Transport Stream.
Broadband Multimedia Satellite Systems. Multimedia Home
Platform. Multimedia Car Platform. Digital Television
Infrastructure for Interactive Multimedia Services.
Interactive Broadcast Data (IDB) Services. Data Carousel
Concept. Concluding Remarks.
References. Index. About the Authors.