Contents

Preface ............................................................................................................................. 7
List of Abbreviations ....................................................................................................... 13
1. Multimedia—a n Overview 1–21
1.1 Introduction ............................................................................................................... 1
1.2 Multimedia Presentation and Production ....................................................................... 1
1.3 Characteristics of a Multimedia Presentation .................................................................. 2
1.4 Multiple Media ........................................................................................................... 5
1.5 Utilities of Multisensory Perception ............................................................................... 7
1.6 Hardware and Software Requirements .......................................................................... 7
1.7 Uses of Multimedia .................................................................................................... 9
1.8 Promotion of Multimedia based Content ..................................................................... 14
1.9 Steps for Creating a Multimedia Presentation ................................................................ 15
1.10 Conclusion ................................................................................................................ 20
Review questions ....................................................................................................... 21
2. Digital Representation 22–53
2.1 Introduction .............................................................................................................. 22
2.2 Analog Representation ................................................................................................ 22
2.3 Waves ....................................................................................................................... 23
2.4 Digital Representation ................................................................................................. 29
2.5 Need for Digital Representation .................................................................................. 30
2.6 Analog to Digital Conversion ...................................................................................... 31
2.7 Digital to Analog Conversion ...................................................................................... 37
2.8 Relation between Sampling Rate and Bit Depth ............................................................. 39
2.9 Quantization Error ..................................................................................................... 40
2.10 Fourier Representation ................................................................................................ 42
2.11 Pulse Modulation ....................................................................................................... 48
2.12 Importance and Drawbacks of Digital Representation .................................................. 50
 xxiv Contents

2.13 Conclusion ................................................................................................................ 51

Review questions ....................................................................................................... 52
3. Visual Display Systems 54–75
3.1 Introduction .............................................................................................................. 54
3.2 Cathode Ray Tube (CRT) ........................................................................................... 54
3.3 Video Adapter Card .................................................................................................. 60
3.4 Video Adapter Cable ................................................................................................. 65
3.5 Liquid Crystal Display (LCD) ...................................................................................... 66
3.6 Plasma Display Panel (PDP) ........................................................................................ 71
3.7 Conclusion ................................................................................................................ 73
Review questions ....................................................................................................... 74
4. Text 76–90
4.1 Introduction .............................................................................................................. 76
4.2 Types of Text ............................................................................................................ 77
4.3 Unicode standard ....................................................................................................... 81
4.4 Font .......................................................................................................................... 83
4.5 Insertion of Text ........................................................................................................ 84
4.6 Text Compression ...................................................................................................... 86
4.7 File Formats .............................................................................................................. 87
4.8 Conclusion ................................................................................................................ 89
Review questions ....................................................................................................... 89
5. Image 91–140
5.1 Introduction .............................................................................................................. 91
5.2 Image Types .............................................................................................................. 92
5.3 Seeing Color .............................................................................................................. 93
5.4 Color Models ............................................................................................................ 94
5.5 Basic Steps for Image Processing ................................................................................. 98
5.6 Scanner ..................................................................................................................... 99
5.7 Digital Camera ........................................................................................................ 107
5.8 Interface Standards ................................................................................................... 109
5.9 Specifications of Digital Images ................................................................................ 111
5.10 Color Management System (CMS) ............................................................................. 113
5.11 Device Independent Color Models ............................................................................ 115
5.12 Gamma and Gamma Correction .............................................................................. 117
5.13 Image Processing Software ....................................................................................... 121
5.14 File Formats ............................................................................................................ 130
5.15 Image Output on Monitor ........................................................................................ 132
 Contents xxv

5.16 Image Output on Printer .......................................................................................... 134

5.17 Conclusion .............................................................................................................. 138
Review questions ..................................................................................................... 139
6. Graphics 141–177
6.1 Introduction ............................................................................................................ 141
6.2 Advantages of Graphics ........................................................................................... 142
6.3 Uses of Graphics ..................................................................................................... 143
6.4 Components of a Graphics System ........................................................................... 144
6.5 Coordinate Systems .................................................................................................. 145
6.6 Line drawing Algorithms .......................................................................................... 146
6.7 Circle Drawing Algorithms ....................................................................................... 148
6.8 Filling Algorithms ..................................................................................................... 149
6.9 Clipping Algorithms ................................................................................................. 150
6.10 Plotter ..................................................................................................................... 152
6.11 Transformations ...................................................................................................... 153
6.12 3D Graphics ........................................................................................................... 156
6.13 3D Modeling ........................................................................................................... 156
6.14 Surface Characteristics and Texture ............................................................................ 169
6.15 Lights ..................................................................................................................... 173
6.16 Conclusion .............................................................................................................. 175
Review questions ..................................................................................................... 176
7. Audio 178–288
7.1 Introduction ............................................................................................................ 178
7.2 Acoustics ................................................................................................................. 179
7.3 Nature of Sound Waves ........................................................................................... 180
7.4 Fundamental Characteristics of sound ........................................................................ 181
7.5 Musical Note and Pitch ............................................................................................. 183
7.6 Psycho-Acoustics ..................................................................................................... 189
7.7 Elements of Audio Systems ...................................................................................... 193
7.8 Microphone ............................................................................................................ 193
7.9 Amplifier ................................................................................................................ 197
7.10 Loudspeaker ........................................................................................................... 200
7.11 Audio Mixer ............................................................................................................ 201
7.12 Digital Audio ........................................................................................................... 202
7.13 Synthesizers ............................................................................................................. 205
7.14 Musical Instrument Digital Interface (MIDI) ............................................................... 207
7.15 MIDI Messages ....................................................................................................... 209
7.16 MIDI Connections ................................................................................................... 213
 xxvi Contents

7.17 General MIDI (GM) Specifications ............................................................................ 215

7.18 Basics of Staff Notation ........................................................................................... 216
7.19 Sound Card ............................................................................................................. 220
7.20 Audio Transmission .................................................................................................. 223
7.21 Audio Recording Devices ......................................................................................... 227
7.22 Audio File Formats and CODECs ............................................................................ 235
7.23 Software Audio Players ............................................................................................ 248
7.24 Audio Recording Systems ......................................................................................... 258
7.25 Digital Audio Broadcasting ....................................................................................... 267
7.26 Audio and Multimedia .............................................................................................. 272
7.27 Voice Recognition and Response ............................................................................... 275
7.28 Audio Processing Software ....................................................................................... 277
7.29 Conclusion .............................................................................................................. 286
Review questions ..................................................................................................... 287
8. Video 289–338
8.1 Introduction ............................................................................................................ 289
8.2 Analog Video Camera .............................................................................................. 290
8.3 Transmission of Video Signals ................................................................................... 292
8.4 Video Signal Formats ............................................................................................... 299
8.5 Television Broadcasting Standards .............................................................................. 301
8.6 Digital Video ........................................................................................................... 304
8.7 Digital Video Standards ............................................................................................ 304
8.8 PC Video ................................................................................................................ 308
8.9 Video Recording Formats and Systems ...................................................................... 312
8.10 Video File Formats and CODECs ............................................................................ 320
8.11 Video Editing .......................................................................................................... 329
8.12 Video Editing Software ............................................................................................ 332
8.13 Conclusion .............................................................................................................. 337
Review questions ..................................................................................................... 338
9. Animation 339–382
9.1 Introduction ............................................................................................................ 339
9.2 Historical Background .............................................................................................. 340
9.3 Uses of Animation ................................................................................................... 340
9.4 Keyframes and Tweening .......................................................................................... 340
9.5 Types of Animation ................................................................................................. 341
9.6 Computer Assisted Animation ................................................................................... 343
9.7 Creating Movement ................................................................................................. 345
9.8 Principles of Animation ............................................................................................ 346
 Contents xxvii

9.9 Some Techniques of Animation ................................................................................. 348

9.10 Animation on the Web .............................................................................................. 352
9.11 3D Animation ......................................................................................................... 354
9.12 Camera ................................................................................................................... 355
9.13 Special Effects ......................................................................................................... 357
9.14 Creating Animation .................................................................................................. 360
9.15 Rendering Algorithms ............................................................................................... 370
9.16 Animation Software ................................................................................................. 374
9.17 File Formats ............................................................................................................ 380
9.18 Conclusion .............................................................................................................. 381
Review questions ..................................................................................................... 382
10. Compression 383–445
10.1 Introduction ......................................................................................................... 383
10.2 CODEC .............................................................................................................. 383
10.3 Types of Compression .......................................................................................... 384
10.4 Types of Redundancies .......................................................................................... 386
10.5 Lossless/Statistical Compression Techniques ............................................................ 386
10.6 GIF Image Coding Standard ................................................................................. 396
10.7 Lossy/Perceptual Compression Techniques ............................................................. 397
10.8 JPEG Image Coding Standard ............................................................................... 402
10.9 MPEG Standards Overview .................................................................................. 411
10.10 MPEG-1 Audio ................................................................................................... 418
10.11 MPEG-1 Video .................................................................................................... 421
10.12 MPEG-2 Audio ................................................................................................... 425
10.13 MPEG-2 Video .................................................................................................... 427
10.14 MPEG-4 ............................................................................................................. 428
10.15 MPEG-7 ............................................................................................................. 435
10.16 fractals ................................................................................................................. 442
10.17 Conclusion ........................................................................................................... 443
Review questions .................................................................................................. 444
11. CD-Technology 446–481
11.1 Introduction ......................................................................................................... 446
11.2 Compact Disc (CD) .............................................................................................. 447
11.3 CD Formats ......................................................................................................... 450
11.4 Magneto-Optical Discs .......................................................................................... 460
11.5 CD Interface ........................................................................................................ 461
11.6 Laserdisc (LD) ...................................................................................................... 462
11.7 Error Handling ..................................................................................................... 466
 xxviii Contents

11.8 DVD ................................................................................................................... 467

11.9 DVD-Formats ..................................................................................................... 472
11.10 Conclusion ........................................................................................................... 480
Review questions .................................................................................................. 481
12. Network Essentials 482–535
12.1 Introduction ......................................................................................................... 482
12.2 Basic Terminology ................................................................................................ 483
12.3 Network Types ..................................................................................................... 483
12.4 Network Components .......................................................................................... 485
12.5 TCP/IP Overview ................................................................................................ 490
12.6 TCP/IP Protocols ................................................................................................ 499
12.7 IP Routing ............................................................................................................ 504
12.8 Dynamic Host Configuration Protocol (DHCP) ...................................................... 507
12.9 Host Name Resolution .......................................................................................... 508
12.10 Access Methods .................................................................................................... 513
12.11 The Internet .......................................................................................................... 513
12.12 Services on the Internet ......................................................................................... 515
12.13 Connecting to the Internet ...................................................................................... 526
12.14 The Intranet .......................................................................................................... 528
12.15 Conclusion ........................................................................................................... 533
Review questions .................................................................................................. 534
13. Multimedia Architecture 536–623
13.1 Introduction ......................................................................................................... 536
13.2 User Interfaces ...................................................................................................... 537
13.3 Windows Multimedia Support ............................................................................... 541
13.4 Hardware Support ................................................................................................ 546
13.5 Distributed Multimedia Applications ....................................................................... 552
13.6 Real-time Protocols ............................................................................................... 556
13.7 Playback Architectures ................................................................................................
13.8 Streaming Technologies ......................................................................................... 562
13.9 Temporal Relationships .......................................................................................... 570
13.10 Synchronization ..................................................................................................... 571
13.11 Multimedia Database Systems (MMDBS) ................................................................ 574
13.12 Feature Extraction of Image .................................................................................. 586
13.13 Feature Extraction of Audio .................................................................................. 599
13.14 Feature Extraction of Video .................................................................................. 610
13.15 Similarity Metrics ................................................................................................... 613
13.16 Indexing Mechanisms ............................................................................................ 615
 Contents xxix

13.17 Characteristics of Multimedia Databases ................................................................. 616

13.18 Benchmarking of MMDBS ................................................................................... 618
13.19 Object Oriented Approach .................................................................................... 619
13.20 Conclusion ........................................................................................................... 621
Review questions .................................................................................................. 622
14. Multimedia Documents 624–651
14.1 Introduction ......................................................................................................... 624
14.2 Document and Document Architecture ................................................................... 624
14.3 Designing a Multimedia Interchange Format ............................................................ 625
14.4 Markup ................................................................................................................ 626
14.5 Standard Generalized Markup Language (SGML) .................................................... 627
14.6 Open Document Architecture (ODA) ..................................................................... 634
14.7 Multimedia and Hypermedia Information Coding Expert Group (MHEG) ............... 636
14.8 Hypermedia Time based Structuring Language (HyTime) ......................................... 637
14.9 Open Media Framework (OMF) ............................................................................ 638
14.10 Digital Copyrights ................................................................................................. 640
14.11 Conclusion ........................................................................................................... 650
Review questions .................................................................................................. 651
15. Multimedia Application Development 652–686
15.1 Introduction ......................................................................................................... 652
15.2 Software Life Cycle Overview ............................................................................... 652
15.3 ADDIE Model .................................................................................................... 654
15.4 Conceptualization .................................................................................................. 655
15.5 Content Collection and Processing .......................................................................... 656
15.6 Story .................................................................................................................. 657
15.7 Flowline ............................................................................................................... 657
15.8 Script ................................................................................................................... 658
15.9 Storyboard ........................................................................................................... 662
15.10 Implementation .................................................................................................... 666
15.11 Authoring Metaphors ............................................................................................ 667
15.12 Testing and Feedback ............................................................................................ 669
15.13 Final delivery ........................................................................................................ 669
15.14 Report Writing/Documentation ............................................................................. 670
15.15 Case Study ........................................................................................................... 671
15.16 Computer Games ................................................................................................. 678
15.17 Conclusion ........................................................................................................... 685
Review questions .................................................................................................. 685
 xxx Contents

16. Virtual Reality 687–692

16.1 Introduction ......................................................................................................... 687
16.2 Forms of Virtual Reality ........................................................................................ 687
16.3 VR Applications .................................................................................................... 688
16.4 Software Requirements .......................................................................................... 689
16.5 Peripheral Devices ................................................................................................. 690
16.6 Virtual Reality Modeling Language (VRML) ............................................................. 691
16.7 Conclusion ........................................................................................................... 691
Review questions .................................................................................................. 692
17. FUTURE DIRECTIONS 693–694
Appendix ............................................................................................................. 695
Bibliography ......................................................................................................... 703