Elements of Data Compression

Adam Drozdek
Duquesne University

- BROOKS/COLE

THOMS O N LEARNING

Australia Canada Mexico Singapore Spain United Kingdom United States

 Conten t s

1.2 Noiselessand Memoryless Coding I 7

1.2.1 The Kraft lnequality 9
1.2.2 FundamentalTheoremof DiscreteCoding 11

1.3 Appendix: Bounds of the Entropy Function H i 14

1.4 Appendix:Tables of Functions -lg p and -p lg p I 16

Chapter 2 Shannon-Fan0 Coding / 19

2.1 ShannonCoding I 19
2.2 Shannon-Fano Coding 1 21

Chapter 3 HuffmanCoding / 25
3.1 Huffman Coding with Low Memory Requirements 31
3.2 Adaptive Huffman Coding i 32

Chapter 4 Arithmetic Coding / 45

4.1 lmplementation of Arithmetic Coding i 48
i 4.1.1Integer lmplementation 55
viii Contents

Chapter 5 Dictionary Techniques / 61

5.1 TheLZ77Technique i 62
5.1.1 The LZSS Technique 64

5.2 The LZ78 Technique i 65

5.2.1 The LZW Technique 67

Chapter 6 Sampling and Quantization / 73

6.1 Sampling 75
6.2 Quantization i 78
6.2.1 Scalar Quantization / 79
6.2.1 .I Uniform Quantization 80
6.2.1.2 Nonuniform Quantization 83
6.2.2 Vector Quantization / 84
6.2.2.1 The K-Means Algorithm 87
6.2.2.2 Tree Codebook 90

6.3 Appendix: Probability Distribution Functions / 92

Chapter 7 Predictive Coding / 95

7.1 Delta Modulation 95
7.1.1 Adaptive Delta Modulation 97
7.1.2 Delayed Coding and Delta Modulation 100

7.2 Differential Pulse Code Modulation i 102

7.2.1 Adaptive Differential Pulse Code Modulation 105
7.2.1.1 Adaptive Prediction 106

Chapter 8 Transform Coding / 111

8.1 Detining a Transform i 112
8.2 Interpretation ofTransforms i 115
8.2.1 Transforms and Rotation of Axes 115
8.2.2 Transforms and Basis Matrices 118

8.3 The Karhunen-LoeveTransform i 120

8.4 The Hadamard Transform / 124

c
8.5 The Discrete Fourier Transform i 126
 Contents ix

8.6 The Discrete Cosine Transform / 127

8.7 The Discrete Wavelet Transform / 128

8.8 Appendix:Matrices / 129

Chapter 9 SubbandCoding / 133

9.1 Filters / 134

9.2 Downsampling and Upsampling / 137

9.3 Bit Allocation / 138

Chapter 10 Compression of Still Images: JPEG / 143

10.1 The Baseline System / 144
10.1.1 Source Image Format 144
10.1.2 DCT-Based Coding 146
10.1.3 Quantization 147
10.1.4 Encodingthe QuantizedCoeficients 148
10.1.4.1 Encoding DC Coefficients 149
10.1.4.2 Encoding AC Coefficients 150
10.1.5 Multicomponent Images 152
10.1.6 Extended Sequential System 154

10.2 Progressive DCT-based Mode of Operation / 154

10.2.1 Spectral Selection 154
10.2.2 Successive Approximation 154

10.3 Hierarchical Mode of Operation / 156

10.4 Sequential Lossless Mode of Operation / 158

10.5 JPEG 2000 / 159

Chapter 11 Video Image Compression:MPEG / 161

11.1 MPEG-1 / 161
11.1.1 MPEGVideoLayers 161
11.1.2 Motion Compensation and Motion Estimation 165

11.2 MPEG-2 / 169

11.3 MPEGBandMPEG-7 / 170

x Contents

Chapter 12 Fourier Analysis / 173

12.1 FourierSeries / 173

12.2 The Fourier Transform / 179

12.3 The Discrete Fourier Transform / 182

12.3.1 The Discrete CosineTransform 186

12.4 The Sampling Theorem / 190

12.5 Appendix:Complex Numbers and Eulers ldentity / 192

Chapter 13 Wavelets / 195

13.1 Wavelet Transforms / 196

13.2 MultiresolutionAnalysis / 199

Appendix Data Compression Software on the lnternet / 215

Indexes Namelndex / 217

Subjectlndex / 219