Multi-Frame Optimized

Quantization

Presented By
Ranjith J
16IT304

AGENDA
Introduction
Inter-frame Dependencies
Lagrangian approach
Multi-frame transform co-efficient optimization
Application of the optimization method to H.265/HEVC
Extension of the method for scalable video coding
Conclusions and outlook

INTRODUCTION

In video coding, there are inter-frame dependencies due

to motion-compensated prediction.
The achievable rate distortion performance of an intercoded frame depends on the coding decisions made
during the encoding of its reference frames.

INTER-FRAME DEPENDENCIES

LAGRANGIAN APPROACH

HYBRID MODEL

THE VIDEO CODING STANDARD

H.265/HEVC

H.265/HEVC is the latest video coding standard which

has been jointly developed by the ITU-T Video Coding
Experts Group (VCEG) and
The ISO/IEC Moving Picture Experts Group (MPEG),
the two most relevant standardization organizations in
the area of video compression.

CONTINUE.

PREDICTION BLOCK PARTITIONING

Whereas in H.264/AVC each frame is split into macro
blocks of 16 16 luma samples, the basic structure in
H.265/HEVC is the Coding Tree Unit (CTU).
The block size of a CTU is variable, but fixed within a
sequence.
The following CTU sizes are possible:
16 x 16, 32 x 32, or 64 x 64 luma samples

TRANSFORM DOMAIN REPRESENTATION

Each CU is split into one or more Transform Units (TUs) by the
usage of secondary quad tree structure, called Residual Quad
tree (RQT).
H.265/HEVC supports transform sizes of 4 4, 8 8, 16 16, and
32 32 samples.
In the bit stream, for each TU, so-called transform coefficient
levels are transmitted.
From each transform coefficient level, the actual transform
coefficient is derived by multiplication by a scaling factor, which
depends on the Quantization Parameter (QP) value.

10

OPTIMIZATION OF DPCM FOR GAUSS-MARKOV

SOURCES

11

EMPIRICAL RATE DISTORTION CURVES

12

QUADRATIC PROGRAM APPROACH

e generic form of a QP is as follows:

13

APPLICATION OF THE OPTIMIZATION METHOD TO

H.265/HEVC
There are four basic configurations:

Intra

Random access

Low delay using B frames

Low delay using P frames

14

MULTI-FRAME OPTIMIZATION IN AN IPPP

15

CONCLUSIONS
The optimization method developed in this thesis relies
on the commonly used squared error distortion measure.
It is a well-known fact, that this metric only roughly
corresponds to the subjective visual quality.
It could be countered, however, that hybrid video
encoders introduce only special types of artifacts (e.g.,
there is typically no rotation, scaling, brightness change
etc.), and that for the kind of artifact which is introduced,
the squared error measure serves its purpose apparently
quite well. Still, there has been considerable work on the
topic of perceptual visual quality metrics.

16

REFERENCE
1. www.Multi-Frame
Optimized
Fraunhofer
Heinrich Hertz Institute.com
2. M. Winken, Multi-Frame Optimized Quantization
for High Efficiency Video Coding, Ph.D.
dissertation, TU Berlin, 2015.
3. https://www.hhi.fraunhofer.de/en/departments/vca
/research-groups/image-video-coding/researchtopics/multiview-video-coding.html

17

THANK YOU!

18