Face Recognition

Presented By:Yogen Sharma 1509262 EC-6

Contents
s s s s s

Face Segmentation/Detection Facial Feature extraction Face Recognition Video-based Face Recognition Comparison

Face Segmentation/Detec tion

Before the middle 90s, the research attention was only focused on singleface segmentation. The approaches included:
x x x

Deformable feature-based template Neural network Using skin color

Face Segmentation/Detecti on
During the past ten years, considerable progress has been made in multi-face recognition area, includes:
x

Example-based learning approach by Sung and Poggio (1994). The neural network approach by Rowley et al. (1998). Support vector machine (SVM) by Osuna et al. (1997).

Example-based learning approach (EBL)

Three parts:
s

The image is divided into many possibleoverlapping windows, each window pattern gets classified as either a face or not a face based on a set of local image measurements. For each new pattern to be classified, the system computes a set of different measurements between the new pattern and the canonical face model. A trained classifier identifies the new pattern as a face or not a face.

Example of a system using EBL

Neural network (NN)

s s

Kanade et al. first proposed an NNbased approach in 1996. Although NN have received significant attention in many research areas, few applications were successful.

Why?

Neural network (NN)

s

Its easy to train a neural network with samples which contain faces, but it is much harder to train a neural network with samples which do not. The number of non-face simples are just too large.

Neural network (NN)

s

Neural network-based filter. A small filter window is used to scan through all portions of the image, and to detect whether a face exists in each window. Merging overlapping detections and arbitration. By setting a small threshold, many false detections can be eliminated.

Test results of using NN

SVM
s

SVM was first proposed in 1997, it can be viewed as a way to train polynomial neural network or radial basic function classifiers. Can improve the accuracy and reduce the computation.

Comparison with EBL

s s

Test results reported in 1997. Using two test sets (155 faces). SVM achieved better detection rate and fewer false alarms.

Recent approaches
Face segmentation/detection area still remain active, for example:
x

An integrated SVM approach to multiface detection and recognition was proposed in 2000. A technique of background learning was proposed in August 2002.

Still lots of potential!

Video-based Face Recognition

s

Three challenges:
x x x

Low quality Small images Characteristics of face/human objects. Allows Provide much more information. Tracking of face image. Provides continuity, this allows reuse of classification information from high-quality images in processing low-quality images from a video sequence.

Three advantage:
x x x

Basic steps for video-based face recognition

s s

Object segmentation/detection. Motion structure. The goal of this step is to estimate the 3D depths of points from the image sequence. 3D models for faces. Using a 3D model to match frontal views of the face. Non-rigid motion analysis.

Recent approaches
Most video-based face recognition system has three modules for detection, tracking and recognition.
x

An access control system using Radial Basis Function (RBS) network was proposed in 1997. A generic approach based on posterior estimation using sequential Monte Carlo methods was proposed in 2000. A scheme based on streaming face recognition (SFR) was propose in August 2002.

Questions