Professional Documents
Culture Documents
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
MOTIVATION
What does expression recognition mean?
Guessing the meaning of facial deformations.
Shape Parameters
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
SNAKE MODEL
Introduced by Kass and Witkin. Energy Minimization Problem:
Used by Waters and Terzopoulos for tracking. Snakes are fit to important regions, and tracked from one view to the other.
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
PROBLEM DESCRIPTION(Tracking 1)
PROBLEM DESCRIPTION(Tracking 2)
X(t) X(t+1)
TIME t+1
?
I(t+1)
I(x(t))
X(t)
?
[ Rigid, Open Mouth, Smile]
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
ASSUMPTIONS
Cameras are calibrated. The person should move slow unless the camera is fast enough for motion capture. The mesh is initialized to the first image. The user performs the expressions known to the computer
Data
Stereo Tracking
Learn Shape
Monocular Tracking
X = X0 + i Xi
i =1
p - degrees of freedom
u I x I y = I t v
?
Time t+1:
Il(xi(t+1))
- For robustness, u and v are estimated using a neighbourhood around the point.
X = X0 + i Xi
i =1
u I x I y = I t v
X ( R, T , )
TIME t+1
I(x(t))
I(t+1)
u u dR u u dR dT d dT v = v v v d dR dT d
J
[I
Iy
dR J dT = I t d
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION
THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
STEREO LEARNING
FACE TRACKING
- The deformation space of a particular individual is learnt - That particular individual is tracked using a mono camera
X = X 0 + i X i
i =1 P
- Tracked parameters : , R, T.
-The deformation space of a subset of people learnt - The shapes are aligned and PCA is applied on this set
OVERVIEW
MOTIVATION PREVIOUS WORK PROBLEM DESCRIPTION
THEORY OF TRACKING TRACKING VIDEOS THEORY OF SVM
- Best discriminating hyperplane between two class of objects - Distinguish the vectors that carry the relevant information (support vectors) - if nonlinear data, map the data to high dimensional domain, then apply the SVM.
Expected Contributions
- Show that 3-D model based tracking is suitable for further applications. - Support vector machine is a suitable classifier for expression recognition