Project Seminar

on
FACE AS A MOUSE

INTRODUCTION
The system is a human computer interface for
mouse operations using face.
System serves as an intermediate block between the
users and computer.
It will capture the desired feature with a webcam
and monitor its action in order to translate it to
some events that communicate with the computer.
While different devices were used in HCI (e.g.
infrared cameras, sensors, Microphones) we used
an off-the-shelf webcam that affords a moderate
resolution and frame rate as the capturing device in
order to make the ability of using the program
affordable
for all individuals.

Purpose

Our product Capture the desired feature with a

webcam and
monitor its action in order to translate it to
some events that
communicate with the computer.
It is unlike the Hardware mouse.

Objectives
The main objective of the project is to
replace
physical mouse.
The face is detected in real time and
tracked
down so that the face movements will
become the mouse movements.
To simulate mouse clicks; eye blinks, mouth

opening/closing, and sometimes eyebrow

movement should be used

Scope
System will track the face and store the
coordinates in the file.
It will check the file when there is movement of
face is detected.
System will compare both coordinates and
perform the action i.e. it will allow the user to
control the mouse operations using webcam.
The system will perform the operation such as
double click and single click by eye blinking.
If the user blinks the left eye for twice then it will
perform double click operation

Feature
The system provide the efficient way to control
mouse operations wirelessly and without the help
of mouse hardware.
It has same accuracy as compared to the
traditional mouse.
The system provides the facility of click and
select.

REQUIREMENTS:

Software :
Language : Java, JMF (image processing),
webcam
Hardware :
o 512 MB RAM
o HARD DISK 40 GB
o 1.2GHz PROCESSOR

Interfaces
System Interfaces
As stated previously, system serves as an intermediate block
between the user and computer.
The interface between user and computer system serves as
primary input to system.

It captures facial feature with webcam and monitor its action

and translates it to some event. Then perform that event.

User Interfaces
The screen of computer will show users face detected by
webcam.
User should be in front of screen so the webcam will
detect his/her face Screen will show user inter pointing
on screen which is moving with the movement of nose
tip.
With the help of nose tip and by moving it user will point
the pointer to desired location for further operations like

single click, double click etc.

Software Interfaces
Detection:
Detection phase includes the detection of webcam. the webcam is
detected according to the users choice(If multiple webcams
detected).
The live video is fed to system and the face of the user is detected.
After face detection, the eye coordinates and location are
calculated.
Performing operation:
Mouse pointer operations are performed by detecting and tracking
the
face movements.
The eye location and eyebrows are used for better face tracking.
The mouse click operation is performed based on the eye blink
detection.

Memory
In this system there are no restrictions
on memory,
but for better performance the RAM size
should be
higher.

Operations
The webcam feds the system with the input and
the system will detect the face.
The system will then track the face location and
facial features.
The system detects the nose tip and eye
location. The geometrical operation and integral
image processes are performed on the input.

CONSTRAINTS
As there is limitation on the distance
between the user and webcam, the
user must sit under the distance
recommended.
The user must sit steadily for
detection of face.
The webcam must support 320*240
resolution for better performance.

Data Flow Diagram

Limitations

Distance

Frame rate

Lighting conditions

Conclusion

All the mouse operations are done by using eye,

nose tip and eye blinks.

Lighting conditions

References
1.Erik Hjelm and Boon Kee Low, Face detection : A survey.
Computer Vision and Image Understanding 83, 236274 (2001).

2. Oraya Sawettanusorn, Yasutaka Senda, Shinjiro Kawato, Nobuji

Tetsutani, and Hironori Yamauchi, Detection of Face Representative
Using Newly Proposed Filter.

3. Paul Viola, Michael J.Jones, Robust Real-Time Face Detection.

International Journal of Computer Vision 57(2), 137154, 2004.

4. Peter Tio Support Vector Machines.

School of Computer Science University of Birmingham 2003.

5. BioID face detection database.

.6. SVMlight, Thorsten Joachims.

Questions?????

Thank You !!