BLUE EYE

presented by:
AKSHAT
JAIN(100130502)

WHAT IS BLUE EYES TECHNOLOGY

Aims at creating a computational machines that

have perceptual and sensory ability.

Use camera and microphone to identify user
action and emotion.
The BLUE EYES technology aims at creating
computational machines that have perceptual and
sensory ability like those of human beings.

THE TERM BLUE EYES

BLUE in the term stands for Bluetooth , which

enables reliable wireless communication.

EYES ,because the eye movement enables us

to obtain a lot of interesting and important

information.

NEED OF BLUE EYES

TECHNOLOGY
To built a machine that can understand your

emotions.
A PC that can listen, talk or scream
Verify your identity , feels your presence and

interact with you.

SYSTEM OVERVIEW
Data Acquisition Unit
Atmel 89C52
microcontroller
Jazz
Multisensor

Bluetooth

Central System Unit

Bluetooth

Connection
Manager

Visualization
Module

Data Analysis

Data
Logger

Bluetooth technology provides means for

creating a Personal Area Network linking
the operators and the central system.

DAU FEATURES
Data Acquisition Unit
Atmel 89C52
microcontroller
Jazz
Multisensor

Bluetooth

Lightweight
Runs on batteries - low

power consumption
Easy to use - does not
disturb the operator
working
ID cards for operator
authorization
Voice transmission using
hardware PCM codec

DAU
The DAU consists of the
following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE
supports synchronous voice
data transmission
PCM CODEC used to transmit
operators voice and central
system sound feedback
UART communication
between bluetooth module
and microcontroller (115200
bps)
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface

CSU - features

Connection
management
Data processing
Visualization
Data recording
Access verification
System maintenance

Central System Unit

Bluetooth

Connection
Manager
Data Analysis

Visualization
Module
Data
Logger

CSU COMPONENTS
CONNECTION MANAGER main task to

perform low-level blue tooth communication

DATA ANALYSIS MODULE performs the
analysis of the raw sensor data in order to
obtain information about operators
physiological condition
DATA LOGGER MODULE provides support
for storing the monitored data.
VISULAIZATION MODULE provides user
interface for the supervisors

TECHONOLOGIES USED
Emotion Mouse
Manual and Gaze Input Cascaded(MAGIC)
Artificial Intelligent Speech Recognition
Simple User Interest Tracker (SUITOR)
The EYE movement sensor

How can we make computers

see and feel ?
Blue eyes uses sensing technology to

identify a users actions and to extract key

information.
Information is then analyzed to determine
the users physical ,emotional ,or
informational state.

EMOTION MOUSE
Simplest way
People spend approximately 1/3 of

their
total computer time touching input
device
Physiological

data

is

obtained

&

emotional
state is determined
A user model will be built that reflects

the personality of user

PHYSIOLOGICAL
SIGNALS

IBM RESERCH
BLUE EYE EMOTIONAL MOUSE
sensors in the mouse ,sense the physiological
attributes which are correlated to emotions
using correlation model -by simply touching the
mouse ,the computer will be able to determine
a persons emotional state.
BLUE EYE enabled TELEVISION
could become active when the user makes an
eye contact.

MAGIC POINTING
Reduced the cursor movement needed for

target selection
Click on target with a regular manual input

device
Two pointing techniques

Liberal
Conservation

APPROACHES
Liberal Approach

To wrap the cursor to every new object user

looks at
Conservative Approach
Does not wrap the cursor target until the manual
input device has been actuated

ARTIFITIAL INTELLIGENT SPEECH

RECOGNITION
Input words are scanned and matched against

internally stored words

Identification causes some action to be taken user
speaks to the computer through microphone
Pattern matching is designed to look for the best
fit because of variations in loudness, pitch,
frequency difference, time gap etc.

APPLICATION OF ARTIFICIAL
INTELLIGIENCE SPEECH RECOGNITION
To control weapons by voice commands
Pilot gives commands to computers by

speaking into microphones

Can be connected to word processors and
instead of writing , simply dictate to them

SIMPLE USER INTEREST TRACKER

(SUITOR)
Help by fetching more information at desktop
Notice where the users eyes focus on the

screen
Fills a scrolling ticker on a computer screen

with information related to users task

Ex. If reading headline ,pops up the story in

the browser window

THE EYE MOVEMENT SENSOR

DESIGNING
A personal area network for linking all the

operators and the supervising system

Two major units are
DAU(Data Acquisition Unit)
CSU(Central System Unit)

EXPERIMENT
Measurement of heart rate ,temperature,

galvanic skin response (GSR),general somatic

activity
Six basic emotions are anger ,fear ,sadness ,

disgust , joy and surprise

APPLICATIONS
In retailing record and interpret customer

movements
In automobile Industry
In video Games
To create Face Responsive Display and
Perceptive Environment Generic control
room
Power station
Flight control centers

CONCLUSION
Provide more delicate and user friendly

facilities in computing devices

Gap between the electronics and physical
world is reduced
The computers can be run using implicit
commands instead of the explicit commands
In the near future ,ordinary household
devices- such as television , refrigerators
,ovens may be able to do their jobs when we
look at them and speak to them.
Future applications of blue eye technology is
limitless

THANK
YOU