1

Presented by:
Sristi Kapoor Shubham kejriwal Raktim Roy Arnab Das Srijanee Biswas

WHAT WE WILL TALK ABOUT: Introduction to Blue Eyes technology

About Blue Eyes System designing System overview Data security

Applications of Blue Eyes Technology

Conclusion

3 ?

WHAT IS BLUE EYES TECHNOLOGY?

The wider meaning..

BLUE in the term stands for Bluetooth,

which enables reliable wireless communication. EYES , because the eye movement enables us to obtain a lot of interesting and important information.

NEEDS: To build a machine that can understand your emotions A PC that can listen, talk or scream Verify your identity, feels your presence and interact with you

PROPOSED TECHNOLGIES
Emotion Sensor
Manual And Gaze Input Cascaded (MAGIC) Artificial Intelligent Speech Recognition

Simple User Interest Tracker (SUITOR)

EMOTION SENSOR

EMOTION MOUSE
Simplest way to sense anger, fear, sadness, disgust, happiness, surprise, etc when we use a computer People spend approximately 1/3 of their total computer time touching the input device Recognizes your emotions based on processed data and speak to you based on the processing

Emotion mouse implemented on a real mouse

Emotion mouse developed by ibm

10

PARAMETERS SENSED:
BIOLOGICAL PARAMETERS: Heart Rate Blood Pressure Body Temperature Skin Conductivity(GSR)

PHYSICAL PARAMETERS: Finger Pressure Button Click Frequency

Heart rate sensor

11

12

Steps involved
Physiological data is obtained based on mouse movements,button click frequency & finger presssure. Some biological parameters are also sensed. Data acquisition system receives the analog data from several sensors and converts it to discrete data. The discrete sampled data is sent to CPU for further processing and determination of our emotional and mental state.

13

14

What is it?
Manual
And Gaze Input Cascaded

15

key idea
1. The eyes are used as a source of input in advanced user interfaces 2. Use gaze to dynamically redefine (warp) the home position of the pointing cursor at the vicinity of the target 3. To effectively reduce the cursor movement.

16

Magic pointing
A touch of the mouse positions the mouse pointer at the current gaze position of the user
The pointer is always at the position where the user expects it on the screen. This approach changes the user experience in tasks that include frequent switching between keyboard and mouse

17

Contd
Pointing (target acquisition) is the core element here.

One has to be conscious of where one looks and how long one looks at an object otherwise selection will be erroneous.

18

APPROACHES
LIBERAL APPROACH To warp the cursor to every new object user looks at. The liberal approach may appear proactive,
CONSERVATIVE APPROACH Does not warp the cursor target until the manual input device has been actuated.

19

Liberal approach

Figure 1. The liberal MAGIC pointing technique: cursor is placed in the vicinity of a target that the user fixates on.

20

CONSERVATIVE APPROACH

Figure 2. The conservative MAGIC pointing technique with intelligent offset

21

Fig.3 Trial Completion time

22

23

SUITOR
Help by fetching more information at desktop

Notice where the users eyes focus on the screen

Fills a scrolling ticker on a computer screen with information related to users task Ex. If reading headline ,pops up the story in the browser window

24

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION

Speech Recognition (SR) is the translation of spoken words into text
These systems analyze the person's specific voice and use it to fine tune the recognition of that person's speech, resulting in more accurate transcription

25

26

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION

Input words are scanned and matched against internally stored words
Identification causes some action to be taken User speaks to the computer through microphone Filtered and fed to ADC and then stored in RAM

27

APPLICATIONs: To control weapons by voice commands Can be connected to word processors and instead of writing, simply dictate to them System control/navigation digital maps e.g.-GPS-connected

Voice dialing i.e. hands free dialling in car

28

Data Acquisition Unit

The DAU consists of the following components: ATMEL 8952 microcontroller BLUE TOOTH MODULE

PCM codec
JAZZ multisensor

ALPHAUNUMERIC LCD display

LED indicators

ID CARD interface

29

30

Central System Unit components

CONNECTION MANAGER main task is to perform low-level blue tooth communication DATA ANALYSIS MODULE performs the analysis of the raw sensor data DATA LOGGER MODULE provides support for storing the monitored data. VISUALIZATION MODULE provides user interface for the supervisors

31

DAU - features
Lightweight
Runs on batteries - low power consumption

Easy to use - does not disturb the operator

working ID cards for operator authorization Voice transmission using hardware PCM codec

32

Csu features
Connection management Data processing
Central System Unit
Bluetooth
Connection Manager Data Analysis Visualization Module Data Logger

Data recording
Access verification System maintenance

33

Data security
Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions

Personal and physiological data encryption

34

APPLICATIONS:The first blue Eye enabled mass production device was POD, the car manufactured by TOYOTA

35

Contd.
IBM released robot named PONG equipped with BLUE EYES TECHNOLO GY

36

Also used in..

Retailing record and interpret customer movements Automobile industry Video games Create Face Responsive Display and Perceptive Environment Generic control rooms Power station Flight control centres Operating theatres

37

CONCLUSION
Provide more delicate and user friendly facilities in computing devices Gap between the electronic and physical world is reduced The computers can be run using implicit commands instead of the explicit commands

38

Thank u..

39