----Monitoring Human-Operator System
Priyanka Rao, 3rd CSE (521.rao@gmail.com)
S.Afshana parveen, 3rd ECE (afshana424@gmail.com)
JNTU COLLEGE OF ENGENEERING, PULIVENDULA
ABSTRACT:
Human cognition depends
primarily on the ability to perceive,
interpret, and integrate audio-visuals
and sensoring information. Adding
extraordinary perceptual abilities to
computers would enable computers to
work together with human beings as
intimate partners. Researchers are
attempting to add more capabilities to
computers that will allow them to
interact like humans, recognize human
presents, talk, listen, or even guess
their feelings.
The BLUE EYES technology
aims at creating computational
machines that have perceptual and
sensory ability like those of human
beings. It uses non-obtrusige sensing
method, employing most modern
video cameras and microphones to
identifies the users actions through the
use of imparted sensory abilities . The
machine can understand what a user
wants, where he is looking at, and
even realize his physical or emotional
states.
The basic idea behind this technology
is to give the computer the human
power. We all have some perceptual
abilities. That is we can understand
each others feelings. For example we
can understand ones emotional state
by analyzing his facial expression. If
we add these perceptual abilities of
human to computers would enable
computers to work together with
human beings as intimate partners.
The "BLUE EYES" technology aims at
creating computational machines that
have perceptual and sensory ability
like those of human beings

INTRODUCTION:
What is Blue Eyes?
BLUE EYES is a technology, which
aims at creating computational machines
that have perceptual and sensory abilities
like those of human beings. The basic
idea behind this technology is to give
computer human power. For example,
we can understand humans’ emotional
state by his facial expressions. If we add
these perceptual abilities to computers,
we would enable them to work together
with human beings as intimate partners.
It provides technical means for
monitoring and recording human-
operator’s physiological condition.
What is Blue Eyes not?
- Doesn’t predict nor interfere with
operator’s thoughts.
- Cannot force directly the operator to
work.
How was the term blue-eyes coined?
- Blue in this term stands for Bluetooth,
which enables reliable wireless
communication and the
Eyes because the eye movement enables
us to obtain a lot of interesting and
important information.
How are blue and eyes related?
- As the idea is to monitor and record
operator’s basic physiological
parameters, the most important
physiological activity is the movement
of eyes.
- For a computer to sense the eye
movement, wiring between operator and
the system is required. But, this is a
serious limitation of the operator’s
mobility and disables his operations in
large control rooms.
- So utilization of wireless technology
becomes essential which can be
implemented through blue tooth
technology.
Need for blue eyes?
- Is it necessary to make computer
function what a human brain does.Yes,
human error is still one of the most
frequent causes of catastrophes
(calamity) and ecological disasters,
because human contribution to the
overall performance of the system is left
unsupervised.
- The control instruments within the
machine have automated it to large
extent, thus Human operator becomes a
passive observer of the supervised
system, resulting in weariness and
vigilance drop, but the user needs to
active.
But Why?
Is it really needed that a human brain be
active?
- He may not notice important changes
of indications causing financial or
ecological consequences, which is a
threat to human life.
- Thus, it’s crucial that operator’s brain
is involved in an active system
supervising over the whole work time
period.
What can we do with blue eyes
technology?
- It has the ability to gather information
about you and interact with you through
special techniques like facial
recognition, speech recognition, etc.
- It can even understand your emotions
at the touch of the mouse.
- It can verify your identity, feel your
presence, and start interacting with you.
-The machine can understand what a
user wants, where he is looking at, and
even realize his physical or emotional
states.
- It realizes the urgency of the situation
through the mouse.
- For instance if you ask the computer to
dial to your friend at his office, it
understands the situation and establishes
a connection.
- It can reconstruct the course of
operator’s work.
Key features of the system:
- Visual attention monitoring (eye
motility analysis).
- Physiological condition monitoring
(pulse rate, blood oxygenation).
- Operator’s position detection
(standing, lying).
- Wireless data acquisition using
Bluetooth technology.
- Real-time user-defined alarm
triggering.
- Physiological data, operator's voice
and overall view of the control room
recording
recorded data playback.
How can we give computer the human
power?
- It uses non-obtrusive sensing method,
employing most modern video cameras
and microphones to identify the users’
actions through the use of imparted
sensory abilities.
- The blue eyes system checks the
physiological parameters like eye
movement, heart beat rate and blood
oxygenation against abnormal and
undesirable values and triggers user-
defined alarms when necessary.
- Blue eyes technology requires
designing a personal area network
linking all the operators and the
supervising system.
- As the operator using his sight and
hearing, senses the state of the controlled
system, the supervising system will look
after his physiological condition.
- The use of a miniature CMOS camera
integrated into the eye movement sensor
will enable the system to calculate the
point of gaze and observe what the
operator is actually looking at.
- Introducing voice recognition
algorithm will facilitate the
communication between the operator
and the central system and simplify
authorization process.
STRUCTURE:
Blue eyes system consists of a mobile TYPES OF USERS:
measuring device called Data Users belong to three categories:
Acquisition Unit (DAU) and a central • Operators
analytical system called Central System • Supervisors
Unit (CSU). • System administrators
Operator:
- Operator is a person whose
OVERALL SYSTEM physiological parameters are supervised.
- The operator wears the DAU.
DIAGRAM
- The only functions offers to the
operator are Authorization to the system
DATA ACQUISITION UNIT:
and receiving alarm alerts.
- It maintains Bluetooth connections.
- Authorization: Operator has to enter
- Gets information from the sensor.
his personal PIN into DAU, if PIN is
- Sends information over the wireless
accepted, authorization is said to be
connection.
complete.
- Delivers the alarm messages sent
- Receiving Alerts: This function
from the Central System Unit (CSU) to
supplies the operator with the most
the operator.
important alerts about his and his co-
- Handles personalized ID cards.
workers’ condition and mobile device
- Jazz Multisensor:
state.
• It’s an eye movement sensor, to
provide necessary physiological data in
Supervisor:
Data Acquisition Unit (DAU).
- He is the person responsible for
• It supplies raw digital data regarding
analyzing operators’ condition and
eye position, the level of blood
performance.
oxygenation acceleration along
- The supervisor receives tools for
horizontal and vertical axes and ambient
inspecting present values of the
light intensity.
parameters (on-line browsing) as well as
• Eye movement can be measured using
browsing the results of the long-term
direct infrared oculographic transducers.
analysis (off-line browsing).

JAZZ MULTISENSOR
CENTRAL SYSTEM UNIT:
- Maintains blue tooth connections in
the other side.
- Buffers incoming sensor data.
- Performs on-line data analysis.
- Records the conclusion for further
exploration.
- Provides visualization interface.
System Administrator:
- He is the user that maintains the
system.
- The administrator is delivered tools for
adding new operators to the database.
Defining alarm conditions.
- Configuring logging tools.
- Creating new analyzer modules.
ADMINISTRATIVE
APPLICATIONS:
Blue Eyes system can be applied in
every working environment requiring
permanent operator's attention.
- At power plant control rooms.
- At captain bridges.
- At flight control centers.
- Professional drivers.
CONCLUSION:
The wireless link between the
sensors worn by the operator and the
supervising system makes it possible to
improve overall reliability, safety and
assures proper quality of system
performance.
These new possibilities can cover areas
such as industry, transportation, military
command centers or operation theaters.
Researchers are attempting to add more
capabilities to computers that will allow
them to interact like humans, recognize
human presents, talk, listen, or even
guess their feelings.
It avoids potential threats resulting from
human errors, such as weariness,
oversight, tiredness.
REFERENCES:
www.encyclopidea.com
www.google.com