|
|




  
 
 
 
|

5th semester
Computer engineering
  

° over millions of years to sense the world around us ,
and to perceive information we use our five natural senses
which includes eye, ear, nose, tongue, mind.

° But arguably the most useful information that

can help us make the right decision is not naturally
perceivable with our five senses, namely the data,
information and knowledge that mankind has to rely
everything on online.
° ÷he minimization of computing device allows
us to carry pockets computer always connected to
digital world.

° But it doesn¶t provide any physical link or any

interaction to digital world.

° Massachusetts Institute ÷echnology(MI÷ has

developed a group, which includes seven graduate
students, were thinking about how a person could be
more integrated into the world around them and access
information without having to do something like take
out a phone.
 G
 

° |ixth |ense bridges this gap, bringing intangible,
digital information out into the tangible world, and
allowing us to interact with this information via natural
hand gestures.

° Our ordinary computers will soon be able to sense

the different feelings accumulated in the surroundings
and it is all a gift of the ´|ixth |ense ÷echnology´ newly
introduced.
° |ixth |ense is a wearable gestural interface that
augments the physical world around us with digital
information. .

° ÷he digital world is shifted to physical world.

° It allows us to use natural hand gestures to interact

with that information½
 0

 
 


° èranav Mistry, 28 year old, of Indian origin is the
mastermind behind the sixth sense technology.

° He is a èhD student at MI÷ and he won the

µInvention of the Year 2009 µ- by èopular |cience.

° Currently working with one of the Mit professor to

implement the technology in normal human life.
 r

 

° ÷he prototype was built from an ordinary
webcam and a battery-powered projector, with an
attached mirror ² all connected to an internet-
enabled mobile phone.
° ÷he setup allows the user to project information
from the phone onto any surface ² walls, the body of
another person or even your hand.

° Mistry wore the device on a lanyard around his

neck, and colored Magic Marker caps on four fingers
(red, blue, green and yellow helped the camera
distinguish the four fingers and recognize his hand
gestures. .
 r



° camera

° projector

° Mirror

° Mobile component

° Colour markers
 r
 

° Captures an object in view and

tracks the users hand gestures using
computer-vision based techniques.

° It acts as a digital eye, connecting you to

the world of digital information½
 è
 

° ÷he projector projects visual information enabling
surfaces and physical objects to be used as interfaces.

° ÷he project itself contains a battery inside, with

3hours of battery life.

° A tiny LED projector displays data sent from the

smart phone on any surface in view±object, wall, or
person.
 0 
|

° ÷he usage of the mirror is significant as the
projector dangles pointing downwards from the neck.

° A Web-enabled smart phone in the user¶s pocket

processes the video data

° Other software searches the Web and interprets the

Hand-Gestures.
 r

 0
° It is at the tip of the user¶s fingers .

° Marking the user¶s fingers with red, yellow, green,

and blue tape helps the webcam recognize gestures.

° ÷he movements and arrangements of these makers

are interpreted into gestures that act as interaction
instructions for the projected application interfaces.
 
 
° It has a camera, a mirror and a projector and is
connected wirelessly to a bluetooth smart phone that
can slip comfortably into one¶s pocket.

° ÷he camera recognizes individuals, images,

pictures, gestures one makes with their hands
Information is sent to the |martphone for processing.

° ÷he downward-facing projector projects the

output image on to the mirror
Mirror reflects image on to the desired surface.
 ˜


° Gesture recognition is a topic in computer
science and language technology with the goal of
interpreting human gestures via mathematical
algorithms.
° Gestures can originate from any bodily
motion or state but commonly originate from the
face or hand.
°Current focuses in the field include emotion
recognition from the face and hand gesture recognition.
\Many approaches have been made using cameras and
computer vision algorithms to interpret sign language.
 Applications in normal life
° 0   
° You can use the |ixth |ense to
project a keypad onto your hand,
then use that virtual keypad to
make a call. Calling a number also
will not be a great task with the
introduction of |ixth |ense
÷echnology.

° No mobile device will be required, just type in the number

with your palm acting as the virtual keypad. ÷he keys will come
up on the fingers. ÷he fingers of the other hand will then be used
to key in the number and call.
 ° r   

° ÷he sixth sense also implements map which

lets the user display the map on any physical
surface and find his destination and he can use
his thumbs and index fingers to navigate the map,
for example, to zoom in and out and do other
controls.

° r



° |ixth |ense all we have to do is draw a

circle on our wrist with our index finger to get
a virtual watch that gives us the correct time.
÷he computer tracks the red marker cap or
piece of tape, recognizes the gesture, and
instructs the projector to flash the image of a
watch onto his wrist.
° i

  
° ÷he |ixth|ense system also augments physical objects the user is interacting
with by projecting more information about these objects projected on them. For
example, a newspaper can show live video news or dynamic information can be
provided on a regular piece of paper. ÷hus a piece of paper turns into a video
display.

° Î

  
Î




° ÷he user can zoom in or zoom

out using their hand movements½
 ° We can get information about
flight status whether it¶s delayed or
cancelled.

° We can rate the books and can

know information about author and
stories.
 Advantages
° èortable

° Inexpensive

° Multi-sensory

° Any time accessibility

 Disadvantages
° Every mobile doesn¶t support external camera
feed in real time o.s.

° Hardware is to be carried out everywhere.

° Battery life is of just 3hrs.

° Live video streaming cannot be done.

 Future research

° Interactive advertisements.

° 3d visualizations

° 3d gaming

° Camera can act as third eye of blind

person.
 jeferances
°http://www.pranavmistry.com/projects/sixthsense/

°http://en.wikipedia.org/wiki/|ixth|ense

°http://theviewspaper.net/sixth-sense-technology-will-revolutionize-the-
world/

°http://mobilebeyond.net/sixt-sense-technology-mobile-augmented-
reality/#axzz13aèzCIqq

°http://gizmodo.com/5167790/sixth-sense-technology-may-change-how-
we-look-at-the-world-forever