Kyle Rafferty

Biomedical Engineering
University of Rhode Island
 Developed by Pranav Mistry
 Research assistant/PhD candidate MIT
 Portable device that is worn around neck
 Consists of:
 Camera
 Colored Markers
 Projector
 *a smart phone
 Camera: tracks the movement of the colored
markers using movement algorithms.
 Colored Markers: Red, blue, green, and yellow
tape worn on the users fingertips for tracking
purposes.
 Projector: Projects stored data onto most any
surface.
 Smart phone: needed for internet connection
and computing power
 Recognizes hand movements
 Examples from online demonstrations:
 Make frame with hands: camera takes picture
 Google map onto wall
 Draw circle on wrist: projects digital clock
 Movement of text book/web info onto page
 Airline ticket updates
 Draw @ symbol: check email for you
 Many more capabilities (it’s on youtube or TED
website)
 Cost: ~300$
 Software will be open source
 Many possible medical applications using the
technology
 Surgical procedures (using tracking capabilities)
 Rehabilitation techniques
 Sources:
 “About (Pranav Mistry)” pranav::mistry. 2010. Apr 1 2010.
http://www.pranavmistry.com/
 Mistry, Pranav. “About (SixthSense)”. 2010. Apr 2, 2010.
http://www.pranavmistry.com/projects/sixthsense/
 “Pranav Mistry’s: The Thrilling Potential of SixthSense Computing-Future of Interface”.
Boxesandarrows. Feb 2010. Apr 1 2010.
http://www.boxesandarrows.com/idea/view/51321

 Publications:
 P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. To be appeared in
SIGGRAPH Asia 2009, Sketch. Yokohama, Japan. 2009
 P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. To be appeared in
SIGGRAPH Asia 2009, Emerging Technologies. Yokohama, Japan. 2009
 P. Mistry. The thrilling potential of SixthSense technology. TEDIndia 2009. Mysore, India
2009
 P. Mistry, P. Maes, L. Chang. WUW - Wear Ur World - A Wearable Gestural Interface. In
the CHI '09 extended abstracts on Human factors in computing systems. Boston, USA.
2009