Prnanav mistry sixth sense device (with video)

                            Sixth sense and Its uses

Sixthsense is a wearable gestural interface device developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It is similar to Telepointer, a neckworn projector/camera system developed by Media Lab student Steve Mann[1] (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense").[2]

Construction and workings:- 

The SixthSense prototype comprises a pocket projector, a mirror and a camera contained in a pendant like, wearable device. Both the projector and the camera are connected to a mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques.[3] The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tips of the user’s fingers. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected 
application interfaces. SixthSense supports multi-touch and multi-user interaction.

Example applications:- 

The SixthSense prototype contains a number of demonstration applications.

The map application lets the user navigate a map displayed on a nearby surface using hand gestures to zoom and pan 

The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger.

SixthSense also implements Augmented reality; projecting information onto objects the user interacts with.

 The system recognizes a user's freehand gestures as well as icons/symbols drawn in the air with the index finger, for example:

 A 'framing' gesture takes a picture of the scene. The user can stop by any surface or wall and flick through the photos he/she has taken.

Drawing a magnifying glass symbol takes the user to the map application while an ‘@’ symbol lets the user check his mail.

The gesture of drawing a circle on the user’s wrist projects an analog watch.