Augmenting Information of Captured Image into the Real World

The system consist of android application and sixth sense technology com-ponents in order to meet the objective. The input to the database would be images and corresponding information. The image is captured by the camera of smart- phone having our android application. Face will be detected from the captured image and characteristics will be extracted by the Local Binary Pattern algorithm and matched with the database images. If the characteristics are matched then information of corresponding image will be passed to the projector. Sixth sense is wearable gesture interface that augments the physical world around us with digital information and lets us use natural hand gesture to interact with that information. Image will be recognized by the android application and related information would be displayed in real world where the hand gestures are locating. Hardware devices used in sixth sense technology are Camera, colored marker, mobile component, mirror and projector. Camera will capture the object in view and will track the users hand gestures. It will send the data to the smart phone. It acts as a digital eye, connecting user to the world of digital information. The mirror will be used to reflect the scene of the projector into real world. The smart phone will process the input data (eg. hand gestures, captured image recognition and matching). A projector displays data sent from smart phone on any surface directed by gestures object, wall etc. The projector faces downward and project output on the mirror so that we can adjust the focus and project on desired surface.