GESTURE CONTROLLED ROBOTIC ARM USING QUERY STRINGS

HMI (Human Machine Interface) is defined as a medium for information exchange and mutual communication between electromechanical system and the user. There have been multiple attempts in the past to try and control a robotic arm or even an entire robot using speech, hand gestures, keyboard input or joystick commands, etc. One particular area with a very promising future that caught our attention was using the revolutionary Microsoft Kinect to wirelessly manipulate a single robotic arm. We use Kinect camera to recognize the gestures and send the data wirelessly using esp8266 with the internet as the medium which in the end controls the robotic arm. Here we propound a novel approach to achieve the wireless communication using query strings and manipulate the robotic arm using microcontroller. Our system can sense gestures from whole body movement and translate it to mechanical motion in the self-developed robotic arm. It also has the capability of handling gesture which requires a wide scope of recognition.