New Service Robot Controlled by Human Eye Which Allows Patients in Hospitals Self-Services Remotely

New service robot controlled by human eye which allows patients in hospitals self-service and speaks remotely. Patients' sight can be estimated with camera images which are mounted on their glass. Also, patients may control the service robot by using the estimated sight for choosing some functions in the menu (moving to anywhere they want, talking to the other persons, etc.). Three types of command (move forward, turn left, and turn right) are available for robot control. These commands can be selected by looking to the center, right and left directions. Patients can create sentences by choosing desired keys from the keyboard which is shown in their head mount display. By using text to speech function, they can talk with some other persons. On the other hand, the service robot has another camera at the tip of the robot for capturing the scenery. Between robot and user, they are separated by distance. The robot streams the scenery video and receives command sending by the patients as clients. The patients could control the robot remotely even in the long distance because user could see the scenery in the front of robot. The performance of the robot is evaluated for the routes including obstacles which are designated in the hospital. All the functions are confirmed together with moving performance.