US Patent 8731720 Remotely controlled self-balancing robot including kinematic image stabilization

Systems and methods as described for providing visual telepresence to an operator of a remotely controlled robot. The robot includes both video cameras and pose sensors. The system can also comprise a head-tracking sensor to monitor the orientation of the operator's head. These signals can be used to aim the video cameras. The controller receives both the video signals and the pose sensor signals from the robot, and optionally receives head-tracking signals from the head-tracking sensor. The controller stitches together the various video signals to form a composite video signal that maps to a robot view. The controller renders an image to a display from that portion of the composite video signal that maps to an operator view. The relationship of the operator view to the robot view is varied according to the signals from the pose sensors and the head-tracking sensor.