Control of the endoscope in a surgical system is described. In some embodiments, the endoscope can be controlled by movement of the surgeon's head or face at a surgeon's console. In some embodiments, the endoscope can be controlled using sensors integrated with a surgeon's headrest mounted on the surgeon's console.