US Patent 10565731 Pose tracking system with multi device shared scene map

A virtual environment or mixed reality environment system including a headset device and controller. Both the headset device and the controller are configured to access and update a shared scene map. In some cases, the headset device may implement pose tracking with respect to the headset device and the controller and the controller may also implement pose tracking with respect to the headset device and the controller.