Patent attributes
In an example in accordance with the present disclosure, an extended reality system is described. The extended reality system includes an imaging system to present virtual objects to a user. The extended reality system also includes a machine vision tracking system. The machine vision tracking system includes a camera to capture images of a user's hand a tool grasped in the user's hand. The machine vision tracking system also includes a processor. The processor 1) tracks a position and orientation of the user's hand in physical space, 2) identifies the tool grasped in the user's hand, and 3) tracks a position and orientation of the tool in physical space. The extended reality system also includes an XR controller to manipulate the XR environment based on the position and orientation of the tool and the position and orientation of the hand.
