Patent attributes
An example method may include acquiring images from cameras, each having a known position and orientation with respect to a spatial coordinate system of an augmented reality (AR) device. The acquired images may include portions of a multi-modal marker device that includes at least one tracking sensor having a three-dimensional position that is detectable in a coordinate system of a tracking system. A three-dimensional position is estimated for the portions of the multi-modal marker device with respect to the spatial coordinate system of the AR device based on each of the respective acquired images and the known position and orientation of the cameras with respect to the spatial coordinate system of the AR device. The method also includes computing an affine transform configured to register the coordinate system of the tracking system with a visual space of a display that is in the spatial coordinate system of the AR device.