US Patent 9928655 Predictive rendering of augmented reality content to overlay physical structures

Embodiments herein include an augmented reality (AR) system that predictively renders images which may reduce or remove lag. Instead of rendering images in response to sensing changes in the user orientation, the AR system generates predictive images by predicting future user orientations. The AR system can render multiple predictive images that each includes AR content that will be displayed at a future time. Because the predictive images are generated using different user orientations, the location of an object in the AR content in each of the predictive images is different. The predictive images are transmitted to the AR device which selects one of the images to display by comparing the orientations used to generate each of the predictive images with the current (actual) orientation of the user.