US Patent 10176642 Systems and methods for computer assisted operation

An augmented reality method includes selecting an image of an object to be installed; converting the image into a 3D model; capturing a view of an environment and selecting a place to insert the 3D model; overlaying the 3D model with the view of the environment in a mashed-up and aligned manner wherein the 3D model view is displayed contemporaneously and contiguously to form an augmented reality view; and enabling user interaction with the displayed 3D model view to update the 3D model of the environment in the 3D modeling system.