Patent attributes
A method for interfacing with an interactive program is provided. Images of an interface object and a motion controller disposed in a gameplay environment are captured, a tag defined on a surface of the interface object. The captured images are analyzed to identify the tag on the surface of the interface object. Movement of the interface object is tracked by tracking the tag. Augmented images are generated by replacing, in the captured images, the tag with a virtual object, wherein generating the augmented images includes processing the tracked movement of the interface object to define movement of the virtual object. The captured images are analyzed to identify a pointing direction of the motion controller in the gameplay environment. The pointing direction of the motion controller is processed to identify a selection of a portion of the virtual object. The augmented images are presented on a display.