US Patent 11282282 Virtual and physical reality integration

A system for providing a virtual reality experience obtains, from a first sensor, image data of a first subject upon entry to an area. The system obtains pose information for the first subject during a period in which the subject is within the area. A graphical asset is generated from the image data. A skeletal model is maintained based on the pose information. A virtual reality scene is generated, using the asset and skeletal model, from the perspective of a second subject.