US Patent 10192360 Information processing apparatus and information processing method

By extracting figures of a play field and a display apparatus from a taken image, the positional coordinates of the play field and a screen in a world coordinate system are obtained. Next, a virtual world is built such that the ground of the virtual world is positioned continually flush with the surface of the play field in a real world, on the opposite side of the real world with the screen in between in a virtual space defined in the world coordinate system. Then, a virtual viewpoint is placed at a position corresponding to the viewpoint of a user in a real space so as to generate an image with the virtual world projected to the screen on the basis of this virtual viewpoint as a display image.