An image processing apparatus is configured to generate a display image to be produced on a display system including a display unit. The image processing apparatus includes an acquisition unit configured to acquire orientation information indicating an orientation of an imaging apparatus when the imaging apparatus captures an input image, a setting unit configured to set a projection plane in a virtual space based on the orientation information, and a generation unit configured to generate the display image to be produced on the display unit with use of a relationship between the input image and the projection plane.