An image processing apparatus for controlling a display apparatus including a luminance modulation element and a color modulation element that are configured using different modulation elements, includes: a control value determination unit that determines, based on an input target color value, using a plurality of color conversion matrixes that describe a relationship between the target color value and a control value for the color modulation element for each control value for the luminance modulation element, the control value for the color modulation element; and a correction unit that non-linearly corrects the control value for the color modulation element according to a characteristic of the color modulation element.