A light ray direction controlling device includes: a plurality of louver elements switching between a transparent state and a light absorption state in accordance with an applied voltage, and a plurality of polymer dispersed liquid crystal parts arranged along the primary surface of the substrate between the plurality of louver elements, respectively. The polymer dispersed liquid crystal parts each includes a solid polymer resin part and liquid crystal drops dispersed in the solid polymer resin part. The polymer dispersed liquid crystal parts each changes a degree of scattering of exiting light by changing a degree of scattering of incident light in accordance with an applied voltage.