A CCD image sensor which is a solid-state imaging device has four kinds of pixels of first pixel to fourth pixel arranged in a predetermined pattern. The each pixel has each PD and each microlens. The first pixel and the fourth pixel are dedicated imaging pixels. The fourth pixel is placed adjacent to the second pixel and the third pixel which are pixels for phase difference detection, and its microlens is formed smaller than the microlens of the first pixel. Accordingly, since quantity of the light to be incident on the PD from the microlens is lowered corresponding to the incident light from the gap between the microlenses, light with approximately uniform quantity is incident on the each PD.