Image sensors may include hybrid three-dimensional imaging pixel groups. The pixel groups may be capable of obtaining both phase detection information and time-of-flight information. A pixel group may have first and second photodiodes covered by a single microlens that are used to obtain phase detection information. The microlens may also cover a third photodiode that obtains time-of-flight information. The first and second photodiodes may be formed in a first substrate whereas the third photodiode may be formed in a second substrate. The first and second substrates may be connected by a metal interconnect layer.