US Patent 9918102 Inter-prediction candidate selection in a mode decision

An apparatus having a first circuit and a second circuit is disclosed. The first circuit may be configured to (i) fetch a plurality of reference samples from a memory to a plurality of slots in a buffer and (ii) motion estimate a plurality of current sample units of a current picture to generate a plurality of motion vectors. The motion vectors may be stored in a plurality of lines of a table. Each line generally identifies a corresponding slot in the buffer. Duplicates among the lines may be consolidated. The second circuit may be configured to evaluate the reference samples in the buffer based on the motion vectors to select a prediction sample unit.