US Patent 11202065 Extended merge prediction

A video coding or decoding method includes using history-based motion vector prediction (HMVP) for conversion between multiple video blocks including a current block of video and a bitstream representation of the multiple video blocks such that for a uni-predicted block that for which a single reference picture is used for motion compensation, refraining from updating a look-up table for HMVP candidates for the uni-predicted block. The video coding or decoding method further includes performing the conversion using look-up tables for the multiple video blocks.