US Patent 11051010 Merge candidates with multiple hypothesis

A video decoder receives to-be-decoded data from a bitstream for a block of pixels to be decoded as a current block of a current picture of the video. The video decoder generates a first prediction of the current block based on a first prediction mode that is selected from a first candidate list. The video decoder generates a second prediction of the current block based on a second prediction mode that is selected from a second candidate list. The video decoder generates a combined prediction for the current block based on the first prediction and the second prediction. The video decoder reconstructs the current block by using the combined prediction.