A method of encoding or decoding video includes: dividing a current video block into multiple sub-blocks video blocks; generating a merge candidate list for at least one sub-blocks video blocks of the multiple sub-blocks video blocks; and performing a conversion between the video block and a bitstream of the video block based one the merge candidate list; wherein the merge candidate list comprises at least one merge candidate with multi-hypothesis mode.