A method of video processing includes: deriving, from a set of neighboring blocks, a motion prediction of a current block which can be split into multiple sub-blocks; and performing a conversion between the current block and a bitstream representation of the current block using the derived motion prediction, the motion prediction being applied to the current block on a basis of a block level instead of on a sub-block level.