A method, a video processing apparatus and computer-readable program medium for video process is disclosed. The method of video processing includes deriving, during a conversion between a current block of video and a bitstream representation of the current block, a new affine model using multiple original affine models with control point motion vectors; and performing the conversion by using the new affine model.