In one example, a device for coding video data includes a video coder configured to code motion information for a block of multiview video data, wherein the motion information includes a reference index that identifies a reference picture comprising a source for backward-warping view synthesis prediction (BVSP), perform BVSP on a portion of the reference picture to produce a BVSP reference block, and predict the block using the BVSP reference block.