A device for decoding video data includes a memory configured to store video data, and at least one processor. The at least one processor may be configured to: determine luma residual samples for a block of video data, determine predictive chroma residual samples for the block of video data, scale the luma residual samples with a scale factor to produce scaled luma residual samples, and determine updated chroma residual samples based on the predictive chroma residual samples and the scaled luma residual samples.