US Patent 9454733 Training a machine learning model

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a machine learning model. One of the methods includes receiving a complete set of training data; receiving instructions to train a predictive model having a plurality of parameters on an initial subset of the complete set of training data; training the predictive model on the initial subset; storing data representing a first state of the predictive model after training the predictive model on the initial subset; receiving updated parameter values and instructions to train the predictive model on a new subset of the complete set of training data; and training the predictive model on the new subset.