US Patent 11544558 Continual learning of artificial intelligence systems based on bi-level optimization

A method of continual learning in an artificial intelligence system through bi-level optimization includes providing a stored data sample of a current task and providing a neural network subdivided into two parts including a parameter part and a hyper-parameter part. The method further includes performing bi-level optimization by separately training the two parts of the neural network. The neural network has been trained, prior to the bi-level optimization, on data samples of previous tasks.