Is a
Patent attributes
Patent Applicant
Current Assignee
Patent Jurisdiction
Patent Number
Patent Inventor Names
Satyen Chandrakant Kale
Sashank Jakkam Reddi
Sanjiv Kumar
Manzil Zaheer
Date of Patent
October 3, 2023
Patent Application Number
17014139
Date Filed
September 8, 2020
Patent Citations
Patent Primary Examiner
CPC Code
Patent abstract
Generally, the present disclosure is directed to systems and methods that perform adaptive optimization with improved convergence properties. The adaptive optimization techniques described herein are useful in various optimization scenarios, including, for example, training a machine-learned model such as, for example, a neural network. In particular, according to one aspect of the present disclosure, a system implementing the adaptive optimization technique can, over a plurality of iterations, employ an adaptive effective learning rate while also ensuring that the effective learning rate is non-increasing.
Timeline
No Timeline data yet.
Further Resources
No Further Resources data yet.