OpenAI Blog · Mar 7, 2018
Reptile: A scalable meta-learning algorithm
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Reptile: A scalable meta-learning algorithm. We’ve developed a simple meta-learning algorithm called Reptile which works by repeatedly sampling a task, performing stochastic gradient descent on it, and updating the initial parameters towards the final parameters learned on that task. Reptile is the application of the Shortest Descent algorithm to the meta-learning setting, and is mathematically similar to first-order MAML (which is a version of the well-known MAML algorithm) that only needs black-box access to an optimizer such as SGD or… This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Reptile: A scalable meta-learning algorithm' affects your current setup before relying on it in production.
phone