OpenAI Blog · Aug 18, 2017
OpenAI Baselines: ACKTR & A2C
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
OpenAI Baselines: ACKTR & A2C. We’re releasing two new OpenAI Baselines implementations: ACKTR and A2C. A2C is a synchronous, deterministic variant of Asynchronous Advantage Actor Critic (A3C) which we’ve found gives equal performance. ACKTR is a more sample-efficient reinforcement learning algorithm than TRPO and A2C, and requires only slightly more computation than A2C per update. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'OpenAI Baselines: ACKTR & A2C' affects your current setup before relying on it in production.
ai release