OpenAI Blog · May 5, 2020
AI and efficiency
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
AI and efficiency. We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less compute to train a neural network to the level of AlexNet (by contrast, Moore’s Law would yield an 11x cost improvement over this period). Our results suggest that for AI tasks with high levels of recent investment, algorithmic progress has yield… This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'AI and efficiency' affects your current setup before relying on it in production.
ai