OpenAI Blog · May 16, 2018
AI and compute
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
AI and compute. We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction]. Since 2012, this metric has grown by more than 300,000x (a 2-year doubling period would yield only a 7x increase). Improvements in compute have been a key component of AI progress, so as long as this trend continues, it’s worth preparing for… This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'AI and compute' affects your current setup before relying on it in production.
ai