OpenAI Blog · Jan 25, 2021
Scaling Kubernetes to 7,500 nodes
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Scaling Kubernetes to 7,500 nodes. We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Scaling Kubernetes to 7,500 nodes' affects your current setup before relying on it in production.