OpenAI Blog · Jun 23, 2022
Learning to play Minecraft with Video PreTraining
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Learning to play Minecraft with Video PreTraining. We trained a neural network to play Minecraft by Video PreTraining (VPT) on a massive unlabeled video dataset of human Minecraft play, while using only a small amount of labeled contractor data. With fine-tuning, our model can learn to craft diamond tools, a task that usually takes proficient humans over 20 minutes (24,000 actions). Our model uses the native human interface of keypresses and mouse movements, making it quite general, and represents a step towards general computer-using agents. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Learning to play Minecraft with Video PreTraining' affects your current setup before relying on it in production.
ai