OpenAI Blog · Jun 11, 2018
Improving language understanding with unsupervised learning
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Improving language understanding with unsupervised learning. We’ve obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we’re also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training. These results provide a convincing example that pairing supervised learning methods with unsupervised pre-training works very well; this is an idea that many have explored in the past, and we hope our result motivates further research into applying this idea… This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Improving language understanding with unsupervised learning' affects your current setup before relying on it in production.
ai