OpenAI Blog · Oct 29, 2021
Solving math word problems
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Solving math word problems. We’ve trained a system that solves grade school math problems with nearly twice the accuracy of a fine-tuned GPT-3 model. It solves about 90% as many problems as real kids: a small sample of 9-12 year olds scored 60% on a test from our dataset, while our system scored 55% on those same problems. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Solving math word problems' affects your current setup before relying on it in production.
ai