Escaping the Cognitive Well: Efficient Competition Math with Off-the-Shelf Models
Abstract
In the past year, custom and unreleased math reasoning models reached gold medal performance on the International Mathematical Olympiad (IMO). Similar performance was then reported using large-scale inference on publicly available models but at prohibitive costs (e.g., 3000 USD per problem). In this work, we present an inference pipeline that attains best-in-class performance on IMO-style math problems at an average inference cost orders of magnitude below competing methods while using only general-purpose off-the-shelf models. Our method relies on insights about grader failure in solver-grader pipelines, which we call the Cognitive Well (iterative refinement converging to a wrong solution that the solver as well as the pipeline's internal grader consider to be basically correct). Our pipeline addresses these failure modes through \emph{conjecture extraction}, wherein candidate lemmas are isolated from generated solutions and independently verified alongside their negations in a fresh environment (context detachment). On IMO-ProofBench Advanced (PB-Adv), our pipeline achieves 87.6% performance using Gemini 3.1 Pro with an average cost per question of ~9 USD. This surpasses the performance of the DeepThink IMO gold-winning model, and more than triples the success rate of the next best publicly accessible pipeline operating at affordable cost.