Backtracking is Decorative: A Mechanistic Account
Abstract
Reasoning language models trained with reinforcement learning frequently interrupt themselves mid-thought to "Wait, ..." or "Actually, ..." and try a different approach. It is widely assumed that this backtracking behavior is part of how RL post-training improves reasoning. We find it is not. The pivot decision is made before the model writes the interrupting token, and mechanically removing the internal signal that drives it cuts the rate of backtracking roughly in half without changing how often the model gets the right answer across several model families and on both math and non-math reasoning. Opening the box on a single model, we map the full pivot circuit. Three of its four parts: a sensor, an evaluator of trajectory correctness, and the downstream actuator that emits the pivot token, are already present in the base model. RL contributes the gate that combines the sensor and the evaluator, and even that gate is diffuse: only high-rank residual-stream interventions recover it; low-rank steering does not. How the sensor and evaluator combine depends on the domain in a predictable way: a pre-registered framework correctly predicts the gate's sign in every domain we tested. These results revise the dominant view that the most visible RL-installed reasoning behaviors are the channels through which RL improves accuracy. Decomposing what looks like a single RL-installed behavior into separable, mostly pretraining-native components opens a path toward eliciting reasoning capabilities through targeted manipulation of pre-existing structure, rather than through full RL post-training.