Train looping reasoning models as step-by-step denoisers so more loops at test time help.
58.8%
ARC-AGI-1 test accuracy
Same 7M architecture as TRM, much higher score
How it works
Loops train poorly
Looped models backprop through only one or a few updates, so early steps never learn to help later ones.
Denoise, step by step
Each loop step denoises a noisy solution, with noise shrinking over steps and the same noise sample shared.
Better, scalable reasoning
Beats prior looped models on five of six benchmarks; finer time grids add compute, different noise gives varied answers.
What they found
Which comes out on top on ARC-AGI-1 pass@2?
More integration steps, better answers
try itDrag the number of inference steps up and watch accuracy change.
- Accuracy
- low
- here
- coarse, rough solve
Terms
6 termsLooped model Network reusing the same weights repeatedly to update a hidden state.'
Like restoring a photo through progressively clearer versions, each pass keeping notes for the next, instead of guessing the whole picture at once.
Limits
- Models are tiny (5–7M) and tested only on puzzle-style grid tasks.
- Sharing noise allows a shortcut the model could learn in theory.
- Needs extra regularization to avoid overfitting on Sudoku and ARC-AGI-2.