Papers
arxiv:2610.20951

LEV: Thinking Fast and Deep with Looped Decision Models

Published on Oct 14
ยท Submitted by
Dingjie Song
on Oct 19
Authors:
,
,

Abstract

LEV is a looped decision model that increases reasoning depth by iterating its layers without generating tokens, improving accuracy on hard questions while allowing adaptive computation via a stopper.

Decision models answer typed questions about an input with one probability per option, computed in a single forward pass without generating text. Like the fast System 1 of dual-process theory, they answer at once, but their depth is fixed at training time, so they spend the same computation on easy and hard questions. Models that reason in generated text can think longer, but they pay for every extra step in decoded tokens. We present LEV, a decision model that thinks deeper by rerunning its layers in a loop instead of generating tokens. LEV builds on a language model pretrained as a loop, reads the options after every loop step and trains all steps jointly, so one checkpoint can answer at any depth. On three looped backbones, accuracy rises with depth on the same weights, mostly on hard questions, and a 2.6B LEV goes from 63.2% at depth one to 76.2% at depth four on JevBench. On-demand depth, set per question by a small stopper with a threshold fitted on unlabelled requests, saves 15% to 24% of the computation at a cost of under one accuracy point, level with or slightly above a fixed mix of depths. On a locked test set, the 1.4B and 3B models are 5.4 to 8.8 points more accurate than dense (non-looped) models and cascades of the same latency below 50 ms.

Community

Paper author Paper submitter

Can a decision model think longer without writing a longer answer?

Lev is a System 1.5 decision model: it reruns a looped backbone and scores the options after every loop, without decoding a chain of thought, so one checkpoint answers at any depth. On JevBench's 231 public items, the same Lev-2.6B goes from 63.2% at one loop to 76.2% at four (+13.0 pp), mostly on standard and hard questions.

A small stopper fitted on unlabelled requests saves 15-24% of loop computation for 0.3-0.8 pp (offline analysis). On our locked test, this adaptive gain holds for 1.4B and 3B, not for 2.6B.

๐Ÿ“„ Paper: https://arxiv.org/abs/2610.20951
๐ŸŒ Project: https://openlair.github.io/lev/
๐Ÿ’ป Code: https://github.com/OpenLAIR/lev
๐Ÿค— Models & data: https://huggingface.co/collections/songdj/lev

The video replays recorded readouts from our runs: an easy question stops after one loop; a hard one changes its answer from 4 to the correct 6 by loop four.

This is an automated message from the ResearchStudio team.

We created an interactive ResearchStudio Reel for this paper. It includes a visual poster, a video, and a blog, all available for download in editable formats.

Visual poster for this paper

Open the ResearchStudio Reel โ†’

Download all files from Hugging Face

Please give this comment a thumbs up if you find the Reel helpful!

Want to explore or create Reels for more papers? Visit the ResearchStudio demo.

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.20951
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 3

Datasets citing this paper 3

Spaces citing this paper 2

Collections including this paper 2