VQV Signal

RESEARCH WATCH TECHNICAL

Dory1.0-4B: a looped model that varies compute by depth rather than longer reasoning

According to a post on X by @GonnabeNikhil, the Dory1.0-4B paper describes a 4B looped (latent-recurrent) model on a normalized-Transformer backbone. Its shared middle block can run a variable number of times, so one checkpoint can serve different compute budgets. The model was pre-trained on 6 trillion tokens, the first 4.5 trillion in NVFP4. The excerpt cuts off mid-sentence on the abstract's claims about two or more loops, so those results are not covered here.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-15T05:50:00+00:00 Detected 2026-11-15T18:22:30+00:00
View original source

According to a post on X by @GonnabeNikhil, the Dory1.0-4B paper describes a 4B looped (latent-recurrent) model on a normalized-Transformer backbone. Its shared middle block can run a variable number of times, so one checkpoint can serve different compute budgets. The model was pre-trained on 6 trillion tokens, the first 4.5 trillion in NVFP4. The excerpt cuts off mid-sentence on the abstract's claims about two or more loops, so those results are not covered here.

AI-assisted summary based on the listed source.

The Dory1.0-4B paper describes a 4B looped (latent-recurrent) model on a normalized-Transformer backbone whose shared middle block can be run a variable number of times, so one checkpoint serves different compute budgets; it was pre-trained on 6 trillion tokens, the first 4.5 trillion in NVFP4. The abstract says...

Teams that deploy language models care about how much compute each query uses, and a single checkpoint that supports several loop counts could mean fewer model variants to manage. The approach adds compute through depth rather than through longer reasoning chains. Readers should check the full paper for the loop-count results, since this post only gives the setup.

Signal Strength 88% Technical label WATCH Public Interest 30 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 94 Consequence Score 34 Curiosity Score 16 Shareability Score 45

VQV surfaced this signal because it is recent, relevant to AI Search, connected to Scobleizer News Pulse (X).