VQV Signal

RESEARCH WATCH TECHNICAL

Kyutai says a single random logit bias can match Neural Thickets gains

According to a post on X by @kyutai_labs, the lab's new paper proposes a simpler alternative to Neural Thickets. Neural Thickets perturbs every weight of a language model, keeps the best-scoring copies and has them vote. The paper reports that adding a single random bias to the output logits, with all other weights unchanged, matches or beats those gains on a diverse set of tasks. The snippet does not name the benchmarks, scores or model sizes.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-10-31T00:37:00+00:00 Detected 2026-10-31T09:32:02+00:00
View original source

According to a post on X by @kyutai_labs, the lab's new paper proposes a simpler alternative to Neural Thickets. Neural Thickets perturbs every weight of a language model, keeps the best-scoring copies and has them vote. The paper reports that adding a single random bias to the output logits, with all other weights unchanged, matches or beats those gains on a diverse set of tasks. The snippet does not name the benchmarks, scores or model sizes.

AI-assisted summary based on the listed source.

Neural Thickets perturbs every weight of a language model, keeps the best-scoring copies and has them vote. Kyutai's new paper shows that a single random bias on the output logits, with all other weights unchanged, matches or beats those gains on a diverse set of tasks. Also:...

If the result holds across the tested tasks, it suggests a much smaller change to a model can recover gains that previously required perturbing every weight and running votes. Researchers and teams working on model tuning would be most affected, since it points to a potentially cheaper approach. Readers should look for the full paper and its task results to judge how broadly the comparison applies.

Signal Strength 88% Technical label WATCH Public Interest 28 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 94 Consequence Score 30 Curiosity Score 0 Shareability Score 45

VQV surfaced this signal because it is recent, relevant to AI Chips, connected to Scobleizer News Pulse (X).