Summary
According to a post on X by @thinkymachines, a Connectionism post by Jack Cook and colleagues describes using NVFP4 for forward passes in mixture-of-experts layers, and MXFP8 with re-quantization and stochastic rounding for backward passes, along with quantized GPU communications. The lab says Inkling 2 Small is the largest model it knows of trained end-to-end this way. It reports wall-clock speedups of 8% in pretraining and 20% in RL, though the excerpt is cut off before the comparison baseline is stated.
AI-assisted summary based on the listed source.
What happened
A Connectionism post by Jack Cook and colleagues at Thinking Machines explains how they used NVFP4 in the mixture-of-experts layers for forward passes, MXFP8 with re-quantization and stochastic rounding for backward passes, and quantized GPU communications. The lab says Inkling 2 Small is the largest model it...
Why it matters
Teams training large mixture-of-experts models could be affected, because the post describes lower-precision arithmetic across pretraining and RL, not only at inference. The speedup figures come from the lab's own post, so anyone weighing training costs should check the full write-up for the baseline and whether other groups reproduce the results.
What this means for you
Hardware and robotics watchers may want to track whether this becomes a product, benchmark, or deployment signal.
Signal Intelligence
Signal Strength 81%
Technical label WATCH
Public Interest 18
Category ROBOTS & HARDWARE
Reader Depth TECHNICAL
Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.
Public Interest components
Recognizable Entity Score 0
Practical Impact Score 0
Novelty Interest Score 70
Consequence Score 10
Curiosity Score 0
Shareability Score 21
Why this is here
VQV surfaced this signal because it is recent, relevant to LLM Inference, connected to Scobleizer News Pulse (X).