VQV Signal

AI AT WORK WATCH TECHNICAL

Google's Streaming DiLoCo in MaxText cuts cross-site traffic in a Qwen3-32B training test

According to a post on X by @Chris40567043, a Google Developers Blog post describes Streaming DiLoCo, a method built natively into MaxText for training LLMs across data centers linked by low-bandwidth networks. In Google's Qwen3-32B test, cross-slice traffic fell from 4,258.8 GB to 67.0 GB. Step time stayed at 5.76 seconds on a 10 Gbit/s link, compared with 55.11 seconds for plain data parallel training.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-20T02:40:00+00:00 Detected 2026-11-20T10:01:24+00:00
View original source

According to a post on X by @Chris40567043, a Google Developers Blog post describes Streaming DiLoCo, a method built natively into MaxText for training LLMs across data centers linked by low-bandwidth networks. In Google's Qwen3-32B test, cross-slice traffic fell from 4,258.8 GB to 67.0 GB. Step time stayed at 5.76 seconds on a 10 Gbit/s link, compared with 55.11 seconds for plain data parallel training.

AI-assisted summary based on the listed source.

A Google Developers Blog post describes Streaming DiLoCo, built natively into MaxText, for training LLMs across data centers linked by low-bandwidth networks. In Google's Qwen3-32B test it cut cross-slice traffic from 4,258.8 GB to 67.0 GB and kept step time at 5.76 seconds on a 10 Gbit/s link, versus 55.11...

Teams that train large models across several sites with limited bandwidth could move far less data between them, based on this single test. The source snippet is cut off before its full explanation, so the wider scope and results on other models are not yet clear. Watch for additional benchmarks or independent tests before treating these results as a general pattern.

Teams using AI at work may want to compare this against current productivity and review workflows.

Signal Strength 78% Technical label WATCH Public Interest 26 Category AI AT WORK Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 28 Novelty Interest Score 70 Consequence Score 10 Curiosity Score 0 Shareability Score 46

VQV surfaced this signal because it is recent, relevant to Open Source LLMs, connected to Scobleizer News Pulse (X).