VQV Signal

ROBOTS & HARDWARE WATCH TECHNICAL

Together AI says its compiler delivers up to 2.7x more inference throughput on NVIDIA B200 and B300

According to a post on X by @togethercompute, Together says its Together Compiler beat the best InferenceX configurations on NVIDIA B200 and B300 GPUs at the same per-user speed. The company reports 2.7x higher throughput on Kimi K3, 1.8x on GLM-5.3 and DeepSeek V4.1 Flash, and 1.5x on MiniMax M3.1 Flash. These figures come from Together's own benchmarks, not independent testing.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-10T02:45:00+00:00 Detected 2026-11-10T18:23:44+00:00
View original source

According to a post on X by @togethercompute, Together says its Together Compiler beat the best InferenceX configurations on NVIDIA B200 and B300 GPUs at the same per-user speed. The company reports 2.7x higher throughput on Kimi K3, 1.8x on GLM-5.3 and DeepSeek V4.1 Flash, and 1.5x on MiniMax M3.1 Flash. These figures come from Together's own benchmarks, not independent testing.

AI-assisted summary based on the listed source.

Together says Together Compiler beat the best InferenceX configurations on NVIDIA B200 and B300 at the same per-user speed: 2.7x on Kimi K3, 1.8x on GLM-5.3 and DeepSeek V4.1 Flash, and 1.5x on MiniMax M3.1 Flash. These are Together's own benchmarks. Why it matters: More throughput per GPU can lower the price of...

If the gains hold up, more throughput per GPU could lower the cost of serving popular open models for builders and businesses running inference. Users of those models could also see better economics over time. Independent results and broader availability of the compiler are the next things to watch.

Hardware and robotics watchers may want to track whether this becomes a product, benchmark, or deployment signal.

Signal Strength 92% Technical label WATCH Public Interest 59 Category ROBOTS & HARDWARE Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 60 Practical Impact Score 56 Novelty Interest Score 94 Consequence Score 46 Curiosity Score 0 Shareability Score 68

VQV surfaced this signal because it is recent, relevant to AI Chips, connected to Scobleizer News Pulse (X).