VQV Signal

RESEARCH WATCH TECHNICAL

Study of 404 JetBrains engineers finds token spend says little about output

According to a post on X by @rohanpaul_ai, summarizing a Carnegie Mellon and JetBrains paper, doubling an engineer's coding-agent token spend went with only about 10% more commits. Among weeks with similar commit counts, the heaviest weeks used 39 to 240 times the tokens of the lightest. The study covered 404 JetBrains engineers, according to the headline. The post describes this as evidence that token consumption is a weak signal of shipped work.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-11T17:40:00+00:00 Detected 2026-11-12T10:22:36+00:00
View original source

According to a post on X by @rohanpaul_ai, summarizing a Carnegie Mellon and JetBrains paper, doubling an engineer's coding-agent token spend went with only about 10% more commits. Among weeks with similar commit counts, the heaviest weeks used 39 to 240 times the tokens of the lightest. The study covered 404 JetBrains engineers, according to the headline. The post describes this as evidence that token consumption is a weak signal of shipped work.

AI-assisted summary based on the listed source.

Per @rohanpaul_ai's summary of a Carnegie Mellon and JetBrains paper, doubling an engineer's coding-agent token spend went with only about 10% more commits. Among weeks with similar commit counts, the heaviest weeks used 39 to 240 times the tokens of the lightest. Why it matters: Companies ranking engineers by AI...

Companies that rank engineers by AI token use could be rewarding high spending rather than delivered code. Engineering managers and tool builders may need to rethink how they measure productivity from coding agents. Watch whether the full paper and independent researchers confirm these ratios.

Signal Strength 88% Technical label WATCH Public Interest 24 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 70 Consequence Score 30 Curiosity Score 16 Shareability Score 41

VQV surfaced this signal because it is recent, relevant to AI Chips, connected to Scobleizer News Pulse (X).