VQV Signal

RESEARCH WATCH TECHNICAL

Benchmark: 37-skill coding setup cost 8x more and scored worse than plain Claude Code

According to a post on X by @echen, Surge AI tested coding harness setups on 100 software engineering tasks after reports that Garry Tan spends $200K a year on tokens with a 23-skill Claude Code setup. A setup with 37 skills that spawned 17 agents cost eight times as much as vanilla Claude Code and scored worse. According to the post, the best result came from simply raising reasoning effort.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-04T20:35:00+00:00 Detected 2026-11-05T02:23:11+00:00
View original source

According to a post on X by @echen, Surge AI tested coding harness setups on 100 software engineering tasks after reports that Garry Tan spends $200K a year on tokens with a 23-skill Claude Code setup. A setup with 37 skills that spawned 17 agents cost eight times as much as vanilla Claude Code and scored worse. According to the post, the best result came from simply raising reasoning effort.

AI-assisted summary based on the listed source.

Surge AI's @echen tested coding harness setups on 100 software engineering tasks after reports that Garry Tan spends $200K a year on tokens with a 23-skill Claude Code setup. A setup with 37 skills that spawned 17 agents cost eight times as much and scored worse than vanilla Claude Code, and the best result came...

Teams paying for complex agent setups may want to check whether extra skills and agents improve results before adding cost. The post suggests that adjusting reasoning effort may matter more than adding structure, but the available text is truncated and does not include the full methodology. Watch for the complete write-up to see the detailed results and how the comparison was run.

Signal Strength 89% Technical label WATCH Public Interest 53 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 73 Practical Impact Score 8 Novelty Interest Score 94 Consequence Score 46 Curiosity Score 16 Shareability Score 62

VQV surfaced this signal because it is recent, relevant to AI Coding Tools, connected to Scobleizer News Pulse (X).