VQV Signal

CREATOR TOOLS WATCH GENERAL

RespSurvBench: best AI agent scores 25.5% on respiratory-virus surveillance tasks

According to a post on X by @kenbwork, Kenny Workman and Latch Bio collaborators introduced BioSecBench-RespiratoryVirus-Surveillance, called RespSurvBench. It contains 110 graded decisions across diagnostic assays, pathogen discovery, viral evolution and transmission, and population surveillance. Across 21 models and 34 model-harness setups, the best pass rate was 25.5%, achieved by Claude Opus 5.5 on Pi. The snippet is cut off before the remaining results are shown.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-05T19:35:00+00:00 Detected 2026-11-06T02:27:25+00:00
View original source

According to a post on X by @kenbwork, Kenny Workman and Latch Bio collaborators introduced BioSecBench-RespiratoryVirus-Surveillance, called RespSurvBench. It contains 110 graded decisions across diagnostic assays, pathogen discovery, viral evolution and transmission, and population surveillance. Across 21 models and 34 model-harness setups, the best pass rate was 25.5%, achieved by Claude Opus 5.5 on Pi. The snippet is cut off before the remaining results are shown.

AI-assisted summary based on the listed source.

Kenny Workman and Latch Bio collaborators introduced BioSecBench-RespiratoryVirus-Surveillance (RespSurvBench): 110 graded decisions across diagnostic assays, pathogen discovery, viral evolution/transmission, and population surveillance. Across 21 models and 34 model–harness setups, the best pass rate was 25.5%...

The reported scores suggest that current AI agents still struggle with these respiratory-virus surveillance decisions. Teams building AI tools for public health or biosecurity work may want to review the full benchmark before relying on agents for similar tasks. The complete methodology and results were not visible in the source snippet, so the details should be checked directly.

Signal Strength 78% Technical label WATCH Public Interest 24 Category CREATOR TOOLS Reader Depth GENERAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 70 Consequence Score 26 Curiosity Score 16 Shareability Score 41

VQV surfaced this signal because it is recent, relevant to AI Search, connected to Scobleizer News Pulse (X).