VQV Signal

RESEARCH WATCH TECHNICAL

Bluejay benchmark finds voice agents less reliable when tasks are run repeatedly

According to a post on X by @cyrildelattre, a Bluejay benchmark tested six voice AI platforms on the same 90 phone tasks, running each task five times. LiveKit got 89% of calls right and was right all five times on 73% of tasks. Across all six platforms, the "right every time" rate ran 15 to 28 points below the "right once" rate. The provided snippet is cut off, so the full methodology and scoring are not shown here.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-10T05:35:00+00:00 Detected 2026-11-10T18:22:01+00:00
View original source

According to a post on X by @cyrildelattre, a Bluejay benchmark tested six voice AI platforms on the same 90 phone tasks, running each task five times. LiveKit got 89% of calls right and was right all five times on 73% of tasks. Across all six platforms, the "right every time" rate ran 15 to 28 points below the "right once" rate. The provided snippet is cut off, so the full methodology and scoring are not shown here.

AI-assisted summary based on the listed source.

Testing six voice AI platforms on the same 90 phone tasks five times each with Bluejay, LiveKit got 89% of calls right and was right all five times on 73% of tasks. Across all six, "right every time" ran 15 to 28 points below "right once." Why it matters: Businesses buying voice agents should judge them on...

The post says businesses buying voice agents should judge them on consistency rather than one good demo. Teams evaluating these tools should look at repeated-run results, since a single test can overstate reliability by the gap the benchmark reports. Watch for the full benchmark details on Bluejay's site to see how the tasks and scoring were set up.

Signal Strength 91% Technical label WATCH Public Interest 38 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 8 Novelty Interest Score 94 Consequence Score 34 Curiosity Score 84 Shareability Score 46

VQV surfaced this signal because it is recent, relevant to AI Voice, connected to Scobleizer News Pulse (X).