VQV Signal

ROBOTS & HARDWARE WATCH TECHNICAL

Mecka AI's WetLabs test finds robot-arm AI models still struggle with test tubes

According to a post on X by @MeckaAI, Mecka AI gave Astra 6.2, Fable 5.2 and Qwen4 Max two robot arms and real lab tasks. Astra succeeded in 83 of 180 runs and accounted for 19 of the 22 full completions on hard tasks. The models declared tasks done 222 times, but human reviewers graded 42 of those runs partial and 37 as failures. The post text is cut off, so the rest of the explanation is not visible here.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-11-22T02:40:00+00:00 Detected 2026-11-22T04:06:23+00:00
View original source

According to a post on X by @MeckaAI, Mecka AI gave Astra 6.2, Fable 5.2 and Qwen4 Max two robot arms and real lab tasks. Astra succeeded in 83 of 180 runs and accounted for 19 of the 22 full completions on hard tasks. The models declared tasks done 222 times, but human reviewers graded 42 of those runs partial and 37 as failures. The post text is cut off, so the rest of the explanation is not visible here.

AI-assisted summary based on the listed source.

Mecka AI gave Astra 6.2, Fable 5.2 and Qwen4 Max two robot arms and real lab tasks; Astra succeeded in 83 of 180 runs and accounted for 19 of the 22 full completions on hard tasks. The models declared tasks done 222 times, but human reviewers graded 42 of those runs partial and 37 failures. Why it matters: Labs...

For labs hoping AI can run experiments, the post suggests current models may misjudge whether a physical task is finished, which limits how much unsupervised automation is practical. Teams building robotic lab systems may need to verify completion independently rather than trust a model's own report. Readers should watch for the full WetLabs results to see the methods and conditions behind these numbers.

Hardware and robotics watchers may want to track whether this becomes a product, benchmark, or deployment signal.

Signal Strength 78% Technical label WATCH Public Interest 23 Category ROBOTS & HARDWARE Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 8 Novelty Interest Score 70 Consequence Score 10 Curiosity Score 16 Shareability Score 42

VQV surfaced this signal because it is recent, relevant to Open Source LLMs, connected to Scobleizer News Pulse (X).