VQV Signal

RESEARCH WATCH TECHNICAL

Naive RAG ranks first in six of seven long-conversation memory benchmark settings

According to a post on X by @SciFi, a paper by Zhengye Bao and co-authors compared Raw-RAG, a setup using simple dense retrieval and reranking over raw chat history, with agentic memory systems. The tests covered LoCoMo, LongMemEval, MEME and MemoryAgentBench. Raw-RAG ranked first in six of seven benchmark-model settings, by margins of 0.13 to 5.53 points, which the authors attribute mainly to raw history covering more of the evidence a model needs. The snippet is cut off before the full recommendation is stated.

Source: Scobleizer News Pulse (X) · x.com Found via Robert Scoble’s Scobleizer News Pulse · a post on X, not independently verified Published 2026-10-25T10:00:00+00:00 Detected 2026-10-25T13:28:30+00:00
View original source

According to a post on X by @SciFi, a paper by Zhengye Bao and co-authors compared Raw-RAG, a setup using simple dense retrieval and reranking over raw chat history, with agentic memory systems. The tests covered LoCoMo, LongMemEval, MEME and MemoryAgentBench. Raw-RAG ranked first in six of seven benchmark-model settings, by margins of 0.13 to 5.53 points, which the authors attribute mainly to raw history covering more of the evidence a model needs. The snippet is cut off before the full recommendation is stated.

AI-assisted summary based on the listed source.

Zhengye Bao and co-authors tested Raw-RAG, simple dense retrieval and reranking over raw chat history, against agentic memory systems on LoCoMo, LongMemEval, MEME and MemoryAgentBench. It ranked first in six of seven benchmark-model settings, by 0.13 to 5.53 points, mainly because raw history covers more of the...

The result suggests that more complex agentic memory does not always beat a simple retrieval baseline on long conversations. Teams building chat assistants or memory features may want to test naive RAG before adding more architecture. The authors argue it should be a required baseline, so watch whether other researchers reproduce these results on the same benchmarks.

Signal Strength 91% Technical label WATCH Public Interest 30 Category RESEARCH Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 94 Consequence Score 34 Curiosity Score 16 Shareability Score 45

VQV surfaced this signal because it is recent, relevant to AI Search, connected to Scobleizer News Pulse (X).