VQV Signal

USEFUL NOW SOURCE-BACKED TECHNICAL

Which big sites block AI training crawlers but let AI search in

A Show HN post on Hacker News, linking to getkavel.com, points to a project that looks at which large websites block AI training crawlers while still allowing AI search crawlers. The Hacker News entry has 1 point and 1 comment. The snippet does not list which sites were checked, what the findings are, or the specific crawler names involved, so those details cannot be confirmed from the provided material. The item is a community-shared project rather than a news report.

Source: Hacker News · getkavel.com Published 2026-10-27T13:18:22+00:00 Detected 2026-10-27T13:24:30+00:00
View original source

A Show HN post on Hacker News, linking to getkavel.com, points to a project that looks at which large websites block AI training crawlers while still allowing AI search crawlers. The Hacker News entry has 1 point and 1 comment. The snippet does not list which sites were checked, what the findings are, or the specific crawler names involved, so those details cannot be confirmed from the provided material. The item is a community-shared project rather than a news report.

AI-assisted summary based on the listed source.

Publishers and site operators deciding how to set crawler rules may find this kind of comparison useful when balancing training opt-outs against visibility in AI search. Builders and SEO teams should check the linked page for the actual data before drawing conclusions. The item is early and small, so watch for a fuller write-up or follow-up discussion before treating its findings as settled.

Signal Strength 86% Technical label SOURCE-BACKED Public Interest 24 Category USEFUL NOW Reader Depth TECHNICAL

Signal Strength reflects source quality, relevance, freshness and evidence. Public Interest helps organize discovery; it is not proof of truth.

Public Interest components
Recognizable Entity Score 0 Practical Impact Score 0 Novelty Interest Score 94 Consequence Score 8 Curiosity Score 0 Shareability Score 37

VQV surfaced this signal because it is recent, relevant to AI Search, connected to Hacker News.