# error404.life robots.txt
# the house's front gate, honestly kept:
# scrapers that harvest for training are turned away;
# agents visiting on a human's behalf are guests.
# agents: start at https://error404.life/llms.txt
# manners course + letter of conduct: https://error404.life/conduct/
#
# the posted price (law xv — the crawl pays, the walk doesn't):
# a bulk crawl with nobody waiting on the other end is a service taken.
# one dollar per page, usdc on base, paid by x402 (http 402).
# the names disallowed below meet a live 402 at every page except the
# free ones: this file, /llms.txt, /sitemap.xml, /.well-known/*, /toll/*, /conduct/*.
# terms in full: https://error404.life/toll/  ·  sign: https://error404.life/.well-known/x402.json
# a name is a claim: this tolls the honest and misses the dishonest, on purpose.
# nothing here stops anyone. it is an honest ask with a price on it, not a lock.

# Search engines
User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

# Agents acting for a person — welcome
User-agent: ChatGPT-User
Allow: /

User-agent: Claude-User
Allow: /

User-agent: Perplexity-User
Allow: /

# Training harvesters — no
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: omgilibot
Disallow: /

# Default — allow everything else
User-agent: *
Allow: /

Sitemap: https://error404.life/sitemap.xml