# Hope & Anchor — robots.txt (served on prod: hopeandanchor.info) # Humans and search engines get full access. The versioned read-only public API # is explicitly crawlable; private/internal API routes and staff docs are not. # # AI usage policy via Content-Signal (content-signals.org): search indexing and # AI *citation/grounding* (ai-input) are permitted; AI *training* (ai-train) is # reserved. Live "answer the user's question" assistants — OAI-SearchBot, # ChatGPT-User, PerplexityBot, Perplexity-User, Claude-User, Claude-SearchBot — # are intentionally NOT listed below, so they match this group and stay allowed. # Google-Extended and Applebot-Extended are likewise allowed: they are # citation-OR-nothing controls, so we permit them to keep Gemini / Apple- # Intelligence *citation* (accepting those operators may also train on content). User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Allow: /api/v1/ Disallow: /api/ Disallow: /docs/ # Bulk AI training / scraping crawlers — disallowed site-wide. User-agent: GPTBot User-agent: CCBot User-agent: ClaudeBot User-agent: Bytespider User-agent: Amazonbot User-agent: meta-externalagent Disallow: / Sitemap: https://hopeandanchor.info/sitemap.xml