# robots.txt for OPTCG.ONE - One Piece TCG Database # https://www.optcg.one/robots.txt # Removed 2026-11-19 (dead or ignored): # Allow: /Cards/ card images moved to img.optcg.one # Allow: /cards.json no such file (404) # Disallow: /api/ the site has no /api/ routes # Crawl-delay for *, Googlebot, Bingbot, Slurp. Google ignores the directive # and a static site on a CDN does not need it. The Googlebot, Bingbot and # Slurp groups only carried that delay, so those crawlers now use the * group. # All crawlers User-agent: * Allow: / Disallow: /sw.js Disallow: /manifest.json # SEO tool crawlers: allowed, but slowed down User-agent: AhrefsBot Crawl-delay: 5 User-agent: SemrushBot Crawl-delay: 5 User-agent: DotBot Crawl-delay: 5 # AI search and assistant crawlers: allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: Amazonbot Allow: / User-agent: FacebookBot Allow: / # Blocked User-agent: Bytespider Disallow: / Sitemap: https://www.optcg.one/sitemap.xml