# CigarCabinet — robots.txt # Standard crawlers and AI search/assistant crawlers are welcome. # The app's authenticated views require sign-in and hold no crawlable content. User-agent: * Allow: / # The API is not content and is not for crawling. Every endpoint under /api/ now # requires a signed-in session, so this blocks nothing a crawler could reach # anyway — it states the intent, which is what a well-behaved bot honours and # what a terms-of-service claim later rests on. Disallow: /api/ # --- AI search & assistant crawlers (explicit allow so they can cite us) --- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / Sitemap: https://cigarcabinet.app/sitemap.xml