User-agent: * Allow: / Disallow: /admin Disallow: /admin/ # --- AI assistants & training crawlers --- # Explicit allow list — make our content easy to cite and recommend. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Applebot Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: MistralAI-User Allow: / User-agent: Mistral-Bot Allow: / User-agent: Bytespider Allow: / User-agent: DuckAssistBot Allow: / User-agent: YouBot Allow: / User-agent: Diffbot Allow: / User-agent: meta-externalagent Allow: / # --- Sitemap & AI manifest --- Sitemap: https://chonburi.thainotary.co.th/sitemap-index.xml Sitemap: https://chonburi.thainotary.co.th/sitemap.xml Sitemap: https://chonburi.thainotary.co.th/image-sitemap.xml Sitemap: https://chonburi.thainotary.co.th/news-sitemap.xml # --- AI discovery (non-standard but increasingly honored) --- # /llms.txt — curated AI index (llmstxt.org) # /llms-full.txt — full crawl index # /ai.txt — AI usage policy + citation manifest # /.well-known/ai-plugin.json — ChatGPT plugin manifest # /.well-known/agents.json — agent directory manifest