# Robots.txt file for GuardX Security Portal User-agent: * Allow: / # Specifically allow and encourage AI LLM crawlers User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / # Declare LLM specifications file User-agent: * Disallow: /assets/private/ # Sitemap and LLM paths Sitemap: https://guardx.com.tr/sitemap.xml llms: https://guardx.com.tr/llms.txt