User-agent: * Allow: / Disallow: /api/ # AI crawlers - allow but slow them down a bit User-agent: GPTBot Allow: / Crawl-delay: 2 User-agent: ClaudeBot Allow: / Crawl-delay: 2 User-agent: PerplexityBot Allow: / Crawl-delay: 2 Sitemap: https://getpc.co.in/sitemap.xml