User-agent: * Allow: / # Block common scraper paths if any get added later Disallow: /api/ # AI crawlers — explicit allow (this is reference content, we want it indexed) User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://offlinesurvivalkit.com/sitemap-index.xml