# Content Signals for AI and LLM agents Content-Signal: search=yes, ai-train=no, ai-input=yes User-agent: * Content-Signal: search=yes, ai-train=no, ai-input=yes Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /.well-known/ Allow: /manifest.json Allow: /about Allow: /services Allow: /contact Allow: /contact-us Allow: /team Allow: /terms Allow: /privacy # Sitemap location Sitemap: https://kripainsulation.in/sitemap.xml # Crawl-delay for all bots Crawl-delay: 1 # Specific directives for major search engines User-agent: Googlebot Allow: / Crawl-delay: 0.5 User-agent: Bingbot Allow: / Crawl-delay: 0.5 User-agent: Slurp Allow: / Crawl-delay: 1 User-agent: DuckDuckBot Allow: / Crawl-delay: 1 User-agent: Baiduspider Allow: / Crawl-delay: 1 # Disallow sensitive internal paths only Disallow: /admin/ Disallow: /private/ Disallow: /_next/ Disallow: /api/send-email # Image crawling User-agent: Googlebot-Image Allow: /img/ Allow: /assets/ # Mobile crawling User-agent: Googlebot-Mobile Allow: / Crawl-delay: 0.5