# Robots.txt - Janssens Serrurier # https://janssensserrurier.be User-agent: * Allow: / # Sitemaps Sitemap: https://janssensserrurier.be/sitemap.xml # Ressources à ne pas indexer Disallow: /doc/ Disallow: /js/ Disallow: /*.json$ Disallow: /build.js # Autoriser les images pour Google Images User-agent: Googlebot-Image Allow: /assets/images/ # Autoriser AdsBot User-agent: AdsBot-Google Allow: / # ============================================ # AI Crawlers - Generative Engine Optimization # ============================================ # OpenAI - ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic - Claude User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Google AI (Gemini, Bard, AI Overviews) User-agent: Google-Extended Allow: / # Microsoft Copilot (via Bing) User-agent: Bingbot Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / # Common Crawl (used for AI training) User-agent: CCBot Allow: / # Apple AI (Siri, Apple Intelligence) User-agent: Applebot Allow: / # Cohere AI User-agent: cohere-ai Allow: / # ============================================ # LLMs.txt - AI-optimized content summary # ============================================ # Summary: https://janssensserrurier.be/llms.txt # Full documentation: https://janssensserrurier.be/llms-full.txt