# robots.txt - UTF-8 BOM, CRLF line endings and trailing whitespace User-agent: * Disallow: /admin/ Allow: /admin/public/ Disallow: /*.bak$ Sitemap: https://www.example.com/sitemap-index.xml