# A crawler follows only the most specific User-agent group that matches it, # so one group for everyone keeps the Disallow rules in force for Googlebot # and the rest. Do not add per-bot groups without repeating them. User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ # @astrojs/sitemap emits sitemap-index.xml (which points at sitemap-0.xml). # /sitemap.xml 301s here from nginx.conf. Sitemap: https://slideweave.com/sitemap-index.xml