# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Disallow: /admin Disallow: /dashboard Disallow: /users Disallow: /webhooks Disallow: /mission_control Disallow: /up Allow: / Sitemap: https://shipfeed.dev/sitemap.xml