User-agent: * # L-8: this was a bare 'Disallow:' (allow everything), which explicitly invited # crawling of the admin, report and legal-archive trees. robots.txt is not an access # control - it is a request, and it is readable by anyone - so the entries below are # deliberately coarse. Anything that actually needs to stay private is gated in # Web.config, not here. Disallow: /Reports/ Disallow: /email-admin/ Disallow: /Experiments/ Disallow: /Dockets/ Disallow: /ai/ Disallow: /Logon.aspx Disallow: /AdminLogon.aspx Disallow: /ActivateToken.aspx Disallow: /UnsubscribeFromChannel.aspx User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / Sitemap: https://veamcast.com/sitemap.aspx