# # Robots.txt # Enables robots.txt rules for all crawlers User-agent: * # Rate limit Yahoo!, Bing and Yandex (Google ignores this) Crawl-delay: 5 # SilverStripe sitemap: Sitemap: https://www.clearwatercf.com/sitemap.xml Disallow: /admin/ Disallow: /Security/ Disallow: /sdotsform/ Disallow: /dev/ Disallow: /*?r=* Disallow: /search/