Configure which paths search engine bots may or may not crawl on your site.
Add sitemap references and custom disallow rules in seconds.
Download-ready robots.txt output for webmasters and SEO specialists.