robots.txt Tools

Looking for a robots.txt editor, viewer, test tool...? Visual SEO Studio robots.txt gives you them all in one, in a full-fledged IDE experience.

Forget the limited tool provided by Google Webmaster Tool (which, by the way, since May 2012 dropped support for the robots.txt editor):
Visual SEO Studio sports a powerful viewer, tester and editor for robots.txt files.

robots.txt Tools - Visual SEO Studio

  • A full-featured viewer/editor with syntax highlighting
  • Drag'n'Drop path editing from a folder tree view
  • Cross search engine syntax checker and diagnostics
  • Multi-agent tester
  • Looks for Crawl-Delay presence (Google ignores it, but others don't and it is important to have it in place!)
  • BOM issues Diagnostics (your directives might be ignored even if the syntax is correct!)
  • and more...
  • Checks for Sitemaps list.
  • Correctly supports multi robots.txt per domain (every used sub-domain is supposed to have one!)
  • Reports robots.txt HTTP response code issues that might affect your indexing or crawl performance.

This feature is not ready for prime time and only partially published in the current version.

See also: