Crawl the way a search spider does
Visual SEO Studio spider explores web sites like a search engine bot would, showing in real-time the taken crawl paths.
Visual SEO Studio spider explores sites by following their internal links. Crawl order resembles what a web search engine crawler would do. The program fully respects the Robots Exclusions Protocol, and shows in real-time the crawl paths taken.
- Explores web sites like a search engine crawler
- Fine tune your crawl option if you need
- Crawl URL Lists for backlink profile auditing
- Crawl Ajax web sites out of the box
- You can crawl several sites in parallel
- and audit XML Sitemaps visiting their content
No registration required