Verified Websites

Some crawl options would break the code of conduct for polite bots (identify yourself, respect robots exclusion protocol, do not hog web server resources...).
Since it would be unethical using them on someone else's website without consent, they are available only for websites you can demonstrate to administer. Then you will be able to set options such as override the directives set in the robots.txt file, spoof the user-agent, and use more parallel threads to download the site resources.

To enable these options you just have to verify your site, it only takes a few clicks.
You can demonstrate to be a site administrator by using "Google Search Console" credentials, or a "Bing webmaster tools" API key, or using the native Visual SEO Studio verification.
For local development web servers running on localhost or 127.0.0.1 you are automatically considered an administrator and the options will always be enabled.

You can learn more about Verified Sites at the page Managing the Verified Sites list.

Site

Root address of the verified site.

Valid

A symbol to confirm or deny that the site were verified.

Verified With

The method used to verify the site ownership.

Valid until

Date when the verification will expire. Verifications are valid for one month, because site owners could withdraw their permission.

Notes

You can add an optional note for your convenience.

Edit Notes

Click on the symbol on this column to edit the Notes field.

Delete Row

Click on the symbol on this column to delete the row. You will be able to add it back by repeating the verification process.

Check using

Specify which verification method to be used to be recognized as a site owner.
Available options are:

• Google Search Console
  By logging-in via browser with your Google Search Console account and authorizing the program, you will add to the Verified websites list all websites GSC recognizes you administer.
• Bing webmaster tools
  By inserting a valid Bing webmaster tools "API key" you will add to the Verified websites list all websites BWT recognizes you administer.
• Visual SEO Studio verification
  You cannot use any of the previous two? May be your site is a pre-production staging server on your LAN, not exposed to the Internet? Then you can use the Visual SEO Studio verification.

You can learn more about Verified Sites at the page Managing the Verified Sites list.

Update list

After having set the correct parameters for the selected verification method, by clicking on the Update list button you will update the Verified Sites list with the websites your are recognized as administrator by the selected method.