A quick way to prevent robots scanning the website.

A quick way to prevent robots scanning the website. The below command will stop Search Engines from crawling your website. Add this to your robots.txt file.

User-agent: *
Disallow: /
Category: