# Ban all spiders from the entire site
User-Agent: *
Disallow: /