# Block site-sucker User-agent: wget Disallow: / # Allow search robots to crawl the site => 4 GOOGLE & Co User-agent: * Disallow: # if you want 2 hide certain stuff uncomment and add dir(s) or ask jules #User-agent: * #Disallow: /stuff/