User-Agent: * Disallow: /cgi-bin/ Disallow: /GIFS/ Disallow: /Scripts/ Disallow: /_private/ # don't allow that damn Internetseer and Linkwalker to see anything. User-agent: sitecheck.internetseer.com User-Agent: linkwalker Disallow: /