# Disallow all bots except Googlebot # set exclusion for InktomiSlurp -> damn bot only causes hits and traffic but doesn't do anything useful! ;-) User-agent: * User-agent: slurp Disallow: / # Allow Googlebot User-agent: Googlebot Allow: / Disallow: /_!_/ Disallow: /admin/ Disallow: /out/ Disallow: /ix/ Disallow: /download/ Disallow: /mailing/ Disallow: /statistik/