User-agent: Slurp
Crawl-delay: 30

User-agent: msnbot
Crawl-delay: 30

# Ganze Site für alle Robots sperren
User-agent: *
Disallow: /