# Apply rules to ALL spiders 

User-agent: *
Disallow: /clients
Disallow: /admin
Disallow: /archive
Disallow: /lab