User-Agent: *
Allow: /

User-Agent: Nutch-1.0-dev
Disallow: /