# Block all web crawler access. We DO NOT want replicated sites to be indexed. # Allowing replicated sites to be indexed will hurt our rep because of duplication rules. User-agent: * Disallow: /