User-agent: * Disallow: /members/ Disallow: /private-members/ Disallow: /membersWIP/ User-agent: Slurp Crawl-delay: 0.5