User-agent: * Disallow: /archive/ Disallow: /staging/ User-agent: * Crawl-Delay: 3