User-agent: * Disallow: /search?* Disallow: /sponsor-demo Disallow: /storage/ User-Agent: FacebookBot Crawl-delay: 5 Disallow: *