User-agent: bingbot Crawl-delay: 5 User-Agent: facebookexternalhit Crawl-delay: 60 User-agent: * Allow: / User-agent: dotbot Disallow: / User-agent: PetalBot Disallow: /