User-Agent: AhrefsBot Crawl-Delay: 2 User-agent: BLEXBot Crawl-Delay: 10 User-Agent: MJ12bot Crawl-Delay: 5