User-Agent: *
Crawl-delay: 6
Allow: /