User-Agent: *
Crawl-delay: 30
Allow: /