User-agent: *
Allow: /downloads/*
Crawl-delay: 1
Request-rate: 1/1
Visit-time: 0000-2359