User-agent: *
Allow: /
Disallow: /database_data/
Crawl-delay: 1