# Refin Studio: robots.txt # # This file is used to allow crawlers to index our site. # It is NOT used for any other purpose, such as filtering # impressions or clicks. # Please, no more that 1 hit per minute and use off peak hours. User-agent: Slurp Crawl-delay: 10 User-agent: * Disallow: /index/it/ User-agent: * Disallow: