User-agent: * Disallow: /*basket Disallow: /*login_customer Disallow: /*login_retailer Disallow: /*login_service Disallow: /*ses= Request-rate: 1/5 Crawl-delay: 20