#Google Search Engine Robot User-agent: Googlebot # Crawl-delay: 10 — Googlebot ignores crawl-delay ftl Disallow: /*? Disallow: /cgi-bin/ Disallow: /business/ Disallow: /gbase/ Disallow: /shop24/ Disallow: /shop5/ Disallow: /good/ Disallow: /fec/ #Yahoo! Search Engine Robot User-Agent: Slurp Crawl-delay: 1 Disallow: /*? Disallow: /cgi-bin/ Disallow: /business/ Disallow: /gbase/ Disallow: /shop24/ Disallow: /shop5/ Disallow: /good/ Disallow: /fec/ #Microsoft Search Engine Robot User-Agent: msnbot Crawl-delay: 1 Disallow: /*? Disallow: /cgi-bin/ Disallow: /business/ Disallow: /gbase/ Disallow: /shop24/ Disallow: /shop5/ Disallow: /good/ Disallow: /fec/ # Every bot that might possibly read and respect this file. User-Agent: * Disallow: /*? Disallow: /cgi-bin/ Disallow: /business/ Disallow: /gbase/ Disallow: /shop24/ Disallow: /shop5/ Disallow: /good/ Disallow: /fec/