#avoid redirect loop when blocking bots - always delivery robots.txt, http403 and 410 pages Order Allow,Deny Allow from all # Block due to SEO or pseudo-SEO which is not useful to me. User-Agent: Googlebot Allow: .js Allow: .css User-agent: AhrefsBot Disallow: / User-agent: Ezooms Disallow: / User-agent: Exabot Disallow: / User-agent: MJ12bot Disallow: / User-agent: CCBot Disallow: / User-agent: meanpathbot Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image Disallow: / User-agent: Sogou Disallow: / User-agent: * Disallow: /1css/ Disallow: /1js/ Disallow: /1php/ Disallow: /SchedeVA/XB03.php