# For domain: http://www.mscproducts.com/ # All robots will spider the domain User-agent: * Disallow: # Disallow directory /includes/ User-agent: * Disallow: /includes/ # Disallow directory /mail/ User-agent: * Disallow: /mail/ # Disallow directory /DOCS/ User-agent: * Disallow: /DOCS/ # Disallow directory /pub/ User-agent: * Disallow: /pub/ # Disallow directory /download/ User-agent: * Disallow: /download/ # Disallow directory /admin/ User-agent: * Disallow: /admin/