# Filename: robots.txt # # Standard robots.txt for Sytadel system distribution. # Must be accessible from the top-level directory of the # webserver hierarchy. e.g. http://www.example.com/robots.txt # 966291 - Added on request from web and recalls team. Email from web team to MC on 8/7/2010 User-agent: * Disallow: /cgi-bin/ Disallow: /icons/ Disallow: /cache/ Disallow: /content/maintain/ Disallow: /content/search/ Disallow: /blogShowDate/ Disallow: /member/ Disallow: /util/ Disallow: /ITTender/ Disallow: /content/index.phtml/itemId/966291