#=============================================================================== # # Copyright (c) 2000 Software Productivity Center Inc. All rights reserved. # # File: robots.txt # # Summary: Web Robot Exclusion File # # Project: SPC WEB # # Author(s): Bill Dagg # # Description: This file specifies areas of the Web site that are not to be # accessed by Web robots, or spiders. # # Notes: 1. This file must be named "robots.txt" and must reside at the # Web site document root. # # 2. Even if no areas of the Web site are to be excluded, DON'T # REMOVE THIS FILE from the document root. Its presence # prevents 404 "Not found" errors from occurring (for # "robots.txt") in Web site error logs. # # 3. Refer to the following URL for full "robots.txt" details: # # http://info.webcrawler.com/mak/projects/robots/robots.html # #=============================================================================== # # # 17-nov-2007 D.Muir added commands to block off downloads etc to indexing robots # 20-nov-2007 D.Muir Cloned for Springboard site, and updated # # # # User-agent: * Disallow: /bounce Disallow: /bounce/ Disallow: /images Disallow: /images/ Disallow: /library Disallow: /library/ Disallow: /logs Disallow: /logs/ Disallow: /templates Disallow: /templates/ Disallow: /webstats Disallow: /webstats/ Disallow: /downloads Disallow: /downloads/