# (Copied from uk.altavista.com robots.txt - Lex, 14-Sep-05) # # Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # For now disallow all we can modify this as needed to allow certain crawlers. # # (robots.txt checked with http://tool.motoricerca.info/robots-checker.phtml # on 06-Feb-08) User-agent: * Disallow: /phpsysinfo/ Disallow: /phpsysinfo-dev/ Disallow: /cgi-bin/ Disallow: /~lex/public/dsl/files/