# Proposed robots.txt file for http://www.pf.uq.edu.au # # Created by ITO on 20/08/01 # # The purpose of this file is to stop excessive trafic from # Internet Web-Bots that automatically index websites. # # It has been noted that a large proportion of web trafic can # be attributed to such bots. Including the generation of # reams of 403 errors as Web-Bots attempt to index secure # areas of the P&F WebSite. # # Please note that these restriction in no way affect anyone # who wishes to explore the P&F WebSite. # # Any unspecified files or directories are automatically allowed # # Last modified by: ITO # Last modified on: 20010820 # # A User agent of '*' applies the following rules to all Web-Bots # User-agent: * Disallow: /IISSAMPLES/ Disallow: /IISADMIN/ Disallow: /SCRIPTS/ Disallow: /IISHELP/ Disallow: /IISADMPWD/ Disallow: /SiteServer/ Disallow: /Sites/ Disallow: /_mem_bin/ Disallow: /FpSample/ Disallow: /CmSample/ Disallow: /msadc/ Disallow: /MWeb/ Disallow: /M-Web/ Disallow: /drawings/ Disallow: /M-Web%202.0/ Disallow: /M-Web3.0/ Disallow: /dwf-BldgName.html Disallow: /dwf-BldgNo.html Disallow: /dwf-intro.html Disallow: /dwf-maps.html Disallow: /term.html Disallow: /term1024768W.hmtl Disallow: /term640480W.html Disallow: /term800600W.html Disallow: /mstscax.cab Disallow: /thanks.html Disallow: /thankscar.html Disallow: /thanksemerg.html Disallow: /thanksgat.hmtl Disallow: /feedback.html Disallow: /forms/ Disallow: /buildings/ Disallow: /Downloads/ Disallow: /edward/ Disallow: /images/ Disallow: /mac-fonts/ Disallow: /MEDIA/ Disallow: /Misc/ Disallow: /pc-fonts/ Disallow: /Phone%20Book%20Service/ Disallow: /Search/ Disallow: /1999_facilities_cond_rep_files/ Disallow: /Draw Disallow: /databases