# robot.txt for http://healthaction.net # # record describes the default access policy for any robot that has not matched any of the other records # # specifies a partial URL that is not to be visited. This can be a full path, or a partial path # do not crawl Image files - Google supporst wildcards like '*' & '$', but it is not standard User-agent: * Disallow: /Templates/ Disallow: /images/ Disallow: /alternative_site/ Disallow: /old Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.psd$ ######################## # indicates that no robot should visit this site further # replace '*' with User-agent you don't want accessing your site # #User-agent: * #Disallow: /