# Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html # By default we allow robots to access all areas of our site # already accessible to anonymous users User-agent: * Allow: / User-Agent: msnbot/ Disallow: / # Add Googlebot-specific syntax extension to exclude forms # that are repeated for each piece of content in the site # the wildcard is only supported by Googlebot # http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling User-Agent: Googlebot Disallow: /*sendto_form$ Disallow: /*folder_factories$ Disallow: /*search$ Disallow: /*enabling_cookies$ Disallow: /events/ Disallow: /accessibility-info Disallow: /login_form Disallow: /Members/ Disallow: /news/ Disallow: /testseite Disallow: /bilder/ Disallow: /dokumente/ Disallow: /iss/ Disallow: /events/aggregator/previous Disallow: /search?SearchableText=inhouse Disallow: /search?SearchableText=adoption Disallow: /search?SearchableText=sorge Disallow: /iss-1/view?set_language=en Disallow: /news-en Disallow: /?set_language=en Disallow: /events/aggregator/previous?set_language=en Disallow: /der-isd/die-organisation Disallow: /externe-links