# ----------------------------------------- # # www.ontourmarketing.at robots.txt # # ----------------------------------------- # # Modified Version of # # httpde.wikipedia.orgrobots.txt # # Creation Date Wed, 3rd Feb. 2010 # # ---------------------------- WP Directories # Block all User-agent Disallow wp-admin # ---------------------------- Feeders # Block Specific User-agent UbiCrawler Disallow User-agent DOC Disallow User-agent Zao Disallow # ---------------------------- Troubling Bots # Block Specific User-agent sitecheck.internetseer.com Disallow User-agent Zealbot Disallow User-agent MSIECrawler Disallow User-agent SiteSnagger Disallow User-agent WebStripper Disallow User-agent WebCopier Disallow User-agent Fetch Disallow User-agent Offline Explorer Disallow User-agent Teleport Disallow User-agent TeleportPro Disallow User-agent WebZIP Disallow User-agent linko Disallow User-agent HTTrack Disallow User-agent Microsoft.URL.Control Disallow User-agent Xenu Disallow User-agent larbin Disallow User-agent libwww Disallow User-agent ZyBORG Disallow User-agent Download Ninja Disallow # ---------------------------- Bad Beahviour # Block Specific User-agent wget Disallow User-agent grub-client Disallow User-agent k2spider Disallow User-agent NPBot Disallow User-agent WebReaper Disallow # ---------------------------- Sitemap Sitemap: http://www.ontourmarketing.at/sitemap.xml