#robots.txt, www.el-live.de 20081121 # User-agent: wget Disallow: / User-agent: scooter Disallow: / User-agent: webzip Disallow: / User-agent: crawl-it Disallow: / User-agent: WebReaper Disallow: / User-agent: Mediapartners-Google* Disallow: User-agent: msnbot Crawl-delay: 120 User-agent: * Disallow: /onlive/sexy_uploads/ Disallow: /onlive/sexy_kontakte/ Disallow: /phplib/ Disallow: /_images/ Disallow: /_linke_navigation/ Disallow: /_rechte_navigation/ Disallow: /_teaser/