# Исключения из индексирования User-agent: * Disallow: /aGuestBook/ Disallow: /ave/ Disallow: /cgi-bin/ Disallow: /scgi-bin/ Disallow: /new/ Disallow: /old/ Disallow: /phpBB/ Disallow: /news1/news/ Disallow: /scgi-bin/ Disallow: /style/ Disallow: /tmp/ Disallow: /cnt.html # # 89.208.19.8 WebAlta Crawler/1.3.20 # # User-agent: Crawler # Disallow: / # # User-agent: WebAlta # Disallow: /