User-agent: * Disallow: /images Disallow: /calendar/js Disallow: /global Disallow: /print #Disallow: /news/inform Disallow: /jump Disallow: /profile/registration/confirm Disallow: /profile/update Disallow: /data/image/avatars/ Disallow: /data/image/forum/ Disallow: /images #Disallow: /mail/new Disallow: /treeselect/ User-agent: psbot Disallow: / # http://www.webalta.net/ru/about_webmaster.html User-agent: Webalta Disallow: / # http://irl.cs.tamu.edu/crawler/ User-agent: IRLbot Disallow: / # http://www.majestic12.co.uk/projects/dsearch/mj12bot.php User-Agent: MJ12bot Disallow: / # http://www.cuill.com/twiceler/robot.html User-Agent: twiceler Disallow: /