User-agent: ZyBorg Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: moget Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Googlebot Disallow: /cgi-bin/ Disallow: /mt/ User-agent: bumblebee Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: TurnitinBot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: ia_archiver Disallow: / User-agent: fast Disallow: / User-agent: ArchitextSpider Disallow: / User-agent: slurp Disallow: / User-agent: nabot Disallow: / User-agent: girafa Disallow: / User-agent: Steeler Disallow: / User-agent: InfoSeek Sidewinder Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Gaisbot Disallow: / Disallow: /illust/ Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Gaisbot/3.0+ Disallow: / Disallow: /illust/ Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: VoilaBot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: NutchOrg Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Zoo Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: kikkou Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: VoilaBot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /illust/ Disallow: /mt/ User-agent: Charlotte Disallow: / Disallow: /d/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /illust/ Disallow: /mt/ User-agent: msnbot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: NPBot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: e-SocietyRobot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: blogWatcher_Spider Disallow: / Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Hatena Antenna Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-agent: Comaneci_bot Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/ User-Agent: W_Univ_BJ_spider disallow: / User-agent: dotbot Disallow: / User-agent: NaverBot Disallow: / User-agent: OOZBOT Disallow: / User-agent: Tagoobot Disallow: / User-agent: twiceler Disallow: / User-agent: * Disallow: /d/ Disallow: /cgi-bin/ Disallow: /mt/