User-Agent: * Disallow: /sp/ Disallow: /op/ Crawl-Delay: 600 User-agent: Y!J-SRD/1.0 Disallow: / User-agent: Y!J-MBS/1.0 Disallow: / User-agent: Googlebot-Mobile Disallow: / User-agent: MicrosoftPrototypeCrawler Disallow: / User-agent: TurnitinBot Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: fast Disallow: / User-Agent: ZyBorg Disallow: / User-Agent: sitecheck.internetseer.com Disallow: / User-Agent: NaverBot* Disallow: / User-Agent: NaverBot Disallow: / User-Agent: SakeBot Disallow: / User-Agent: Mediapartners-Google Disallow: / User-Agent: Googlebot-Image Disallow: / User-Agent: Zao Disallow: / User-Agent: Baiduspider* Disallow: / User-agent: Teoma Disallow: / User-agent: SlySearch Disallow: / User-agent: DiaGem Disallow: / User-agent: Gaisbot Disallow: / User-agent: ImageBot Disallow: / User-agent: blogWatcher_Spider Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: lmspider Disallow: / User-agent: Gigabot Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: searchpreview Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: MVAClient Disallow: / User-agent: psbot Disallow: / User-agent: lmspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: Twiceler Disallow: / User-agent: Exabot-Images Disallow: / User-agent: MJ12bot Disallow: / User-agent: page_verifier Disallow: / User-agent: WebAuto Disallow: / User-agent: Pockey-GetHTML Disallow: / User-agent: Bitacle Disallow: / User-agent: Exabot Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: IDBot Disallow: / User-agent: SnapPreviewBot Disallow: / User-agent: LiteFinder Disallow: / User-agent: Biz360 Disallow: / User-agent: dotbot Disallow: /