|
|
|
|
|
XML Version |
 |
Home || Links || Banners || Feedback & Additions || E-Mail
|
|
|
|
List of User-Agents (Spiders, Robots, Crawler, Browser) A - F:A searchable database of user-agents as used by browsers, search-engines spiders and crawlers, web-directories, download managers, link checkers, proxy servers, web filtering tools, harvesters, spambots, badbots. Sorted by the user-agents names with informations about their type, purpose and origin. The info-field at every user-agents entry offers even more information. Recent additions and updates are at the top of each page. The numerous Mozilla variations are not included in the alphabetical assortment "M" and can be found at an own page. Because of the many requests for a text only version of the database I decided to make a XML version available. You'll find a permanent link at the top left.
|
|
|||||
|
Legend: |
RECENT ADDITIONS AND UPDATES: |
Updated: 07/04/2008 17:46h |
|
String |
Description |
Type | Info |
|---|---|---|---|
| Amoi 8512/R21.0 NF-Browser/3.3 | NF embedded browser on Amois Skypephone | B | Info |
| Apple iPhone v1.1.4 CoreMedia v1.0.0.4A102 | CoreMedia player on Apple iPhone | B | Info |
| ArachBot | Covac Arachnid Web Crawler | R | Info |
| CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp) | CyberPatrol LLC robot for web filtering software | R | Info |
| FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP) | FeedDemon RSS reader | B | Info |
| Feedjit Favicon Crawler 1.0 | Feedjit news feed service favicon crawler | R | Info |
|
String |
Description |
Type | Info |
|---|---|---|---|
| !Susie (http://www.sync2it.com/susie) | Sync2It bookmark management & clustering engine | C R | Info |
| <a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com) | UnCHAOS search robot | R | Info |
| <a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com) | UnCHAOS search robot | R | Info |
| <b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com) | UnCHAOS search robot | R | Info |
| <http://www.sygol.com/> http://www.sygol.com | Sygol Search (Italy) robot | R | Info |
| ( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ) | SearchEngineWorld's robots.txt validator | C | Info |
| (DreamPassport/3.0; isao/MyDiGiRabi) | DreamCast DreamPassport browser | B | Info |
| (Privoxy/1.0) | Privoxy web proxy | P | Info |
| */Nutch-0.9-dev | Unknown Yahoo robot | R | Info |
| +SitiDi.net/SitiDiBot/1.0 (+Have Good Day) | SitiDi.net search (Germany) robot | R | Info |
| -DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de | Die Kraehe Meta-Search-Engine (Germany) link checking | R | Info |
| 123spider-Bot (Version: 1.02, powered by www.123spider.de | 123spider.de (Germany) web directory link checking | C | Info |
| 192.comAgent | 192.com - UK web directory | R | Info |
| 1st ZipCommander (Net) - http://www.zipcommander.com/ | 1st ZipCommander Net - IE based browser | B | Info |
| 2Bone_LinkChecker/1.0 libwww-perl/5.64 | 2Bone online link checker | C | Info |
| 4anything.com LinkChecker v2.0 | 4Anything robot | R | Info |
| 8484 Boston Project v 1.0 | Unknown guestbook spamming or harvesting tool from diff. IPs | S | Info |
| :robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html ) | neofonie search robot Germany | R | Info |
| A-Online Search | A-Online.at robot - now Jet2Web Search | R | Info |
| A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27 | A1 Keyword Research - search engine and keyword optimization software | C | Info |
| A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24 | MiggiBot website crawler engine - A1 Sitemap Generator | R | Info |
| aardvark-crawler | Aardvark web crawler for Sun's Blog recommendations | R | Info |
| AbachoBOT | Abacho / Crawler.de robot | R | Info |
| AbachoBOT (Mozilla compatible) | Abacho / Crawler.de robot | R | Info |
| ABCdatos BotLink/5.xx.xxx#BBL | ABCdatos - Castilian program & tutorial directory | R | Info |
| Aberja Checkomat | Aberja Hybridsuchmaschine (Germany) link checking | R | Info |
| abot/0.1 (abot; http://www.abot.com; abot@abot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| About/0.1libwww-perl/5.47 | About robot | R | Info |
| Accelatech RSSCrawler/0.4 | Accela Technology RSS feed crawler | R | Info |
| accoona | Accoona Search robot | R | Info |
| Accoona-AI-Agent/1.1.1 (crawler at accoona dot com) | Accoona Search robot | R | Info |
| Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com) | Accoona Search robot | R | Info |
| Ace Explorer | Ace Explorer - IE based browser | B | Info |
| Ack (http://www.ackerm.com/) | Ackerm search robot | R | Info |
| AcoiRobot | Acoi picture finder robot | R | Info |
| Acoon Robot v1.50.001 | Acoon.de search (Germany) robot | R | Info |
| Acoon Robot v1.52 (http://www.acoon.de) | Acoon.de search (Germany) robot | R | Info |
| Acoon-Robot 4.0.x.[xx] (http://www.acoon.de) | Acoon.de search (Germany) robot | R | Info |
| Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com) | Acoon.de search (Germany) robot | R | Info |
| Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org) | Acorn Search Project | R | Info |
| ActiveBookmark 1.x | LibMaster.com Active Bookmark HTML page creator | C B | Info |
| Activeworlds | Activeworlds 3D homepage browser | B | Info |
| ActiveWorlds/3.xx (xxx) | Activeworlds 3D homepage browser | B | Info |
| Ad Muncher v4.xx.x | Ad Muncher - banner killer | P | Info |
| Ad Muncher v4x Build xxxxx | Ad Muncher - banner killer | P | Info |
| Adaxas Spider (http://www.adaxas.net/) | website directory adaxas link checking | C | Info |
| Advanced Browser (http://www.avantbrowser.com) | Avant Browser - IE based browser | B | Info |
| AESOP_com_SpiderMan | Aesop robot | R | Info |
| agadine/1.x.x (+http://www.agada.de) | Agada search (Germany) robot | R | Info |
| Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com) | SharewarePlaza link checking | R | Info |
| AgentName/0.1 libwww-perl/5.48 | Linkomatic submission verifier | R | Info |
| AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China) | 21seek.com (China) robot (218.17.90.xxx) | R | Info |
| AideRSS/1.0 (aiderss.com) | AideRss - Postrank RSS and Blog filtering | C | Info |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| Aladin/3.324 | Aladin robot | R | Info |
| Alcatel-BG3/1.0 UP.Browser/5.0.3.1.2 | Phone.com UP.Browser for mobiles on Alcatel cellphone | B | Info |
| Aleksika Spider/1.0 (+http://www.aleksika.com/) | Aleksika Danmark - Search engine optimization spider | R | Info |
| AlkalineBOT/1.3 | Vestris robot | R | Info |
| AlkalineBOT/1.4 (1.4.0326.0 RTM) | Vestris robot | R | Info |
| Allesklar/0.1 libwww-perl/5.46 | Allesklar.de robot | R | Info |
| Alligator 1.31 (www.nearsoftware.com) | Alligator download manager | D | Info |
| AltaVista Intranet V2.0 AVS EVAL search@freeit.com | Altavista robot | R | Info |
| AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net | Altavista robot | R | Info |
| AltaVista Intranet V2.0 evreka.com crawler@evreka.com | Altavista robot | R | Info |
| AltaVista V2.0B crawler@evreka.com | Altavista robot | R | Info |
| AmfibiBOT | Amfibi Search robot | R | Info |
| Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com) | Amfibi Search robot | R | Info |
| Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) | Amfibi Search robot | R | Info |
| amibot | amibot - Amidalla search engine robot (62.241.33.xx) | R | Info |
| Amiga-AWeb/3.4.167SE | AWeb Amiga browser | B | Info |
| AmigaVoyager/3.4.4 (MorphOS/PPC native) | Voyager - Amiga browser | B | Info |
| AmiTCP Miami (AmigaOS 2.04) | Amiga Miami TCP Stack | Info | |
| amzn_assoc | Amazon.com robot for checking their affiliate sites | C | Info |
| AnnoMille spider 0.1 alpha - http://www.annomille.it | Annomille Italian historical oriented robot | R | Info |
| annotate_google; http://ponderer.org/download/annotate_google.user.js | annotate Google - Firefox extension for annotating Google search results | B | Info |
| Anonymized by ProxyOS: http://www.megaproxy.com | Megaproxy user | P | Info |
| Anonymizer/1.1 | faked user agent | Info | |
| AnswerBus (http://www.answerbus.com/) | AnswerBus natural language search using COLLATE technology | R | Info |
| AnswerChase PROve x.0 | AnswerChase search tool | Info | |
| AnswerChase x.0 | AnswerChase search tool | Info | |
| ANTFresco/x.xx | ANT Fresco Browser | B | Info |
| antibot-V1.1.5/i586-linux-2.2 | Antibot (discontinued) robot | R | Info |
| AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine) | Anzwers (Yahoo) Australia robot | R | Info |
| Apexoo Spider 1.x | Apexoo Search spider | R | Info |
| Aplix HTTP/1.0.1 | JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV | B | Info |
| Aplix_SANYO_browser/1.x (Japanese) | JavaOS app. for Sanyo Internet-TV | B | Info |
| Aplix_SEGASATURN_browser/1.x (Japanese) | JavaOS app. for SEGA Saturn Internet | B | Info |
| Aport | Aport robot | R | Info |
| appie 1.1 (www.walhello.com) | Walhello Internet Search robot | R | Info |
| ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;) | Araby search - Arabia | R | Info |
| Arachnoidea (arachnoidea@euroseek.com) | Euroseek spider | R | Info |
| aranhabot | Amazon.com robot for checking their affiliate sites | C | Info |
| ArchitextSpider | Excite spider | R | Info |
| archive.org_bot | Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx) | R | Info |
| Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com) | Simpy Bookmarklet crawler (69.55.233.xx) | C | Info |
| Arikus_Spider | Arikus inContext search engine software | R | Info |
| Arquivo-web-crawler (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt) | Tomba project: the Portuguese web archive | R | Info |
| ASAHA Search Engine Turkey V.001 (http://www.asaha.com/) | Asaha search robot (Turkey) | R | Info |
| Asahina-Antenna/1.x | ASAHINA Antenna information detecting agent | R | Info |
| Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x) | ASAHINA Antenna information detecting agent | R | Info |
| ask.24x.info | Ask 24x Info robot | R | Info |
| AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com) | Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch | R | Info |
| asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com) | askEd! / Inferret search (Japan) robot using Nutch | R | Info |
| ASPSeek/1.2.5 | ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot | R | Info |
| ASPseek/1.2.9d | Swsoft.net robot using Aspseek | R | Info |
| ASPSeek/1.2.x | ASPSeek search engine software | R | Info |
| ASPSeek/1.2.xa | ASPSeek search engine software | R | Info |
| ASPseek/1.2.xx | ASPSeek search engine software | R | Info |
| ASPSeek/1.2.xxpre | ASPSeek search engine software | R | Info |
| ASSORT/0.10 | Associative Sort robot | R | Info |
| asterias/2.0 | Singingfish media spider (64.12.186.2xx) via AOL search | R | Info |
| AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html) | Atlocal local business search robot | R | Info |
| Atomic_Email_Hunter/4.0 | Atomic Email Hunter email extracing and harvesting | S | Info |
| Atomz/1.0 | Atomz robot | R | Info |
| atSpider/1.0 | atSpider (ceased) email harvester / spambot | S | Info |
| Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com) | Attentio social media monitoring and analysing | R | Info |
| AU-MIC/2.0 MMP/2.0 | Samsung SPH-A660 phone with Sprint software | B | Info |
| AUDIOVOX-SMT5600 | Audiovox SMT5600 (AT&T) Smartphone mobile phone browser | B | Info |
| augurfind | Augurnet Swiss (was www.augurnet.ch) search robot | R | Info |
| augurnfind V-1.x | Augurnet Swiss (was www.augurnet.ch) search robot | R | Info |
| autoemailspider | Auto Email Pro Email harvester | S | Info |
| autohttp | Linkscan tool from Elsop | C | Info |
| autowebdir 1.1 (www.autowebdir.com) | Autowebdir - The Automatically Generated Web Directory | R | Info |
| AV Fetch 1.0 | Altavista robot ?? | R | Info |
| Avant Browser (http://www.avantbrowser.com) | Avant Browser - IE based browser | B | Info |
| AVSearch-1.0(peter.turney@nrc.ca) | National Research Council Canada robot | R | Info |
| AVSearch-2.0-fusionIdx-14-CompetitorWebSites | Unknown robot from 205.203.108.xx (telerate.com) | Info | |
| AVSearch-3.0(AltaVista/AVC) | Altavista robot | R | Info |
| AWeb | AWeb Amiga browser | B | Info |
| axadine/ (Axadine Crawler; http://www.axada.de/; ) | Axada search Germany robot | R | Info |
| AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine. | Axmo search robot | R | Info |
| Azureus 2.x.x.x | Azureus Java BitTorrent Client | D | Info |
| BaboomBot/1.x.x (+http://www.baboom.us) | BaBoom Web Portal (ODP) robot (66.98.254.xx) | R | Info |
| BackStreet Browser 3.x | BackStreet Browser - Offline browser / website downloader | D | Info |
| BaiduImagespider+(+http://www.baidu.jp/search/s308.html) | Baidu search (Japan) image crawler | R | Info |
| BaiDuSpider | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://help.baidu.jp/system/05.html) | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://www.baidu.com/search/spider_jp.html) | Baidu search (Japan) crawler | R | Info |
| Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) | Balihoo - Vertical search engine crawler (beta) | R | Info |
| BanBots/1.2 (spider@banbots.com) | Project BanBots Perl script robot | C | Info |
| Barca/2.0.xxxx | Barca Pro email & PIM software | B | Info |
| BarcaPro/1.4.xxxx | Barca Pro email & PIM software | B | Info |
| BarraHomeCrawler (albertof@barrahome.org) | Barrahome crawler | R | Info |
| bCentral Billing Post-Process | Unknown user agent from Microsoft | Info | |
| bdcindexer_2.6.2 (research@bdc) | Business.com robot | R | Info |
| BDFetch | Brandimensions Brand Protection robot | R | Info |
| BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686) | Bdncentral Sitesearch robot | R | Info |
| BeamMachine/0.5 (dead link remover of www.beammachine.net) | beammachine web directory (Germany) link checking | R C | Info |
| beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/) | Beauty robot for Cosmoty - German beauty and wellness search | R | Info |
| BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html ) | A Passion for Jazz music related search robot | R | Info |
| BeebwareDirectory/v0.01 | LinkcheckerBeepware (site is down) web directory link checking | C | Info |
| Big Brother (http://pauillac.inria.fr/~fpottier/) | Big Brother link checking tool | C | Info |
| Big Fish v1.0 | GoonGee.com link popularity checking | C | Info |
| BigBrother/1.6e | BB4 network monitoring | C | Info |
| BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com) | BigClique Search robot | R | Info |
| BIGLOTRON (Beta 2;GNU/Linux) | Biglotron search (France) robot | R | Info |
| Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com) | Bigsearch.ca search robot | R | Info |
| Bilbo/2.3b-UNIX | Bilbo - web frontend for the Nessus Security Scanner | C | Info |
| BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) | Bilgi.com (Beta) search robot - Turkey | R | Info |
| BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com) | Bilgi.com (Beta) search robot - Turkey | R | Info |
| billbot wjj@cs.cmu.edu | Carnegie Mellon School robot/link checking ? | C | Info |
| Bitacle bot/1.1 | Bitacle Blog Search Archive robot | R | Info |
| Bitacle Robot (V:1.0;) (http://www.bitacle.com) | Bitacle Blog Search Archive robot | R | Info |
| Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx) | Biyubi Navigator - Mexican browser for Fenix OS | B | Info |
| BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0) | Blackberry Wireless Internet browser via Google WAP Proxy | B P | Info |
| BlackWidow | BlackWidow web site scanner / downloading tool | D | Info |
| BlackWidow | FS Consulting (was www.fsconsult.net) Black Widow web crawler | R | Info |
| Blaiz-Bee/1.0 (+http://www.blaiz.net) | Blaiz Enterprises RawGrunt search | R | Info |
| Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com) | Blaiz Enterprises RawGrunt search | R | Info |
| Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net) | Blaiz Enterprises RawGrunt search | R | Info |
| BlitzBOT@tricus.net | Blitzsuche Germany robot | R | Info |
| BlitzBOT@tricus.net (Mozilla compatible) | Blitzsuche Germany robot | R | Info |
| BlockNote.Net | BlockNote web page editor | B | Info |
| BlogBot/1.x | blogdex robot from MIT.edu | R | Info |
| BlogBridge 2.13 (http://www.blogbridge.com/) | BlogBridge RSS reader | B | Info |
| Bloglines Title Fetch/1.0 (http://www.bloglines.com) | Bloglines article search | R | Info |
| Bloglines-Images/0.1 (http://www.bloglines.com) | Bloglines graphics crawler | R | Info |
| BlogMap (http://www.feedmap.net) | FeedMap / BlogMap geo coding service | C | Info |
| Blogpulse (info@blogpulse.com) | Intelliseek's BlogPulse blog search | R | Info |
| BlogPulseLive (support@blogpulse.com) | Intelliseek's BlogPulse blog search | R | Info |
| BlogSearch/1.x +http://www.icerocket.com/ | IceRocket Web search robot | R | Info |
| blogsearchbot-pumpkin-3 | Art of Computing blog search project | R | Info |
| BlogsNowBot, V 2.01 (+http://www.blogsnow.com/) | BlogsNow realtime link tracker robot | R | Info |
| BlogVibeBot-v1.1 (spider@blogvibe.nl) | BlogVipe news and Blog crawler (Netherlands) | R | Info |
| blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/) | blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx) | R | Info |
| BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com) | IceRocket Web search robot | R | Info |
| BlogzIce/1.0 +http://www.icerocket.com/ | IceRocket Web search robot | R | Info |
| BloobyBot | Blooby search (beta) robot | R | Info |
| Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) | Balihoo - Search Engine for Advertising Media | R | Info |
| bluefish 0.6 HTML editor | Bluefish HTML-editor for Linux | B | Info |
| BMCLIENT | Part of ButtMan remote access tool | Info | |
| BMLAUNCHER | Bookmark Express bookmark manager | C | Info |
| Bobby/4.0.x RPT-HTTPClient/0.3-3E | Bobby web accessibility desktop testing tool | C | Info |
| boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html) | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| boitho.com-robot/1.x | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| boitho.com-robot/1.x (http://www.boitho.com/bot.html) | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| Bookdog/x.x | Bookdog - Mac bookmark manager | C | Info |
| Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/) | Bookmark Buddy - favorite bookmark manager | C | Info |
| Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] | Favourites managing program | C | Info |
| Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta) | Favourites managing program | C | Info |
| BookmarkBase(2/;http://bookmarkbase.com) | Bookmark Base bookmark manager | C | Info |
| Bot mailto:craftbot@yahoo.com | cybercity.fr user robot / faked user agent ? | Info | |
| BPImageWalker/2.0 (www.bdbrandprotect.com) | BD-Brandprotect copyright infringement crawler | R | Info |
| BravoBrian bstop.bravobrian.it | BravoBrian bSTOP parental control | P R | Info |
| BravoBrian SpiderEngine MarcoPolo | Robot for BravoBrian bSTOP | R | Info |
| BrightCrawler (http://www.brightcloud.com/brightcrawler.asp) | BrightCloud web filtering for classifying websites | P R | Info |
| BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) | Webarchive Project Bruinbot crawler | R | Info |
| BSDSeek/1.0 | Inktomi (Hotbot-Lycos NBCi) robot | R | Info |
| BStop.BravoBrian.it Agent Detector | BravoBrian bSTOP parental control | P R | Info |
| BTbot/0.x (+http://www.btbot.com/btbot.html) | BitTorrent Search Engine btbot robot | R | Info |
| BTWebClient/180B(9704) | µTorrent BitTorrent Client | D | Info |
| BuildCMS crawler (http://www.buildcms.com/crawler) | BuildCMS crawler - market monitoring project of BuildCMS | R | Info |
| Bulkfeeds/r1752 (http://bulkfeeds.net/) | Bulkfeeds: RSS directory link checking | C | Info |
| BullsEye | BullsEye/Intelliseek robot | R | Info |
| bumblebee@relevare.com | Relevare Portal software robot | R | Info |
| BunnySlippers | Microsoft server information robot (see link) | C | Info |
| BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com) | BurstFind search crawler (64.34.172.xx) | R | Info |
| Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/) | Buscaplus (Spain) robot | R | Info |
| BW-C-2.0 | Logitech Desktop Managers (LDM) Backweb (BW) update check | D | Info |
| bwh3_user_agent | Basic Web Hacking 3 fake user-agent from Hellbound Hackers challenges | S | Info |
| Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com) | Amfibi Search robot | R | Info |
| Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com) | Amfibi Search robot | R | Info |
| CamelHttpStream/1.0 | Evolution integrated mail solution Camel TCP stream class | Info | |
| Cancer Information and Support International; | Some user agent | Info | |
| carleson/1.0 | Cosmix project crawler (204.14.48.x / 38.113.234.xxx) | R | Info |
| Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html | Carnegie Mellon University WebBOT | R | Info |
| Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html | Carnegie Mellon University WebBOT | R | Info |
| Catall Spider | Catall.de search & web directory (Germany) | R | Info |
| CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) | UIUCs Cazoodle search based on MetaQuerier | R | Info |
| CCBot/1.0 (+http://www.commoncrawl.org/bot.html) | CommonCrawl Foundation search crawler | R | Info |
| ccubee/x.x | Empyreum Ccubee (Czech) search engine solution | R | Info |
| CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0 | Timewe mobile browser (WAP) simulator (Japan) | B | Info |
| CE-Preload | Cisco Content Engine | P | Info |
| CentiverseBot | Nordic semantic search engine | C | Info |
| CentiverseBot - investigator | Nordic semantic search engine | C | Info |
| CentiverseBot/3.0 (http://www.centiverse-project.net) | Nordic semantic search engine | C | Info |
| Ceramic Tile Installation Guide (http://www.floorstransformed.com) | Floortransformed.com robot (link ckecking ??) | R | Info |
| cfetch/1.0 | Cosmix project crawler (204.14.48.x / 38.113.234.xxx) | R | Info |
| CFNetwork/x.x | MaxOS X CoreFoundation CFNetwork API | Info | |
| cg-eye interactive | cg-eye CGI checker | C | Info |
| Charon/1.x (Amiga) | Charon Amiga download manager | D | Info |
| Checkbot/1.xx LWP/5.xx | Checkbot link validation | C | Info |
| CheckLinks/1.x.x | Checklinks - Perl link checker | C | Info |
| CheckUrl | NTL user agent | Info | |
| CheckWeb | CheckWeb link validation | C | Info |
| Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp) | Chilkat HTTP component user-agent | Info | |
| China Local Browse 2.6 | Unknown spam bot from telekom.com.my (218.111.83.xxx) | S | Info |
| Chitika ContentHit 1.0 | Chitika Inc. Blog advertising | C | Info |
| ChristCRAWLER 2.0 | Christcentral.com Christcrawler (was www.christcrawler.com) | R | Info |
| CHttpClient by Open Text Corporation | CHttpClient - C++ class using WinInet | Info | |
| CipinetBot (http://www.cipinet.com/bot.html) | CipinetBot -Cipinet Search Engine Web Crawler | R | Info |
| Cityreview Robot (+http://www.cityreview.org/crawler/) | Cityreview regional search (Germany) link checking | C | Info |
| CJ Spider/ | Commision Junction link checking spider | C | Info |
| CJB.NET Proxy | CJB Net anonymous socks proxy service (216.194.70.x) | P | Info |
| ClariaBot/1.0 | Claria (ex Gator) SearchScout robot (64.152.73.xx) | R | Info |
| Claymont.com | Claymont Search robot | R | Info |
| CloakDetect/0.9 (+http://fulltext.seznam.cz/) | Seznam Search (Czech Republic) robot | R | Info |
| Clushbot/2.x (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Hector (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| COAST WebMaster Pro/4.x.x.xx (Windows NT) | COAST Webmaster - Web management and maintenance software | Info | |
| CoBITSProbe | Proposed Content-Based Image Tracking System (CoBITS) P2P crawler | R C | Info |
| Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious) | Cocoa del.icio.us (social bookmarks manager) client for Mac OS X | C | Info |
| ColdFusion | Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking | P C | Info |
| ColdFusion (BookmarkTracker.com) | Cold Fusion server used by Bookmark Tracker - online favourites managment | C | Info |
| collage.cgi/1.xx | WebCollage Syndicator graphics crawler/collector | R D | Info |
| combine/0.0 | Combine harvesting & indexing robot | R | Info |
| Combine/2.0 http://combine.it.lth.se/ | Combine harvesting & indexing robot | R | Info |
| Combine/3 http://combine.it.lth.se/ | Combine harvesting & indexing robot | R | Info |
| Combine/x.0 | Combine harvesting & indexing robot | R | Info |
| cometrics-bot, http://www.cometrics.de | cometrics Web Content Mining solution - Germany | R | Info |
| Commerce Browser Center | Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de) | B | Info |
| complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com) | UCLA Complex Networks Groups Complex Network Analysis | C | Info |
| Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu | Hungarian Academy of Sciences data mining search | R | Info |
| Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) | ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx) | R | Info |
| Contact | unknown | Info | |
| ContactBot/0.2 | Probably E-Mail harvesting robot - same as LMQueueBot | S | Info |
| ContentSmartz | ContentSmartz e-mail harvesting tools | S | Info |
| contype | Internet Explorer versions 4.x and 5 plugin content | B | Info |
| Convera Internet Spider V6.x | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraCrawler/0.2 | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl) | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl) | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| CoolBot | Suchmaschine21 (Germany) robot | R | Info |
| CoralWebPrx/0.1.1x (See http://coralcdn.org/) | Coral Content Distribution Network | P C | Info |
| cosmos/0.8_(robot@xyleme.com) | Xyleme SA France robot | R | Info |
| cosmos/0.9_(robot@xyleme.com) | Xyleme SA France robot | R | Info |
| CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com) | Coteo.com - local French directory link checking | C | Info |
| CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml) | Cougarsearch.com robot | R | Info |
| Covac TexAs Arachbot | Covac Arachnid Web Crawler | R | Info |
| Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) | Naver Japan / Korea robot | R | Info |
| Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) | Naver Japan / Korea robot | R | Info |
| CrawlConvera0.1 (CrawlConvera@yahoo.com) | Converas RetrievalWare Internet Spider | R | Info |
| Crawler | unknown robot via Level3.net | Info | |
| Crawler (cometsearch@cometsystems.com) | Cometsystems Comet Search robot via Findwhat (now Miva) | R | Info |
| Crawler admin@crawler.de | Crawler.de / Abacho robot | R | Info |
| Crawler V 0.2.x admin@crawler.de | Crawler.de / Abacho robot | R | Info |
| crawler@alexa.com | Alexa crawler | R | Info |
| CrawlerBoy Pinpoint.com | Pinpoint WAP search robot | R | Info |
| Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com) | Crawlly Beta search - Germany (72.232.194.2xx) | R | Info |
| CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) | Creatice Commons using Nutch open source robot | R | Info |
| CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686) | Croccrawler robot | R | Info |
| csci_b659/0.13 | Web mining project from CSCI 659 (computer science course) at Indiana Univerity | R | Info |
| CSE HTML Validator Professional (http://www.htmlvalidator.com/) | CSE HTML Validator for Windows | C | Info |
| Cuam Ver0.050bx | Cuam - IE based browser | B | Info |
| Cuasarbot/0.9b http://www.cuasar.com/spider_beta/ | Cuasar (Spain) music / ringtone search spider | R | Info |
| curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4 | Curl file transferring tool | D | Info |
| curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled) | Curl file transferring tool | D | Info |
| curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSS |