RSS Feed   

xml

  XML Version
   from 06/19/2010

Add to Google

  Add to Google

The User-Agents List
Home || Links || Banners || Feedback & Additions || E-Mail

Search Database:

           Help

 

List of User-Agents (Spiders, Robots, Crawler, Browser) N - S:

A searchable database of user-agents as used by browsers, search-engines spiders and crawlers, web-directories, download managers, link checkers, proxy servers, web filtering tools, harvesters, spambots, badbots. Sorted by the user-agents names with informations about their type, purpose and origin. The info-field at every user-agents entry offers even more information. Recent additions and updates are at the top of each page. The numerous Mozilla variations are not included in the alphabetical assortment "M" and can be found at an own page.
new Because of the many requests for a text only version of the database I decided to make a XML version available. You'll find a permanent link at the top left.

A - F
G - M
Mozilla
N - S
T - Z

 

Legend:
B = Browser
C = Link-, bookmark-, server- checking D = Downloading tool
P = Proxy server, web filtering
R = Robot, crawler, spider
S = Spam or bad bot

RECENT ADDITIONS AND UPDATES:
Updated: 06/19/2010 07:37h

String

Description

Type

Info

Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (FM Scene 4.6.1)  FM Scene soccer fan pages plugin  Info
Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729) (Prevx 3.0.5)  PrevX security plugin    Info

N - S:

String

Description

Type

Info

Naamah 1.0.1/Blogbot (http://blogbot.de/)  Blogbot (Germany) robot  Info
Naamah 1.0a/Blogbot (http://blogbot.de/)  Blogbot (Germany) robot  Info
NABOT/5.0  Naver Japan / Korea robot   Info
nabot_1.0  Naver Japan / Korea robot   Info
NameOfAgent (CMS Spider)  Badbot searching for Wordpress wp-login.php  Info
naoFavicon4IE/1.xx  naoFavicon4IE  Info
NASA Search 1.0  Unknown spambot / harvester from diff. IPs  Info
NationalDirectory-WebSpider/1.3  Nationaldirectory spider  Info
NationalDirectoryAddURL/1.0  Nationaldirectory spider  Info
NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)  Naver Japan / Korea robot  Info
NaverBot_dloader/1.5  Naver Japan / Korea robot  Info
NavissoBot  Navisso closed beta robot (69.41.162.1xx)  Info
NavissoBot/1.7 (+http://navisso.com/)  Navisso closed beta robot (69.41.162.1xx)  Info
NCSA Beta 1 (http://vias.ncsa.uiuc.edu/viasarchivinginformation.html)  Vias Information Archival robot  Info
Nebullabot/2.2 (http://bot.nebulla.info)  Nebulla.info distributed crawler (Germany)  Info
NEC Research Agent -- compuman at research.nj.nec.com  NEC Researchindex robot - now CiteSeer.IST scientific document index  Info
NEC-Hayek/1.0  rcn.com user agent ? NEC Researchindex robot ?    Info
Net-Seekr Bot/Net-Seekr Bot V1 (http://www.net-seekr.com)  Net Seekr search robot  Info
NetAnts/1.2x  NetAnts download manager  Info
NETCOMplete/x.xx  NetComplete IE browser package  Info
NetinfoBot/1.0 (http://netinfo.bg/netinfobot.html)  Netinfo.bg search (Bulgaria) robot  Info
NetLookout/2.24  Netlookout internet notifier  Info
Netluchs/0.8-dev ( ; http://www.netluchs.de/; ___don't___spam_me_@netluchs.de)  Netluchs (Germany) search (193.164.8.xx)  Info
NetMechanic Vx.0  NetMechanic link checker  Info
NetNewsWire/2.x (Mac OS X; http://ranchero.com/netnewswire/)  NewsGator NetNewsWire - Mac RSS feed reader  Info
NetNoseCrawler/v1.0  unknown InCom (216.0.107.xx) robot  Info
Netprospector JavaCrawler  Netprospector metasearch software  Info
NetPumper/x.xx  Netpumper download manager  Info
NetResearchServer(http://www.look.com)  Look.com robot (209.87.232.x)  Info
NetResearchServer/x.x(loopimprovements.com/robot.html)  IncyWincy search engine using DMOZ database  Info
NetSeer/Nutch-0.9 (NetSeer Crawler; http://www.netseer.com; crawler@netseer.com)  NetSeer search (beta) crawler via Amazon Web Services - see also Teemer  Info
NetSprint -- 2.0  Wirtualna Polska / Netsprint search (Poland) robot  Info
NetWhatCrawler/0.06-dev (NetWhatCrawler from NetWhat.com; http://www.netwhat.com; support@netwhat.com)  NetWhat Search crawler (69.9.167.1xx)  Info
NetZippy  Netzippy robot  Info
NeuralBot/0.2  unknown    Info
newsearchengine (ThisUser@unspecified.mail)  Unknown (12.238.4.xxx) attbi.com client robot    Info
NewsGator FetchLinks extension/0.2.0 (http://graemef.com)  FetchLinks plugin for NewsGator RSS reader  Info
NewsGatorOnline/2.0 (http://www.newsgator.com; 1 subscribers)  NewsGator online RSS reader  Info
NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot)  Eliyon Crawler for Business People Search  Info
NextopiaBOT (+http://www.nextopia.com) distributed crawler client beta v0.x  Nextopia crawler  Info
NG-Search/0.90 (NG-SearchBot; http://www.ng-search.com; )  find your keywords - semantic search (Germany) robot  Info
NG/1.0  Exalead (France) search robot (193.47.80.xx)  Info
NG/4.0.1229  Exalead Websearch image crawler (193.47.80.xx)  Info
nicebot  Unknown UA from PlanetLab distributed network    Info
NICO/1.0  NicoZone childsafe search robot   R P  Info
Nikita the Spider (http://NikitaTheSpider.com/)  Nikita the Spider - Online HTML validation , link checking  Info
NITLE Blog Spider/0.01  Experimental LSI (?) robot from 140.233.69.xx (Middlebury.edu)  Info
Nitro Downloader 1.x (www.klsofttools.com)  Download manager  Info
Noago Spider  Noago spider  Info
Nocilla/1.0  telefonica.es user robot    Info
Nokia-WAPToolkit/1.2 googlebot(at)googlebot.com  Google WAP robot  Info
Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi http://find.mobi/bot.html abuse@mtld.mobi)  Botmobi crawler for Find.mobi mobile search  Info
Nokia6610/1.0 (3.09) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html)  YahooSeeker/M1A1-R2D2 - Yahoo mobile web crawling robot  Info
Nokia7110/1.0 (05.01) (Google WAP Proxy/1.0)  Google WAP proxy  Info
NokodoBot/1.x (+http://nokodo.com/bot.htm)  Nokodo public beta search robot (67.18.222.xx)  Info
Norbert the Spider(Burf.com)  Burf.com UK Search Engine robot  Info
noxtrumbot/1.0 (crawler@noxtrum.com)  noXtrum search robot (Spain)  Info
noyona_0_1  Noyona job search (preview)  Info
NP/0.1 (NP; http://www.nameprotect.com; npbot@nameprotect.com)  Nameprotect copyright search robot (24.177.134.x)  Info
NPBot (http://www.nameprotect.com/botinfo.html)  Nameprotect copyright search robot (24.177.134.x)  Info
NPBot-1/2.0  Nameprotect copyright search robot (24.177.134.x)  Info
Nsauditor/1.x  Nsauditor Network Security Auditor  Info
NSPlayer/10.0.0.xxxx WMFSDK/10.0  NetShow Media Player = Windows Media Player 10  Info
nsyght.com/Nutch-1.0-dev (nsyght.com; Nsyght.com)  Nsyght social search application  Info
nsyght.com/Nutch-x.x (nsyght.com; search.nsyght.com)  Nsyght social search application  Info
nttdirectory_robot/0.9 (super-robot@super.navi.ocn.ne.jp)  NTT Directory robot  Info
Nucleus SiteList LinkChecker/1.1  Nucleus CMS SiteList link managing plugin  Info
nuSearch Spider <a href='http://www.nusearch.com'>www.nusearch.com</a> (compatible; MSIE 4.01)  nuSearch spider (84.9.136.xxx)  Info
NuSearch Spider (compatible; MSIE 6.0)  nuSearch spider (84.9.136.xxx)  Info
NuSearch Spider www.nusearch.com  nuSearch spider (84.9.136.xxx)  Info
Nutch  Nutch open source robot  Info
Nutch crawler/Nutch-0.9 (picapage.com; admin@picapage.com)  Picapage search for handheld devices using Nutch  Info
Nutch/Nutch-0.9 (Eurobot; http://www.ayell.eu )  Ayell Euronet business directory robot using Nutch  Info
NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)  Netsweeper content filtering engine (66.207.120.2xx) powered by Nutch  Info
NutchCVS/0.0x-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)  Nutch open source robot  Info
NutchCVS/0.7.1 (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)  Robot from University of Washington Computer Science & Engineering (128.208.6.2xx)  Info
NutchEC2Test/Nutch-0.9-dev (Testing Nutch on Amazon EC2.; http://lucene.apache.org/nutch/bot.html; ec2test at lucene.com)  Amazon Elastic Compute Cloud (Amazon EC2) robot  Info
NutchOrg/0.0x-dev (Nutch; http://www.nutch.org/docs/bot.html; nutch-agent@lists.sourceforge.net)  Nutch open source robot  Info
nutchsearch/Nutch-0.9 (Nutch Search 1.0; herceg_novi at yahoo dot com)  Unknown robot using Nutch (maybe private crawling) via Cox network (70.187.130.25x)  Info
NutchVinegarCrawl/Nutch-0.8.1 (Vinegar; http://www.cs.washington.edu; eytanadar at gmail dot com)  Unknown crawler from University of Washington - Computer science  Info
obidos-bot (just looking for books.)  Weblog bookwatch robot  Info
ObjectsSearch/0.01-dev (ObjectsSearch;http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)  Objects Search robot  Info
ObjectsSearch/0.0x (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)  Objects Search robot  Info
oBot ((compatible;Win32))  Cobion Germany Brand Protection Services robot  Info
Ocelli/1.x (http://www.globalspec.com/Ocelli)  GlobalSpec Engineering Search robot (66.194.55.xxx)  Info
Octopus  Octopus download manager  Info
Octora Beta - www.octora.com  Octora blog or RSS information crawler - beta (66.228.114.xx)  Info
Octora Beta Bot - www.octora.com  Octora RSS feed search  Info
Offline Explorer 1.*  Meta Products Offlinebrowser  B D  Info
OliverPerry  Claymont robot / Internetseer Web Site Monitoring  R C  Info
OmniExplorer_Bot/1.0x (+http://www.omni-explorer.com) Internet CategorizerOmniExplorer http://www.omni-explorer.com/ car & shopping search (64.62.175.xxx)  OmniExplorer car & shopping search (64.62.175.xxx)  Info
OmniExplorer_Bot/1.0x (+http://www.omni-explorer.com) Job Crawler  OmniExplorer car & shopping search (64.62.175.xxx)  Info
OmniExplorer_Bot/1.1x (+http://www.omni-explorer.com) Torrent Crawler  OmniExplorer car & shopping search (64.62.175.xxx)  Info
OmniExplorer_Bot/x.xx (+http://www.omni-explorer.com) WorldIndexer  OmniExplorer car & shopping search (64.62.175.xxx)  Info
onCHECK Linkchecker von www.scientec.de fuer www.onsinn.de  onsearch.de German web directory link checking   Info
onCHECK-Robot, www.onsearch.de  onsearch.de German web directory link checking   Info
Onet.pl SA- http://szukaj.onet.pl  onet.pl Szukaj (Search) robot (213.180.128.1xx)  Info
online link validator (http://www.dead-links.com/)  Dead-Links.com link validation spider  Info
Online24-Bot (Version: 1.0x, powered by www.online24.de)  Online24 shopping portal (Germany) link checking  Info
OntoSpider/1.0 libwww-perl/5.65  OntoSpider - Dutch robot for a research project. (195.11.244.xx)  Info
OOZBOT/0.20 ( http://www.setooz.com/oozbot.html ; agentname at setooz dot_com )  SeetooZ search crawler  Info
Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)  Openfind.com.tw robot  Info
Openfind data gatherer- Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)  Openfind.com.tw robot  Info
Openfind Robot/1.1A2  Openfind.com.tw robot  Info
OpenISearch/1.x (www.openisearch.com)  open i search robot - search engine in development  Info
OpenTaggerBot (http://www.opentagger.com/opentaggerbot.htm)  Opentagger social bookmarking system  Info
OpenTextSiteCrawler/2.9.2  OpenText crawler  Info
OpenWebSpider/0.x.x (http://www.openwebspider.org)  OpenWebSpider - Open Source web search engine  Info
OpenWebSpider/x  OpenWebSpider - Open Source web search engine  Info
Opera/5.0 (Linux 2.0.38 i386; U) [en]  Opera 5.0 Linux  Info
Opera/5.11 (Windows ME; U) [ru]  Opera 5.11 faked WinME referer  Info
Opera/5.12 (Windows 98; U) [en]  Opera 5.12 Win98  Info
Opera/6.01 (larbin@unspecified.mail)  unknown robot from gw.ocg-corp.com (209.126.176.x)    Info
Opera/6.x (Linux 2.4.8-26mdk i686; U) [en]  Opera 6.x- Mandrake Linux  Info
Opera/6.x (Windows NT 4.0; U) [de]  Opera 6.x WinNT  Info
Opera/7.x (Windows NT 5.1; U) [en]  Opera 7.x WinXP  Info
Opera/8.xx (Windows NT 5.1; U; en)  Opera 8.x (Beta) WinXP  Info
Opera/9.0 (Windows NT 5.1; U; en)  Opera 9 (Beta) Browser  Info
Opera/9.00 (Windows NT 5.1; U; de)  Opera 9 (final)  Info
Opera/9.60 (Windows NT 5.1; U; de) Presto/2.1.1  Opera browser 9.6x on WinXP (Presto = Operas rendering engine)  Info
OpidooBOT (larbin2.6.3@unspecified.mail)  Opidoo Search Belgium robot (62.4.83.xxx)  Info
OPWV-SDK UP.Browser/7.0.2.3.119 (GUI) MMP/2.0 Push/PO  Open Wave Phone Simulator SDK  Info
Oracle Application Server Web Cache 10g  Oracle Application Server cache  Info
Oracle iMTCrawler  Oracle interMedia Text - Text and web documents indexing  Info
Oracle Ultra Search  Oracle Search  Info
OrangeSpider  Orangeslicer semantic search (Beta) Germany (193.201.52.1xx)  Info
Orbiter/T-2.0 (+http://www.dailyorbit.com/bot.htm)  Orbiter - DailyOrbit search spider  Info
Orca Browser (http://www.orcabrowser.com)  Orca browser - based on Gecko  Info
OSSProxy 1.3.305.321 (Build 305.321 Win32 en-us)(Dec 21 2005 16:30:54)  Marketscore (was Netsetter) internet accelerator  Info
OutfoxBot/0.x (For internet experiments; http://; outfox.agent@gmail.com)  Unknown robot from Chinanet (220.181.8.xxx)    Info
OutfoxMelonBot/0.5 (for internet experiments; http://; outfoxbot@gmail.com)  Unknown robot from Chinanet (60.191.80.1)    Info
Overture-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)  Overture/Fast/Alltheweb crawler (66.77.73.xxx)  Info
OWR_Crawler 0.1  Unknown robot from 198.169.127.xx (innovationplace.com)    Info
ozelot/2.7.3 (Search engine indexer; www.flying-cat.de/ozelot; ozelot@flying-cat.de)  Ozelot - Flying Cat's search engine robot (Germany)  Info
PADLibrary Spider  PADLibrary.com - PAD file software robot for FindFiles.com  Info
PageBitesHyperBot/600 (http://www.pagebites.com/)  Pagebites job search crawler  Info
Pagebull http://www.pagebull.com/  Pagebull visual search engine  Info
Pagestacker Bot  Pagestacker online bookmark service  Info
page_verifier (http://www.securecomputing.com/goto/pv)  Secure Computing SmartFilter Tools - malware crawler  Info
PagmIEDownload  Downloadmanager ?  Info
parallelContextFocusCrawler1.1parallelContextFocusCrawler1.1  CFC crawler used by Italian academic and research network (GARR)  Info
ParaSite/1.0b (http://www.ianett.com/parasite/)  http://www.ianett.com robot  Info
Patwebbot (http://www.herz-power.de/technik.html)  Patsearch (Germany) robot  Info
pavuk/0.9pl29b i686-pc-linux-gnu  Pavuk web downloading program for Unix  Info
PBrowse 1.4b  Some site scanning tool via diff. IPs- i.e.: - cox.net (68.4.xxx.xxx)  Info
pd02_1.0.0 pd02_1.0.0@dzimi@post.sk  Post.sk / Eurotel.sk robot  Info
PEAR HTTP_Request class ( http://pear.php.net/ )  Pear HTTP_Request PHP extension package    Info
PEERbot www.peerbot.com  Peerbot - favicon search robot  Info
PeopleChat/Search_Engine  Unknown robot from 64.5.48.xxx (Plethoric.net)    Info
PEval 1.4b  Some site scanning tool via diff. IPs  Info
PHP/3.x.xx  diff. IPs / services    Info
PHP/4.0.4pl1  diff. IPs / services    Info
PHP/4.0.6  diff. IPs / services- i.e.: -NTT/Verio Inc. link checker  Info
PHP/4.1.1  diff. IPs / services- i.e.: - Phenominet.com link checking  Info
PHP/4.1.2  diff. IPs / services- i.e.: - 209.114.200.xx = MyNetCrawler link checking - 216.139.207.xxx = Mixcat crawler    Info
PicoSearch/1.0  Pico Search robot  Info
Piffany_Web_Scraper_v0.x  Piffany targeted search web spider  Info
Piffany_Web_Spider_v0.x  Piffany targeted search web spider  Info
PigeonBot1.0 BETA  Whois Source domain name information robot (66.249.26.xx)- s.also: - SurveyBot  R C  Info
PingALink Monitoring Services 1.0  PingALink website monitoring  R C  Info
PingALink Monitoring Services 1.0 (http://www.pingalink.com)  PingALink website monitoring  R C  Info
Pingdom GIGRIB (http://www.pingdom.com)  Pingdom web site monitoring  Info
pipeLiner/0.3a (PipeLine Spider;http://www.pipeline-search.com/webmaster.html; webmaster'at'pipeline-search.com)  pipeline search (DMOZ based) search robot (24.106.39. xxx)  Info
pipeLiner/0.xx (PipeLine Spider; http://www.pipeline-search.com/webmaster.html)  pipeline search (DMOZ based) search robot (24.106.39. xxx)  Info
Pita  Pita crawler  Info
Pizilla++ ver 2.45  Private user-agent via Hurricane Electric Internet Services  B ?  Info
PJspider/3.0 (pjspider@portaljuice.com; http://www.portaljuice.com)  Portaljuice spider  Info
Plagger/0.x.xx (http://plagger.org/)  Plagger - pluggable RSS/Atom feed aggregator written in Perl  Info
PlagiarBot/1.0  unknown ucsd.edu robot  Info
PlantyNet_WebRobot_V1.9 dhkang@plantynet.com  Plantynet web filtering services - Blacklist DB robot  R P  Info
plinki/0.1 (you got plinked! (thats a good thing..); http://www.plinki.com; crawl@plinki.com)  Unknown UA from 66.220.23.2xx    Info
PluckFeedCrawler/2.0 (compatible; Mozilla 4.0; MSIE 5.5; http://www.pluck.com; 1 subscribers)  Pluck RSS feed crawler  Info
Pluggd/Nutch-0.9 (automated crawler http://www.pluggd.com;support at pluggd dot com)  Pluggd Podcast search engine  Info
Pockey-GetHTML/4.12.0 (Win32; GUI; ix86)  Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan  Info
Pockey-GetHTML/x.xx  Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan  Info
Pockey/x.x.x  Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan  Info
Pockey7.x.x(WIN32GUI)  Yutaka Endo's Pockey / GetHTML / GetHTMLW - some downloading tool from Japan  Info
POE-Component-Client-HTTP/0.64 (perl; N; POE; en; rv:0.640000)  HTTP user-agent for POE (portable networking framework for Perl )    Info
Poirot  ThePlanet/jaja-jak-globusy.com Google Adsense refferer spam bot from 70.85.116.* / 70.84.128.xxx / 70.85.193.xxx  Info
polybot 1.0 (http://cis.poly.edu/polybot/)  Polybot webcrawler  Info
Pompos/1.x http://dir.com/pompos.html  Dir.com / Iliad French recherche robot  Info
Pompos/1.x pompos@iliad.fr  Iliad / Free French recherche robot  Info
Popdexter/1.0  Popdex - web site popularity crawler  Info
Port Huron Labs  Unknown spam bot / harvester (63.223.10.***)  Info
PortalBSpider/2.0 (spider@portalb.com)  PortalB (now Alacra search) spider  Info
portalmmm/2.0 S500i(c20;TB)  portalmmm IMode mobile browser  Info
PostFavorites  Yahoo (66.94.237.1xx / 216.109.121.xx) favorites tracking robot  Info
potbot 1.0  Potbot : A simple IRC bot written in Perl  Info
PRCrawler/Nutch-0.9 (data mining development project; crawler@projectrialto.com)  Project Rialto - data mining development project  Info
PrivacyFinder Cache Bot v1.0  CUPS robot for AT&T Privacy Bird Privacy Preferences (P3P) enhancements  Info
PrivacyFinder/1.1  CUPS robot for AT&T Privacy Bird Privacy Preferences (P3P) enhancements  Info
Privoxy/3.0 (Anonymous)  Privoxy web proxy  Info
Production Bot 0116B  Some site scanning tool from diff. IPs- i.e.: - 67.99.33.x (lightningcon.broadwing.net)  Info
Production Bot 2016B  Some site scanning tool from diff. IPs- i.e.: - 216.232.64.xx (telus.net)  Info
Production Bot DOT 3016B  Some site scanning tool from diff. IPs- i.e.: - 141.154.181.xxx (east.verizon.net)  Info
Program Shareware 1.0.2  Some spam bot  Info
Progressive Download  unknown    Info
Progressive Download HTTP check  unknown    Info
Project XP5 [2.03.07-111203]  XP5 robot  Info
PROve AnswerBot 4.0  Answerchase PROve Answerbot  Info
ProWebGuide Link Checker (http://www.prowebguide.com)  ProWebguide robot  Info
psbot/0.1 (+http://www.picsearch.com/bot.html)  Picsearch robot (62.119.21.13x)  Info
PSurf15a 11  Some site scanning tool via diff. IPs- i.e.: QWest Net  Info
PSurf15a 51  Some site scanning tool via diff. IPs- i.e.: Optonline net (24.191.xxx.xxx)  Info
PSurf15a VA  Some site scanning tool via diff. IPs- i.e.: - choiceone.net (216.153.xxx.xxx) - attbi.com (12.250.xxx.xxx) - optonline.net (24.191.xxx.xxx)  Info
psycheclone  Unknown website grabbing / ripping for unknown purposes from 208.66.195.x - Digitalinfinity.org Russia  Info
PubCrawl (pubcrawl.stanford.edu)  Some robot from Stanford University (171.64.75.xxx = PubCrawl.Stanford.EDU)  Info
puf/0.91beta6a (Linux 2.2.18; i686)  Parallel URL Fetcher downloading tool  Info
puf/0.93.2a (Linux 2.4.18; i686)  Parallel URL Fetcher downloading tool  Info
pulseBot (pulse Web Miner)  WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)  Info
PureSight  PureSight Internet content filter  Info
PuxaRapido v1.0  Puxa Rapido download manager  Info
PWeBot/1.2 Inspector (http://www.programacionweb.net/robot.php)  ProgramacionWeb.net PWeBot link checking (Argentina)  Info
PycURL  Fast Search robot (using PycURL Python component- s. below)  Info
PycURL/7.xx.x  PycURL - Python interface to libcurl  Info
Python-urllib/1.1x  Python URL fetcher - robot used by Naver Japan/Korea  Info
Python-urllib/2.0a1  Python URL fetcher - robot used by Google  Info
Qango.com Web Directory (http://www.qango.com/)  Qango.com Web Directory robot  Info
QEAVis Agent/Nutch-0.9 (Quantitative Evaluation of Academic Websites Visibility; http://nlp.uned.es/qeavis  QEAVis: Quantitative Evaluation of Academic Websites Visibility using Nutch  Info
QPCreep Test Rig ( We are not indexing- just testing )  Quepasa!com (Latin American search) robot  Info
QuepasaCreep ( crawler@quepasacorp.com )  Quepasa!com (Latin American search) robot  Info
QuepasaCreep v0.9.1x  Quepasa!com (Latin American search) robot  Info
QueryN Metasearch  QueryN Metasearch robot  Info
Quicksilver (Blacktree,MacOSX)  Blacktrees Quicksilver helper application for Mac  Info
QuickTime\xaa.7.0.4 (qtver=7.0.4;cpu=PPC;os=Mac 10.3.9)  Quicktime for Macintosh  Info
QweeryBot/3.01 ( http://qweerybot.qweery.nl)  Qweerybot for the Qweery search engine (in development) - Netherland  Info
Qweery_robot.txt_CheckBot/3.01 (http://qweerybot.qweery.com)  Qweerybot for the Qweery search engine (in development) - Netherland  Info
R6_CommentReader_(www.radian6.com/crawler)  Radian6 RSS feed comment crawler  Info
R6_FeedFetcher_(www.radian6.com/crawler)  Radian6 Rss feed crawler  Info
rabaz (rabaz at gigabaz dot com)  gigaBaz - the brainbot (Germany) robot  Info
RaBot/1.0 Agent-admin/phortse@hanmail.net  DAUMOA - Daum search Korea robot (211.115.109.xxx)  Info
Rainbot1.1  Bot Provider for the All Womans Bot Service?    Info
ramBot xtreme x.x  Intersearch.de (was www.intersearch.de) robot (Germany)  Info
RAMPyBot - www.giveRAMP.com/0.1 (RAMPyBot - www.giveRAMP.com; http://www.giveramp.com/bot.html; support@giveRAMP.com)  giveRAMP Search Engine robot (64.69.43.1xx)  Info
RAMPyBot/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)  giveRAMP Search Engine robot (64.69.43.1xx)  Info
Rank Exec (rankexec.com) Reciprocal Link Manager 1.x/bot  Rank Exec reciprocal link checking  Info
Rankivabot/3.2 (www.rankiva.com; 3.2; vzmxikn)  Rankiva website popularity robot  Info
Rational SiteCheck (Windows NT)  Innova/IBM Rational SiteCheck - Rational robot  Info
RAYSPIDER/Nutch-0.9  Unknown spider from Raytheon Company - maybe Raytheon High Speed Guard proxy  Info
ReadABlog Spider (compatible; 1.1; feed update; www.readablog.com)  Read A Blog - RSS feed and blog search engine  Info
RealDownload/4.0.0.4x  RealDownload download manager  Info
REAP-crawler Nutch/Nutch-1.0-dev (Reap Project; http://reap.cs.cmu.edu/REAP-crawler/; Reap Project)  The REAP Web Crawler for the REAP project  Info
Reaper [2.03.10-031204] (http://www.sitesearch.ca/reaper/)  Reaper robot for SiteSearch  Info
Reaper/2.0x (+http://www.sitesearch.ca/reaper)  Reaper robot for SiteSearch  Info
REBOL Core 2.x.x.x.x  REBOL messaging language for distributed Internet apps    Info
REBOL View 1.x.x.x.x  REBOL/View - machine independent internet client application  Info
RebusnetBot (+http://www.rebusnet.biz)  Rebusnet software site - link / submission checking  R C  Info
RebusnetPADBot/1.5x (+http://www.rebusnet.biz)  Rebusnet software site - link / submission checking  R C  Info
reciprocal links checker (http://www.recip-links.com/)  Online reciprocal link checker  Info
RedBot/redbot-1.0 (Rediff.com Crawler; redbot at rediff dot com)  rediff.com search link checking  Info
RedCarpet/1.2 (http://www.redcarpet-inc.com/robots.html)  RedCarpet crawler for Pronto price comparison search(66.179.107.1xx)  Info
RedCell/0.1 (InfoSec Search Bot (Coming Soon); http://www.telegenetic.net/bot.html; lhall@telegenetic.net)  Der Bot for telegenetic.net's security related search (65.220.67.2xx)  Info
RedCell/0.1 (RedCell; telegenetic.net/bot.html; lhall_at_telegenetic.net)  Der Bot for telegenetic.net's security related search (65.220.67.2xx)  Info
RedKernel WWW-Spider 2/0 (+http://www-spider.redkernel-softwares.com/)  RedKernel Softwares robot  Info
REL Link Checker Lite x.x  REL Link Checker Lite free version of Web Link Validator  Info
RepoMonkey Bait & Tackle/v1.01  unknown    Info
Rewebber/1.2 libwww-perl/5.41  Rewebber proxy service  Info
rico/0.1  Applied Semantics Auto-Categorizer for QWestDex Direct  Info
RixBot (http://babelserver.org/rix)  RixBot Rebol Indexer for the RIX - Rebol related search (195.204.121.xx)  Info
RMA/1.0 (compatible; RealMedia)  StreamBox VCR user agent  Info
RMA/1.0 (compatible; RealMedia)  Real Media server acting as client  B P  Info
RoboCrawl (http://www.canadiancontent.net)  Canadian Content search crawler  Info
RoboCrawl (www.canadiancontent.net)  Canadian Content Search (207.44.220.xx) robot  Info
RoboPal (http://www.findpal.com/)  FindPal Australia metasearch robot (61.68.139.xx)  Info
Robot/www.pj-search.com  PopJapanSearch robot  Info
Robot: NutchCrawler- Owner: wdavies@acm.org  Experimental robot using Wget via attbi.net  Info
Robot@SuperSnooper.Com  Supersnooper robot  Info
Robozilla/1.0  Netscape Directory / DMOZ Open Directory link crawler  Info
Rome Client (http://tinyurl.com/64t5n) Ver: 0.9  ROME - Open source Java tools for RSS and Atom feeds  Info
Rotondo/3.1 libwww/5.3.1  Qualigo.de robot  Info
RPT-HTTPClient/0.3-x  different IPs using the HTTPClient library (mostly link checking)  Info
RRC (crawler_admin@bigfoot.com)  Metacarta.com (66.28.xx.xxx) robot  Info
RssBandit/1.5.0.10 (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; http://www.rssbandit.org) (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; )  RSS Bandit RSS/Atom reader for .NET framework  Info
RSSMicro.com RSS/Atom Feed Robot  RSS Micro Search - RSS feed search engine  Info
RSSOwl/1.2.3 2006-11-26 (Windows; U; zhtw)  RSSOwl embedded RSS feed reader  Info
RSSOwl/1.2.4 Preview Release 2007-04-15 (Windows; U; zhtw)  RSSOwl embedded RSS feed reader  Info
RssReader/1.0.xx.x (http://www.rssreader.com) Microsoft Windows NT 5.1.2600.0  Ykoon RssReader news feed reader  Info
RSurf15a 41  Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com  Info
RSurf15a 51  Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com  Info
RSurf15a 81  Some site scanning tool via diff. IPs- i.e.: - dslx.net (208.35.1x.xxx) - Home.com  Info
Rubbot/1.0 (+http://rubhub.com/)  rubhub blog spider  Info
RufusBot (Rufus Web Miner; http://64.124.122.252/feedback.html)  WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)  Info
RufusBot (Rufus Web Miner; http://www.webaroo.com/rooSiteOwners.html)  WebarooBot - Webaroo web site search / theme based downloading tool (64.124.122.2xx)  Info
Rumours-Agent  unknown robot from rumours.jp (202.214.69.xxx)    Info
RX Bar  RX (Reflexive Search) Bar for IE  Info
S&L Spider (http://search.hirners.com/)  Search & Links directory spider  Info
S.T.A.L.K.E.R. (http://www.seo-tools.net/en/bot.aspx)  SEO-Tools.net link checking ?  Info
SafariBookmarkChecker (+http://www.coriolis.ch/)  SafariBookmarkChecker for Mac OS X  Info
sait/Nutch-0.9 (SAIT Research; http://www.samsung.com)  sait robot - unknown robot from Samsung International Korea  Info
SandCrawler - Compatibility Testing  Sandcrawler robot from Microsoft (131.107.0.xx)  Info
SapphireWebCrawler/1.0 (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)  Sapphire Web Crawler from Carnegie Mellon University's Language Technologies Institute  Info
SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch; http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu)  Sapphire Web Crawler from Carnegie Mellon University's Language Technologies Institute  Info
savvybot/0.2  WebSavvy Directory robot  Info
SBIder/0.7 (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)  SiteSell SBIder Nutch based crawler  Info
SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)  SiteSell SBIder Nutch based crawler  Info
SBL-BOT (http://sbl.net)  Softbyte Labs Black Widow web site ripper  D B  Info
ScanWeb  ScanWeb - regular expression based web page searching tool  Info
ScholarUniverse/0.8 (Nutch;+http://scholaruniverse.com/bot.jsp; fetch-agent@scholaruniverse.com)  ScholarUniverse - Scholarly experts search robot  Info
schwarzmann.biz-Spider_for_paddel.org+(http://www.innerprise.net/usp-spider.asp)  URL Spider Pro (USP) used by German Schwarzmann GmbH  Info
Science Traveller International 1X/1.0  1X Web Browser  Info
ScollSpider/2.0 (+http://www.webwobot.com/ScollSpider.php)  WebWobot UK search engine robot (82.43.129.2xx)  Info
Scooter-3.0.EU  Altavista robot  Info
Scooter-3.0.FS  Altavista robot  Info
Scooter-3.0.HD  Altavista robot  Info
Scooter-3.0.VNS  Altavista robot  Info
Scooter-3.0QI  Altavista robot  Info
Scooter-3.2  Altavista robot  Info
Scooter-3.2.BT  Altavista robot  Info
Scooter-3.2.DIL  Altavista robot  Info
Scooter-3.2.EX  Altavista robot  Info
Scooter-3.2.JT  Altavista robot  Info
Scooter-3.2.NIV  Altavista robot  Info
Scooter-3.2.SF0  Altavista robot  Info
Scooter-3.2.snippet  Altavista robot  Info
Scooter-3.3dev  Altavista robot  Info
Scooter-ARS-1.1  Altavista robot  Info
Scooter-ARS-1.1-ih  Altavista robot  Info
scooter-venus-3.0.vns  Altavista robot  Info
Scooter-W3-1.0  Altavista robot  Info
Scooter-W3.1.2  Altavista robot  Info
Scooter/1.0  Altavista robot  Info
Scooter/1.0 scooter@pa.dec.com  Altavista robot  Info
Scooter/1.1 (custom)  Altavista robot  Info
Scooter/2.0 G.R.A.B. V1.1.0  Altavista robot  Info
Scooter/2.0 G.R.A.B. X2.0  Altavista robot  Info
Scooter/3.3  Altavista robot  Info
Scooter/3.3.QA.pczukor  Altavista robot  Info
Scooter/3.3.vscooter  Altavista robot  Info
Scooter/3.3_SF  Altavista robot  Info
Scooter2_Mercator_x-x.0  Altavista using Mercator robot  Info
Scooter_bh0-3.0.3  Altavista robot  Info
Scooter_trk3-3.0.3  Altavista robot  Info
Scope (Mars+)  Scope Navigator mobile browser (Japan)  Info
ScoutAbout  Some nec.com robot using Research Republic ScoutAbout Research Tool  Info
ScoutAnt/0.1; +http://www.ant.com/what_is_ant.com/  Ant.com search robot  Info
scoutmaster  ScoutMaster information retrieval software  Info
Scrubby/2.x (http://www.scrubtheweb.com/)  Scrub the web robot (66.93.156.xx)  Info
Scrubby/3.0 (+http://www.scrubtheweb.com/help/technology.html)  Scrub the web robot (66.93.156.xx)  Info
Search+  URL Search+ search software  Info
Search-Engine-Studio  Xtreem Search Engine Studio - SE software  Info
search.ch V1.4  Search.ch robot  Info
search.ch V1.4.2 (spiderman@search.ch; http://www.search.ch)  Search.ch robot  Info
Search/1.0 (http://www.innerprise.net/es-spider.asp)  Enterprise Search web indexing / site searching tool  Info
searchbot admin@google.com  Unknown robot / website grabber from Chinatelecom (219.142.78.xxx)  Info
SearchByUsa/2 (SearchByUsa; http://www.SearchByUsa.com/bot.html; info@SearchByUsa.com)  SearchByUSA robot (69.150.7.xxx)  Info
SearchdayBot  Searchday (Germany) search robot  Info
SearchExpress Spider0.99  Searchexpress spider  Info
SearchGuild/DMOZ/Experiment (searchguild@gmail.com)  Searchguild forum & directory robot (81.3.75.xxx)  Info
SearchGuild_DMOZ_Experiment (chris@searchguild.com)  Searchguild forum & directory robot (81.3.75.xxx)  Info
Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)  Searchit robot (69.93.107.xx)  Info
Searchmee! Spider v0.98a  Searchmee! Search Engine (prototype) robot by findanisp.com  Info
SearchSight/2.0 (http://SearchSight.com/)  SearchSight search robot  Info
SearchSpider.com/1.1  SearchSpider robot  Info
Searchspider/1.2 (SearchSpider; http://www.searchspider.com; webmaster@searchspider.com)  SearchSpider robot  Info
SearchTone2.0 - IDEARE  Janas (Ideare.com / Tiscali.it) robot  Info
Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/0.3  seekport. beta search (Germany) robot  Info
Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0 (XDF)  seekport. beta search (Germany) robot  Info
Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.2  seekport. beta search (Germany) robot  Info
Seeker.lookseek.com  Lookseek search robot / link checking  Info
semaforo.net  semaforo.net web filtering software  Info
Semager/1.1 (http://www.semager.de/blog/semager-bots/)  Semager.de (was NG-Search) semantic search - Germany  Info
Semager/1.x (http://www.semager.de)  Semager.de (was NG-Search) semantic search - Germany  Info
semanticdiscovery/0.x  Semantic Discovery domain checking tool  R C  Info
Sensis Web Crawler (search_comments\at\sensis\dot\com\dot\au)  Sensis Australia search robot  Info
Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)  Sensis Australia search robot  Info
SeznamBot/1.0  Seznam Search (Czech Republic) robot  Info
SeznamBot/1.0 (+http://fulltext.seznam.cz/)  Seznam Search (Czech Republic) robot  Info
SeznamBot/2.0-test (+http://fulltext.sblog.cz/)  Seznam Search (Czech Republic) robot  Info
ShablastBot 1.0  Unknown robot from Shablast.com - Website has no content - Ignores robots.txt  Info
Shareaza v1.x.x.xx  Shareaza P2P peer-to-peer download client  D B  Info
SharewarePlazaFileCheckBot/1.0+(+http://www.SharewarePlaza.com)  SharewarePlaza File Check Bot - link checking  R C  Info
Shim Crawler  Chikayama-Taura Lab Shim-Crawler used for The Kototoi Project (Japan) - (133.11.36.xx)  Info
Shim-Crawler(Mozilla-compatible; http://www.logos.ic.i.u-tokyo.ac.jp/crawler/; crawl@logos.ic.i.u-tokyo.ac.jp)  Chikayama-Taura Lab Shim-Crawler used for The Kototoi Project (Japan) - (133.11.36.xx)  Info
ShopWiki/1.0 ( +http://www.shopwiki.com/)  ShopWiki shopping search based on LittleWiki search  Info
ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)  ShopWiki shopping search based on LittleWiki search  Info
Shoula.com Crawler 2.0  Shoula Search Engine crawler  Info
SietsCrawler/1.1 (+http://www.siets.biz)  Siets Crawler - Web based site crawling application  Info
Sigram/Nutch-1.0-dev (Test agent for Nutch development; http://www.sigram.com/bot.html; bot at sigram dot com)  Sigram's Nutch robot - crawler testing  Info
Siigle Orumcex v.001 Turkey (http://www.siigle.com)  Siigle search (Turkey) robot  Info
silk/1.0  Slider Search directory robot (194.213.194.2xx)  Info
silk/1.0 (+http://www.slider.com/silk.htm)/3.7  Slider Search directory robot (194.213.194.2xx)  Info
SimpleFavPanel/1.2  SimpleFavPanel - IE newsfeed panel plugin  Info
Simpy 1.x; http://www.simpy.com/  Simpy bookmarking and personal search engine  R C  Info
Simpy/1.x (Simpy; http://www.simpy.com/?ref=bot; feedback at simpy dot com)  Simpy bookmarking and personal search engine  R C  Info
Sirketcebot/v.01 (http://www.sirketce.com/bot.html)  Sirketçe search - Turkey  Info
SiteBar/3.x.x (Bookmark Server; http://sitebar.org/)  SiteBar online bookmark manager  Info
SiteBar/x.x  SiteBar bookmark server  Info
SiteBar/x.x.x (Bookmark Server; http://sitebar.org/)  SiteBar bookmark server  Info
sitecheck.internetseer.com  Internetseer Web Site Monitoring / Claymont robot  R C  Info
sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)  Internetseer Web Site Monitoring  R C  Info
SiteRecon+(xx)  SiteRecon website monitoring spider at xx minute intervals  R C  Info
SiteSnagger  PC Magazin web site downloadmanager  Info
SiteSpider +(http://www.SiteSpider.com/)  Site Spider robot (66.249.17.xx)  Info
SiteSucker/1.x.x  SiteSucker Mac website downloading tool  Info
SiteTaggerBot (http://www.sitetagger.com/bot.htm)  SiteTagger.com bookmark organizer  Info
SiteTruth.com site rating system  SiteTruth - Automatic site legitimacy rating system  Info
SiteWinder  Webwasher.com (217.146.159.xx) internet filter  B P  Info
SiteXpert  Xtreeme SiteXpert sitemap & search engine builder  Info
Skampy/0.9.x (http://www.skaffe.com/skampy-info.html)  Skaffe.com directory link checker  Info
Skimpy/0.x (http://www.skaffe.com/skampy-info.html)  Skaffe.com directory link checker  Info
Skywalker/0.1 (Skywalker; anonymous; anonymous)  Visvo distributed website crawler based on Nutch  Info
Slarp/0.1  Only.com robot  Info
Sleipnir  Sleipnir - Japanese Explorer based browser & search bar  Info
Sleipnir Version 1.xx  Sleipnir - Japanese Explorer based browser & search bar  Info
Sleipnir Version2.x  Sleipnir - Japanese Explorer based browser & search bar  Info
Sleipnir/2.xx  Sleipnir - Japanese Explorer based browser & search bar  Info
Slider_Search_v1-de  Slider Search directory robot (194.213.194.2xx)  Info
SlimBrowser  Slim Browser (IE based browser) - uses this user agent for favicon.ico only  Info
Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html)  Inktomi (Hotbot-Lycos-NBCi) robot  Info
Slurp/2.0-KiteWeekly (slurp@inktomi.com; http://www.inktomi.com/slurp.html)  Inktomi (Hotbot-Lycos-NBCi) robot  Info
Slurp/si (slurp@inktomi.com; http://www.inktomi.com/slurp.html)  Inktomi (Hotbot-Lycos-NBCi) robot  Info
Slurpy Verifier/1.0  Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x)  Info
SlySearch (slysearch@slysearch.com)  Slysearch robot (now Turnitin robot)  Info
SlySearch/1.0 http://www.plagiarism.org/crawler/robotinfo.html  Slysearch robot (now Turnitin robot)  Info
SlySearch/1.x http://www.slysearch.com  Slysearch robot (now Turnitin robot)  Info
SmartDownload/1.2.67 (Win32; Jan 12 1999)  Netzip/Smartdownload download manager  Info
SmartDownload/1.2.77 (Win32; Feb 1 2000)  Netzip/Smartdownload download manager  Info
SmartDownload/1.2.77 (Win32; Jun 19 2001)  Netzip/Smartdownload download manager  Info
smartwit.com  Loop Improvements NRS Enterprise search (69.44.155.xx[x])  Info
SmiffyDCMetaSpider/1.0  SmiffyDCMetaSpider - Robot to check the retro-adding of Dublin Core metadata  Info
sna-0.0.1 (mikemuzio@msn.com)  Snoopy PHP-client    Info
sna-0.0.1 mikeelliott@hotmail.com  Snoopy PHP-client    Info
snap.com beta crawler v0  Unknown bot from bb2.net (66.234.139.xxx) also as Snapbot/1.0  Info
Snapbot/1.0  Unknown bot from bb2.net (66.234.139.xxx) - also as snap.com  Info
Snapbot/1.0 (Snap Shots, +http://www.snap.com)  Unknown bot from Psinet / Cogentco - not from Snap.com  Info
Snappy/1.1 ( http://www.urltrends.com/ )  My UrlTrends online web ranking service  Info
Snarfer/0.x.x (http://www.snarfware.com/)  Snarfer RSS reader  Info
SnoopRob/x.x  Unknown robot from 217.229.156.xx (T-Online Germany)    Info
Snoopy v1.xx  Snoopy PHP-client    Info
Snoopy v1.xx- : User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MyIE2)  Snoopy PHP-client    Info
Snoopy_v0.xx  Snoopy PHP-client    Info
SnykeBot/0.6 (http://www.snyke.com)  Snyke.com France robot  Info
SocSciBot ()  Link crawler for the social sciences  Info
SoftBank/1.0/812SH/SHJ001 Browser/NetFront/3.3 Profile/MIDP-2.0 Configuration/CLDC-1.1  NetFront browser on Softbank mobile phone  Info
SoftHypermarketFileCheckBot/1.0+(+http://www.softhypermaket.com)  Soft Hypermarket link checking  Info
Softizerbot (http://www.softizer.com)  Softizer.com software directory link checking  Info
sogou develop spider  Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot  Info
Sogou Orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)  Unknown UA from Chinanet (220.181.18.xx) faking Sogou search robot  Info
sogou spider  Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot  Info
Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)  Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot  Info
sohu agent  Unknown UA from Chinanet (220.181.26.1xx) faking Sogou search robot  Info
sohu-search  Sohu (Search Fox) search robot China (61.135.131.xxx)  Info
Sosospider+(+http://help.soso.com/webspider.htm)  SOSO search (China) spider  Info
Space Bison/0.02 [fu] (Win67; X; SK)  Default Proxomitron (discontinued) filtering proxy user agent identifier  P B  Info
SpeedDownload/1.x  Speed Download (Mac) download manager  Info
speedfind ramBot xtreme 8.1  Speedfind.de robot  Info
Speedy Spider (Beta/x.x; speedy@entireweb.com)  Entireweb search robot  Info
Speedy Spider (Entireweb; Beta/1.0; http://www.entireweb.com/about/search_tech/speedyspider/)  Entireweb search spider  Info
Speedy_Spider (http://www.entireweb.com)  Entireweb search robot  Info
Sphere Scout&v4.0 - scout at sphere dot com  Sphere blog and news search robot  Info
Sphider  Sphider - a lightweight search engine in PHP  Info
Spida/0.1  Only.com robot  Info
Spider-Sleek/2.0 (+http://search-info.com/linktous.html)  Search-Info ODP/DMOZ spider  Info
spider.batsch.com  Batsch robot  Info
Spider.TerraNautic.net - v:1.04  TerraNautic spider for Schnellsuchen touristic search (Germany)  Info
spider.yellopet.com - www.yellopet.com  Yellopet spider  Info
Spider/maxbot.com admin@maxbot.com  Maxbot .gov .mil .edu indexing robot  Info
SpiderKU/0.x  Unknown robot from CPE at Kasetsart University (158.108.35.xxx)  Info
SpiderMan  Yahoo Search user agent or spider (202.165.102.xxx)  Info
SpiderMonkey/7.0x (SpiderMonkey.ca info at http://spidermonkey.ca/sm.shtml)  SpiderMonkey Canada robot  Info
Spinne/2.0  Spider.de robot  Info
Spinne/2.0 med  Medkatalog (medical catalogue) Austria robot  Info
Spinne/2.0 med_AH  Medkatalog (medical catalogue) Austria robot  Info
Spock Crawler (http://www.spock.com/crawler)  Spock - people search application - via Amazon web services  Info
sportsuchmaschine.de-Robot (Version: 1.02- powered by www.sportsuchmaschine.de)  Sportsuchmaschine (German sports related search) link checking / robot  Info
sproose/0.1-alpha (sproose crawler; http://www.sproose.com/bot.html; crawler@sproose.com)  Sproose personalized search (38.100.225.xx)  Info
SQ Webscanner  SQ Webscanner Mac download manager  Info
Squid-Prefetch  Simple page-prefetch for Squid web proxy  Info
squidclam  Squidclam is a replacement for SquidClamAV-Redirector  Info
SquidClamAV_Redirector 1.x.x  SCAVR - Squid helper script for scanning download URLs for viruses  Info
Sqworm/2.9.81-BETA (beta_release; 20011102-760; i686-pc-linux-gnu)  AOL Search / Pacific Internet Exchange robot  Info
Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu)  diff. IPs / services i.e.: - Inria.fr robot - Websense (Internet filtering) robot  Info
Sqworm/2.9.89-BETA (beta_release; 20020130-839; i686-pc-linux-gnu)   Time Warner Telecom user robot ?    Info
SSurf15a 11   Some site scanning tool via diff. IPs i.e.: - choiceone.net (216.153.xxx.xxx) - epix.net (216.108.198.xx)  Info
StackRambler/x.x   Rambler search (Russia) robot (81.19.6x.xx)  Info
Stamina/1.4  Stamina download manager  Info
Star Downloader  Star Downloader download manager  Info
StarDownloader/1.xx  Star Downloader download manager  Info
stat statcrawler@gmail.com  Experimental search engine spider from 66.92.186.xxx  Info
Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)  Steeler crawler  Info
Steeler/3.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)  Steeler - University of Tokyo web crawler  Info
Strategic Board Bot (+http://www.strategicboard.com)  Strategic Board blog & news search robot  Info
Strategic Board Bot (+http://www.strategicboard.com)  Strategic Board blogs and news aggregator robot  Info
Submission Spider at surfsafely.com  Surfsafely submission verifier  Info
suchbaer.de  Suchbaer.de (Germany) search robot  Info
suchbaer.de (CrawlerAgent v0.103)  Suchbaer.de (Germany) search robot  Info
suchbot  Suchbot Germany robot  Info
Suchknecht.at-Robot  Suchknecht Austria robot  Info
suchpadbot/1.0 (+http://www.suchpad.de)  suchpad search Germany robot (213.239.194.xx)  Info
Sunrise XP/2.x  Sunrise XP handheld news / website reader and converter  Info
Sunrise/0.42g (Windows XP)  Sunrise XP web sites and newsfeeds converter and handheld reader  Info
SuperBot/x.x (Win32)  SuperBot website copier  Info
SuperBot/x.x.x.xx (Windows XP)  SuperBot website copier  Info
Superdownloads Spiderman  Ubbi Superdownloads (Brazil) link checking  Info
SURF   SurfControl Web Filtering  Info
SurferF3 1/0  Wanadoo Rechereche robot  Info
SurfMaster  Maskbit Surfmaster bookmark tool  Info
SurveyBot/2.2 <a href='http://www.whois.sc'>Whois Source</a>  Whois Source domain name information robot (66.249.26.xx)  R C  Info
SurveyBot/2.3 (Whois Source)  Whois Source domain name information robot (66.249.26.xx)  R C  Info
suzuran  Yokogao Search Engine robot (Kanazawa University)  Info
SWB/V1.4 (HP)  HP Secure Web Browser for OpenVMS  Info
swbot/0.9c libwww/5.3.1  unknown    Info
Swooglebot/2.0. (+http://swoogle.umbc.edu/swooglebot.htm)  Swooglebot Swoogle's semantic web crawler  Info
SWSBot-Images/1.2 http://www.smartwaresoft.com/swsbot12.html  SWSBot - SmartWareSoft (85.186.255.xx) software search engine created for Playfuls.com  Info
SygolBot http://www.sygol.net  Sygol Search (Italy) robot  Info
Sylera/1.2.x  Sylera browser (Japan)  Info
SyncBot  Mindspring.com user robot    Info
SyncIT/x.x  SyncIT link validation  Info
Syndirella/0.91pre  Syndirella desktop information aggregator (beta)  Info
SynoBot  Synomia (France) robot  Info
Syntryx ANT Scout Chassis Pheromone; Mozilla/4.0 compatible crawler  Syntryx Solution Suite - domain / keyword crawler (216.7.179.xx)  Info
Szukacz/1.x  Szukacz.pl (Polish search) robot  Info
Szukacz/1.x (robot; www.szukacz.pl/jakdzialarobot.html; szukacz@proszynski.pl)  Szukacz.pl (Polish search) robot  Info
A - F & Additions
G - L
M
N - S
T - Z

Legend
B
(Client) browser
C
Link-, bookmark-, server- checking
D
Downloading tool
P
Proxy server, web filtering
R
Robot, crawler, spider
S
Spam or bad bot

© 2002-2010Andreas Staeding

a Psychedelix.com product

Home || Links || Banners || Feedback & Additions || E-Mail