unidentifed spiders/search eng/browsers

WassUp Forums » WassUp Support

unidentifed spiders/search eng/browsers

(4 posts) (2 voices)

Started 3 years ago by helene
Latest reply from helene

Tags:

helene
Moderator

Hi Michele,

I think Wassup is a great plugin and I am completely addicted to it.
But in the interest of keeping Wassup stats accurate, here's a list of some bots/feeds/search engines/browsers that Wassup currently does not recognize:
------------------
Unidentified Bots:

64.40.117.39 /
2008-01-04 15:11:17 Referer: Direct hit
Hostname: sphere.com
UserAgent: Sphere Scout&v4.0 - scout at sphere dot com
OS: N/A N/A BROWSER: N/A

64.158.138.84 /robots.txt
2008-01-04 04:02:21 Referer: Direct hit
Hostname: floodgate.intelliseek.com
UserAgent: BlogPulseLive (support@blogpulse.com)
OS: N/A N/A BROWSER: N/A

207.171.167.25 /robots.txt
2008-01-03 21:37:33 Referer: Direct hit
Hostname: iad-fw-global.amazon.com
UserAgent: Mozilla/5.0 (compatible; AMZNKAssocBot/4.0)
OS: N/A N/A BROWSER: N/A

82.99.30.22 /50/
2008-01-05 22:47:36 Referer: Direct hit
Hostname: 82.99.30.22
UserAgent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
OS: Windows XP BROWSER: MSIE 6.0
This is the Munax.com crawler that has been hitting my site from the IP range 82.99.30.0/25. It deliberately does not identify itself as a bot and does not obey robots.txt. In Wassup, it skews the Top OS/Top Browser stats.

77.88.23.137 /
2008-02-05 05:32:54 Referer: Direct hit
Hostname: walrus031.yandex.ru
UserAgent: Yandex/1.01.001 (compatible; Win16; H)
OS: N/A N/A BROWSER: N/A
* 05:32:54 ->/robots.txt

208.109.189.127 /robots.txt
2008-02-06 10:43:23 Referer: http://supernatural.hellioness.com/imagegallery/
Hostname: ip-208-109-189-127.ip.secureserver.net
UserAgent: Mozilla/5.0 (compatible; heritrix/1.12.0 +http://www.picmole.com)
OS: N/A N/A BROWSER: N/A

----------------------------
Unidentified Feed Reader UA:

205.175.123.102 /feed/
2008-01-04 21:12:42 Referer: Direct hit
Hostname: p172-28-102-0.nat.washington.edu
UserAgent: Firefox/2.0.0.6 (Ubuntu-feisty)
OS: N/A N/A BROWSER: N/A

83.132.17.98 /feed/
2008-01-12 19:15:09 Referer: Direct hit
Hostname: a83-132-17-98.cpe.netcabo.pt
UserAgent: veoh-??0 service (NT 5.1; IE 6.0.2900.2180; en-US Windows)
us OS: N/A N/A BROWSER: N/A
I had multiple hits from this mystery feedreader before an actual visit to my site (with WinXP/IE6) from the same IP.

----------------------------
Unidentified Search Engines:

68.186.178.8 /
2008-01-09 18:16:05 Referrer: http://www.goodsearch.com/Search.aspx?Keywords=supernatural online petition&Source=mozillaplugin
Hostname: 68-186-178-8.dhcp.leds.al.charter.com
UserAgent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11
us OS: Windows XP BROWSER: Mozilla Firefox 2.0.0.11

65.33.183.250 /87/
2008-02-18 18:28:33 Referrer: http://blogsearch.google.com/blogsearch?hl=en&client=news&ie=UTF-8&scoring=d&q=Mystery-Spot Sam Dean Jared&sa=N&start=20
Hostname: 250.183.33.65.cfl.res.rr.com
UserAgent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
OS: Windows XP BROWSER: MSIE 6.0

----------------------
Unidentified Browsers:

71.255.194.93 /
2008-01-04 05:15:48 Referer: Direct hit
Hostname: pool-71-255-194-93.bltmmd.east.verizon.net
UserAgent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en) AppleWebKit/522.15.5 (KHTML, like Gecko) Version/3.0.3 Safari/522.15.5
OS: Windows XP BROWSER: N/A <--- should say Safari

71.200.219.12 /
2008-02-05 06:47:46 Referer: http://supernatural.hellioness.com/
Hostname: c-71-200-219-12.hsd1.fl.comcast.net
UserAgent: Mozilla/5.0 (Windows; U; Win 9x 4.90) Gecko/20020502 CS 2000 7.0/7.0
OS: N/A N/A BROWSER: N/A

-Helene D.
http://techfromhel.webege.com

Posted 3 years ago #
Michele
Key Master

Thank you Helene, I opened a ticket on the wiki so everybody can add their. (http://trac.wpwp.org/ticket/38)

Michele - WassUp Project

Posted 3 years ago #
helene
Moderator

Cool! I already added a new one to the ticket.

Posted 3 years ago #
helene
Moderator

Just an FYI.
While looking at Wassup's detail screen, I noticed a significant number of visitors on my site with Windows/IE user agents that were moving from page to page too quickly to be human (2 secs or less between hits). Here's an example:
206.45.82.241 /
2008-02-28 23:47:55 Referer: Direct hit
Hostname: 206-45-82-241.static.mts.net
UserAgent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)
OS: Windows NT BROWSER: MSIE 5.0
23:47:42 ->/feed
23:47:43 ->/feed/atom
23:47:43 ->/about/showinfo
23:47:45 ->/imagegallery
23:47:47 ->/forumlinks
23:47:48 ->/fanfiction
23:47:50 ->/episodeguide
23:47:51 ->/tech-tools
23:47:53 ->/88
23:47:54 ->/87
23:47:55 ->/86

There is nothing that Wassup can do about these bad bots. I personally try to block them by IP in my .htaccess file, but that is like using pebbles to make a dam. I just wanted to let everyone know that top ten stats for OS and Browsers can be distorted by these bots that hide behind browser user-agents.

I found this great web site that has a database of user-agents from both browsers and bots, including those that attempt to disguise themselves. It is called BotsVsBrowsers.com. It even has the UA's of the latest internet-ready mobile devices which I am getting more hits from everyday.

Posted 3 years ago #

RSS feed for this topic

Reply

You must log in to post.