IAB/ABC International Spiders & Bots List

Questions about ScientiaMobile WURFL InSight

IAB/ABC International Spiders & Bots List

Postby rsmith » Tue Dec 30, 2014 3:03 pm

Does WURFL make use of the IAB/ABC International Spiders & Bots List to identify bots?

Here are some example of devices and user-agents that WURFL seems to classify wrongly.
device_type, user_agent
-----
apple-iphone,Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
apple-iphone,Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; http://www.bing.com/bingbot.htm)
genericwebbrowser,Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; CrystalSemanticsBot http://www.crystalsemantics.com/service ... useragent/)
rsmith
 
Posts: 2
Joined: Tue Dec 30, 2014 2:51 pm

Re: IAB/ABC International Spiders & Bots List

Postby Elliotfehr » Tue Dec 30, 2014 3:46 pm

Hello,

Thank you for letting us know. I will pass these User Agents to our device detection team and will let you know as soon as a fix is available.

Thank you,

Elliot
Elliotfehr
 

Re: IAB/ABC International Spiders & Bots List

Postby rsmith » Tue Dec 30, 2014 3:52 pm

Thanks - Those are only a few of the user-agents, we see several more.

Do you use the latest IAB/ABC International Spiders & Bots List to identify bots? If not, can you include that in the API?
rsmith
 
Posts: 2
Joined: Tue Dec 30, 2014 2:51 pm

Re: IAB/ABC International Spiders & Bots List

Postby Elliotfehr » Tue Dec 30, 2014 4:53 pm

Hello,

The `is_robot` virtual capability currently looks at several HTTP headers to determine bot traffic, since the User Agent alone can sometimes be deceiving for some bot traffic. I will have to check with the data analytics team in regards to the inclusion of the IAB Spiders & Bots list and will also let you know the response.

In the meantime, would you mind providing any other User Agents that you are having difficulty detecting?

Thank you,

Elliot
Elliotfehr
 

Re: IAB/ABC International Spiders & Bots List

Postby Elliotfehr » Wed Jan 07, 2015 2:56 pm

Hello,

While these User Agents will return the ID of the device, they should return true for `is_robot`. Are you able to confirm whether or not this is the case for you as well?

Thank you,

Elliot
Elliotfehr
 

Re: IAB/ABC International Spiders & Bots List

Postby masaruta4at » Sat Feb 06, 2016 4:40 am

masaruta4at
 
Posts: 1
Joined: Mon Sep 07, 2015 2:13 am


Return to ScientiaMobile WURFL InSight

Who is online

Users browsing this forum: No registered users and 1 guest

cron