Community | Forum Insider: Does the Cuil search engine love forums? - Community | Forum Insider

Jump to content

Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic

Does the Cuil search engine love forums?

#1 User is offline   Dan Icon

  • Administrator
  • Icon
  • View blog
  • Group: Editors
  • Posts: 148
  • Joined: 04-January 10
  • LocationLeeds, UK

Posted 21 January 2010 - 10:33 PM

I've just been having a look at our access logs here on ForumInsider.com, and noticed that Cuil has been going nuts here. The forum has had 840 hits from Cuil's Twiceler bot today alone, more than by blog (which is bigger, older, has more content and has had more exposure than this site) has ever had. In total, Cuil has hit this site over 4,500 times in the few short weeks it has been open.

Has anyone else noticed this kind of activity with the Twiceler bot? If so, is it a short spike or does Cuil really just love forum content?
0

#2 User is offline   David McHenry Icon

  • Newbie
  • Pip
  • Group: Members
  • Posts: 6
  • Joined: 21-January 10

Posted 21 January 2010 - 11:11 PM

It seems they do, they went completely off the wall (and still are crawling feverishly) at my vBulletin based forum. I'm not sure if it's because it's new or what, but also like you I've got older more established sites that don't see much action from Cuil.

But I've yet to see any traffic come from them on any of my sites, so it's probably I'll be blocking (or at least slowing down) them in the very near future.
0

#3 User is offline   Andy Icon

  • Newbie
  • Pip
  • Group: Members
  • Posts: 3
  • Joined: 05-January 10
  • LocationDerby, UK

Posted 25 February 2010 - 09:30 PM

I blocked it on one of my friends sites as it appeared (checking the IP's) to be assuming 80+ sessions at once and their server was struggling as it was. I'll probably unblock it and set a sensible crawl limit in a few days to see.

On my site, it has behaved perfectly though. :)
Andy Posted Image
0

Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users