I've just been having a look at our access logs here on ForumInsider.com, and noticed that Cuil has been going nuts here. The forum has had 840 hits from Cuil's Twiceler bot today alone, more than by blog (which is bigger, older, has more content and has had more exposure than this site) has ever had. In total, Cuil has hit this site over 4,500 times in the few short weeks it has been open.
Has anyone else noticed this kind of activity with the Twiceler bot? If so, is it a short spike or does Cuil really just love forum content?
Page 1 of 1
Does the Cuil search engine love forums?
#2
Posted 21 January 2010 - 11:11 PM
It seems they do, they went completely off the wall (and still are crawling feverishly) at my vBulletin based forum. I'm not sure if it's because it's new or what, but also like you I've got older more established sites that don't see much action from Cuil.
But I've yet to see any traffic come from them on any of my sites, so it's probably I'll be blocking (or at least slowing down) them in the very near future.
But I've yet to see any traffic come from them on any of my sites, so it's probably I'll be blocking (or at least slowing down) them in the very near future.
Hey I'm David McHenry and I run a Digital Photography Forum.
@davemchenry - Sundance Studios Senior Photography
@davemchenry - Sundance Studios Senior Photography
#3
Posted 25 February 2010 - 09:30 PM
I blocked it on one of my friends sites as it appeared (checking the IP's) to be assuming 80+ sessions at once and their server was struggling as it was. I'll probably unblock it and set a sensible crawl limit in a few days to see.
On my site, it has behaved perfectly though.
On my site, it has behaved perfectly though.
Andy
Page 1 of 1


Sign In
Register
Help


Back to top
MultiQuote