How big did you say? I am often contacted by prospective clients to help them crawl the web on a very large scale or find questions such...

It's been a while since I last blogged, in particular about Behemoth .  For those who don't know about it, Behemoth is an open sou...

Behemoth is an open-source platform for document processing based on Hadoop which provides an excellent way to process document collection...