StormCrawler holds the frontier and the page fetch status in the "status" index. It's a sharded Elasticsearch index (in the...

StormCrawler 1.14 was released yesterday and as usual, contains loads of improvements and bugfixes. You can find the full list of cha...

We are opening a series of Q&A blogs with Maik Piel telling us about the use of StormCrawler at Pixray .   Q: What do you guys do at...

Happy new year! I have just released StormCrawler 1.13, which contains important bug fixes and some nice improvements. As usual,...

The previous release was only last month but I decided to ship this one now as it contains several bugfixes and improvements which many use...

I've just released StormCrawler 1.11, here are the main changes, some of which require modifications of your configuration. Users sho...

StormCrawler 1.9 is only a couple of weeks old but the new functionalities added since justify a new release. Dependency upgrades Ap...