Tuesday, 28 November 2017

What's new in StormCrawler 1.7

›
Amazingly this is the 20th release of StormCrawler ! Here are the main changes: Dependencies updates crawler-commons 0.9 #513 Core ...
Friday, 8 September 2017

What's new in StormCrawler 1.6

›
Dependencies updates jsoup 1.10.3 crawler-commons 0.8 Core Use ISO representation of time for modifiedtime in adaptivescheduler ...
Monday, 29 May 2017

What's new in StormCrawler 1.5

›
StormCrawler 1.5 has just been released! It is an important road mark with the move to Elasticsearch 5.x and the implementation of long-a...
Monday, 15 May 2017

Avoid these common pitfalls when upgrading StormCrawler with Elasticsearch 5.x

›
The next (and probably imminent) release of StormCrawler will contain an update of Elasticsearch to version 5.3. This is definitely a good...
Thursday, 27 April 2017

Crawl dynamic content with Selenium and StormCrawler

›
Many websites rely on AJAX to provide smooth and reactive web applications and/or single page websites. While this works fine for humans u...
Tuesday, 4 April 2017

Video Tutorial - StormCrawler + Elasticsearch + Kibana

›
This tutorial explains how to configure Elasticsearch with StormCrawler.  We first bootstrap a StormCrawler project using the Maven a...
Wednesday, 29 March 2017

Full day workshop(s) on StormCrawler (+Elasticsearch and Kibana)

›
I will be running a full-day workshop on crawling with StormCrawler on the  24th April  in Berlin. See full details on   https://endoc...