What’s new?

Multiprocess support was added to the crawler to speed up the processing of queue entries.

Some parts were rewritten using MVC principles.

Intotroduced “ pollable processing instructions ” to enable tracking failures in processing instructions. (Read more about this feature in chapter “pollable processing instructions”)