The extension provides a backend module which displays the queue and log and allows execution and status check of the “cronscript” from the backend for testing purposes.
CLI status display¶
CLI = Command Line Interface = shell script = cron script
Crawler queue (before processing) / log (after processing)¶
Interface for submitting a batch of URLs to be crawled¶
The parameter combinations are programmeble through Page TSconfig or configuration records.