TYPO3 Logo
Crawler
Options
View source How to edit Full documentation (single file)

Crawler

  • Introduction
    • What does it do?
    • Screenshots
  • Configuration
    • Extension Manager Configuration
    • Configuration records
    • Page TSconfig Reference (tx_crawler.crawlerCfg)
    • HTTP Authentication
    • Examples
      • EXT:news
  • Executing the queue
    • Run via command controller
    • Executing queue with cron-job
    • Run via backend
    • Building and Executing queue right away (from cli)
  • Scheduler
  • Use cases
    • Cache warm up
    • Indexed Search
  • Features
    • Automatic add pages to Queue
    • Pollable processing instructions
    • Multi process support
    • Hooks
    • PSR-14 Events
    • Priority Crawling
  • Troubleshooting
  • Links
  • AOE GmbH
  • <Unknown>
  1. Crawler
  2. Executing the queue

Executing the queue 

The idea of the queue is that a large number of tasks can be submitted to the queue and performed over longer time. This could be interesting for several reasons;

  • To spread server load over time.
  • To time the requests for nightly processing.
  • And simply to avoid "max_execution_time" of PHP to limit processing to 30 seconds!
  • Run via command controller
  • Executing queue with cron-job
  • Run via backend
  • Building and Executing queue right away (from cli)
  • Previous
  • Next
Reference to the headline

Copy and freely share the link

This link target has no permanent anchor assigned.The link below can be used, but is prone to change if the page gets moved.

Copy this link into your TYPO3 manual.

Last rendered: Mar 23, 2026 09:03

  • Legal Notice
  • Privacy Policy