TYPO3 Logo
Crawler
Release: main

Loading data.

  • Introduction
  • Configuration
    • Extension Manager Configuration
    • Configuration records
    • Page TSconfig Reference (tx_crawler.crawlerCfg)
    • HTTP Authentication
    • Examples
      • EXT:news
  • Executing the queue
    • Run via command controller
    • Executing queue with cron-job
    • Run via backend
    • Building and Executing queue right away (from cli)
  • Scheduler
  • Use cases
    • Cache warm up
    • Indexed Search
  • Features
    • Automatic add pages to Queue
    • Pollable processing instructions
    • Multi process support
    • Hooks
    • PSR-14 Events
    • Priority Crawling
  • Troubleshooting
  • Links
  • Sitemap

Contributors Corner

  • View source of current document
  • How to edit
  • Edit current document on GitHub
  1. Site Crawler Extension
  2. Executing the queue
Report issue View source How to edit Edit on GitHub

Executing the queue

The idea of the queue is that a large number of tasks can be submitted to the queue and performed over longer time. This could be interesting for several reasons;

  • To spread server load over time.
  • To time the requests for nightly processing.
  • And simply to avoid max_execution_time of PHP to limit processing to 30 seconds!
  • Run via command controller
  • Executing queue with cron-job
  • Run via backend
  • Building and Executing queue right away (from cli)
  • Previous
  • Next
Reference to the headline

Copy and freely share the link

This link target has no permanent anchor assigned. You can make a pull request on GitHub to suggest an anchor. The link below can be used, but is prone to change if the page gets moved.

Copy this link into your TYPO3 manual.

  • Issues
  • Repository

Last rendered: Mar 11, 2025 15:23

© 2002-2021 AOE GmbH, since 2021 Tomas Norre Mikkelsen
  • Legal Notice
  • Privacy Policy