TYPO3 Logo
Site Crawler Extension
Options
Give feedback View source How to edit Edit on GitHub Full documentation (single file)

Site Crawler Extension

  • Introduction
  • Configuration
    • Extension Manager Configuration
    • Configuration records
    • Page TSconfig Reference (tx_crawler.crawlerCfg)
    • HTTP Authentication
    • Examples
      • EXT:news
  • Executing the queue
    • Run via command controller
    • Executing queue with cron-job
    • Run via backend
    • Building and Executing queue right away (from cli)
  • Scheduler
  • Use cases
    • Cache warm up
    • Indexed Search
  • Features
    • Automatic add pages to Queue
    • Pollable processing instructions
    • Multi process support
    • Hooks
    • PSR-14 Events
    • Priority Crawling
  • Troubleshooting
  • Links
  • Sitemap
  1. Site Crawler Extension
  2. Executing the queue
Give feedback Edit on GitHub

Executing the queue

The idea of the queue is that a large number of tasks can be submitted to the queue and performed over longer time. This could be interesting for several reasons;

  • To spread server load over time.
  • To time the requests for nightly processing.
  • And simply to avoid max_execution_time of PHP to limit processing to 30 seconds!
  • Run via command controller
  • Executing queue with cron-job
  • Run via backend
  • Building and Executing queue right away (from cli)
  • Previous
  • Next
Reference to the headline

Copy and freely share the link

This link target has no permanent anchor assigned. You can make a pull request on GitHub to suggest an anchor. The link below can be used, but is prone to change if the page gets moved.

Copy this link into your TYPO3 manual.

  • Issues
  • Repository

Last rendered: May 23, 2025 06:54

© 2002-2021 AOE GmbH, since 2021 Tomas Norre Mikkelsen
  • Legal Notice
  • Privacy Policy