---
title: "Crawler configuration"
manual: "Warming"
version: "5.3"
permalink: "https://docs.typo3.org/permalink/eliashaeussler/typo3-warming:crawler-configuration@5.3"
source: "Configuration/CrawlerConfiguration.rst"
rendered: "2026-11-05T08:37:00+00:00"
---

# Crawler configuration {#crawler-configuration}

The following configuration applies only to the [default crawlers](https://docs.typo3.org/permalink/eliashaeussler/typo3-warming:default-crawlers@5.3)
shipped by this extension.

> [!NOTE]
> **See also**
>
> If you want to learn more about configurable crawlers, read more in the [developer corner](https://docs.typo3.org/permalink/eliashaeussler/typo3-warming:crawlers@5.3).

Both default crawlers utilize the same crawler options that are described in the
[option reference](https://cache-warmup.dev/config-reference/crawler-options.html#option-reference)
of the underlying [`eliashaeussler/cache-warmup`](https://packagist.org/packages/eliashaeussler/cache-warmup) library.

In addition, the following crawler options are available:

-   **perform_subrequests**

    -   *Type:* boolean
    -   *Default:* 0

    <!-- TODO: no Markdown rendering for "versionadded" -->

    Feature: #730 - Introduce sub request handlerEnable sub request handler for cache warmup requests. This will significantly increase
    performance of the whole cache warmup progress, since no HTTP requests will be performed
    anymore. Instead, the bootstrapped frontend application is re-used for each cache warmup
    request.

    > [!NOTE]
    > Only URLs matching the site's base URL are handled by the sub request handler. All
    > other URLs (e.g. pages linking to external URLs) will be handled by Guzzle's default
    > handler.