Hooks

Register the following hooks in ext_localconf.php of your extension.

excludeDoktype Hook

By adding doktype ids to following array you can exclude them from being crawled:

packages/my_extension/ext_localconf.php 
$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['crawler']['excludeDoktype'][] = <dokTypeId>
Copied!

pageVeto Hook

Deprecated since version 11.0.0

You can also decide whether a page should not be crawled in an individual userfunction. Register your function here:

packages/my_extension/ext_localconf.php 
$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['crawler']['pageVeto'][] = MyVendor\MyExtension\Hooks\Crawler\PageVeto::class . '->excludePage';
Copied!
packages/my_extension/Classes/Hooks/Crawler/PageVeto.php 
<?php

declare(strict_types=1);

namespace MyVendor\MyExtension\Hooks\Crawler;

use AOE\Crawler\Controller\CrawlerController;

class PageVeto
{
    public function excludePage(array &$params, CrawlerController $controller)
    {
        if ($params['pageRow']['uid'] === 42) {
            return 'Page with uid "42" is excluded by page veto hook';
        }

        return false;
    }
}
Copied!