PHPackages                             aoepeople/crawler - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. aoepeople/crawler

Abandoned → [tomasnorre/crawler](/?search=tomasnorre%2Fcrawler)Typo3-cms-extension

aoepeople/crawler
=================

Crawler extension for TYPO3

12.0.10(6mo ago)58289.4k↓25%89[17 issues](https://github.com/tomasnorre/crawler/issues)[2 PRs](https://github.com/tomasnorre/crawler/pulls)GPL-3.0PHPPHP ~8.1.0 || ~8.2.0 || ~8.3.0 || ~8.4.0CI passing

Since Oct 27Pushed 1mo ago28 watchersCompare

[ Source](https://github.com/tomasnorre/crawler)[ Packagist](https://packagist.org/packages/aoepeople/crawler)[ Docs](https://github.com/tomasnorre/crawler)[ Fund](https://www.paypal.me/tomasnorre/10)[ GitHub Sponsors](https://github.com/tomasnorre)[ RSS](/packages/aoepeople-crawler/feed)WikiDiscussions main Synced 1mo ago

READMEChangelog (10)Dependencies (37)Versions (101)Used By (0)

TYPO3 Crawler
=============

[](#typo3-crawler)

[![Latest Stable Version](https://camo.githubusercontent.com/eceadb5c67fde640441c96e65c1e41cbe1910d763c2c4455e1c5cbc5321cf959/68747470733a2f2f706f7365722e707567782e6f72672f746f6d61736e6f7272652f637261776c65722f762f737461626c65)](https://packagist.org/packages/tomasnorre/crawler)[![Total Downloads](https://camo.githubusercontent.com/7283ee0268f3a3df287333edd2a164a5740677089e611c2c4518e0f457c94ed0/68747470733a2f2f706f7365722e707567782e6f72672f746f6d61736e6f7272652f637261776c65722f646f776e6c6f616473)](https://packagist.org/packages/tomasnorre/crawler)[![License](https://camo.githubusercontent.com/1f9cbc7dde70bfe4bd578d25dc32f0c9b690e46d72acae588a649495243dd3c0/68747470733a2f2f706f7365722e707567782e6f72672f746f6d61736e6f7272652f637261776c65722f6c6963656e7365)](https://packagist.org/packages/tomasnorre/crawler)[![Tests](https://github.com/tomasnorre/crawler/workflows/Tests/badge.svg)](https://github.com/tomasnorre/crawler/workflows/Tests/badge.svg)[![Coverage Status](https://camo.githubusercontent.com/e95cb43bc60d52964e48299b01e516763491658d363d27bb248b4f70f1c9520a/68747470733a2f2f636f766572616c6c732e696f2f7265706f732f6769746875622f746f6d61736e6f7272652f637261776c65722f62616467652e737667)](https://coveralls.io/github/tomasnorre/crawler)[![Mutation testing badge](https://camo.githubusercontent.com/1811d5de40edccf29650df083d255c2a92f9756e70865652d2ff356da5d067af/68747470733a2f2f696d672e736869656c64732e696f2f656e64706f696e743f7374796c653d666c61742675726c3d687474707325334125324625324662616467652d6170692e737472796b65722d6d757461746f722e696f2532466769746875622e636f6d253246746f6d61736e6f727265253246637261776c65722532466d61696e)](https://dashboard.stryker-mutator.io/reports/github.com/tomasnorre/crawler/main)[![Psalm coverage](https://camo.githubusercontent.com/b2110701eaf3045c755a14c4f1aa4023da7204ae5eaa4edee316874349a9e31d/68747470733a2f2f73686570686572642e6465762f6769746875622f746f6d61736e6f7272652f637261776c65722f636f7665726167652e737667)](https://camo.githubusercontent.com/b2110701eaf3045c755a14c4f1aa4023da7204ae5eaa4edee316874349a9e31d/68747470733a2f2f73686570686572642e6465762f6769746875622f746f6d61736e6f7272652f637261776c65722f636f7665726167652e737667)

TYPO3 Crawler crawls the TYPO3 page tree. Used for cache warmup, indexing, publishing applications etc.

You can include the crawler in your TYPO3 project with composer or from the [TYPO3 Extension Repository](https://extensions.typo3.org/extension/crawler)

```
composer require tomasnorre/crawler
```

**Crawler processes**

[![backend_processlist](https://user-images.githubusercontent.com/1212481/142763110-936be57c-1e9e-4d62-afbe-4134b139fd56.png)](https://user-images.githubusercontent.com/1212481/142763110-936be57c-1e9e-4d62-afbe-4134b139fd56.png)

Versions and Support
--------------------

[](#versions-and-support)

ReleaseTYPO3PHPFixes will containdev-main13.4-14.x8.2-8.5This is work in progress, for next major release 14.0.012.x.y12.4-13.48.1-8.4Features, Bugfixes, Security Updates, Since 12.0.6 TYPO3 13.4, Since 12.0.7 PHP 8.411.x.y10.4-11.57.4-8.1Security Updates, Since 11.0.3 PHP 8.110.x.y9.5-11.07.2-7.4Security Updates9.x.y9.5-11.07.2-7.4As this version has same requirements as 10.x.y, there will be no further releases of this version, please update instead.8.x.yReleases do not exist7.x.yReleases do not exist6.x.y7.6-8.75.6-7.3Security Updates### Documentation

[](#documentation)

Please read the [documentation](https://docs.typo3.org/p/tomasnorre/crawler/main/en-us/)

To render the documentation locally, please use the official TYPO3 Documentation rendering Docker Tool.

### Contributions

[](#contributions)

Please see [CONTRIBUTING.md](https://github.com/tomasnorre/crawler/blob/main/CONTRIBUTING.md)

### Honorable Previous Maintainers

[](#honorable-previous-maintainers)

- Kasper Skaarhoj
- Daniel Poetzinger
- Fabrizio Branca
- Tolleiv Nietsch
- Timo Schmidt
- Michael Klapper
- Stefan Rotsch

###  Health Score

67

—

FairBetter than 100% of packages

Maintenance73

Regular maintenance activity

Popularity48

Moderate usage in the ecosystem

Community33

Small or concentrated contributor base

Maturity97

Battle-tested with a long release history

 Bus Factor1

Top contributor holds 76% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~44 days

Recently: every ~53 days

Total

87

Last Release

57d ago

Major Versions

11.0.7 → 12.0.02024-05-21

11.0.8 → 12.0.12024-05-29

11.0.9 → 12.0.32024-05-30

11.0.11 → 12.0.52025-01-20

v11.x-dev → v12.x-dev2026-03-23

PHP version history (6 changes)6.3.1PHP &gt;= 5.6, &lt; 7.3

6.6.0PHP &gt;= 5.6, &lt; 7.4

9.0.0PHP ^7.2

11.0.0PHP ^7.4 || ^8.0

12.0.0PHP ~8.1.0 || ~8.2.0 || ~8.3.0

12.0.7PHP ~8.1.0 || ~8.2.0 || ~8.3.0 || ~8.4.0

### Community

Maintainers

![](https://www.gravatar.com/avatar/14fce2398ec689a4dacc23f96babecba25ca372ff4ea00f1419f803701e04e7a?d=identicon)[tomasnorre](/maintainers/tomasnorre)

![](https://avatars.githubusercontent.com/u/6331769?v=4)[AOE](/maintainers/AOEpeople)[@AOEpeople](https://github.com/AOEpeople)

---

Top Contributors

[![tomasnorre](https://avatars.githubusercontent.com/u/1212481?v=4)](https://github.com/tomasnorre "tomasnorre (730 commits)")[![srotsch](https://avatars.githubusercontent.com/u/1445999?v=4)](https://github.com/srotsch "srotsch (87 commits)")[![brotkrueml](https://avatars.githubusercontent.com/u/2566282?v=4)](https://github.com/brotkrueml "brotkrueml (41 commits)")[![bmack](https://avatars.githubusercontent.com/u/165630?v=4)](https://github.com/bmack "bmack (20 commits)")[![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?v=4)](https://github.com/dependabot[bot] "dependabot[bot] (17 commits)")[![cweiske](https://avatars.githubusercontent.com/u/59036?v=4)](https://github.com/cweiske "cweiske (15 commits)")[![TomasVotruba](https://avatars.githubusercontent.com/u/924196?v=4)](https://github.com/TomasVotruba "TomasVotruba (5 commits)")[![stucki](https://avatars.githubusercontent.com/u/320916?v=4)](https://github.com/stucki "stucki (5 commits)")[![kpnielsen](https://avatars.githubusercontent.com/u/76052209?v=4)](https://github.com/kpnielsen "kpnielsen (4 commits)")[![rengaw83](https://avatars.githubusercontent.com/u/5131653?v=4)](https://github.com/rengaw83 "rengaw83 (4 commits)")[![chetan-thapliyal](https://avatars.githubusercontent.com/u/1963399?v=4)](https://github.com/chetan-thapliyal "chetan-thapliyal (4 commits)")[![tstahn](https://avatars.githubusercontent.com/u/32361706?v=4)](https://github.com/tstahn "tstahn (3 commits)")[![PhilippKuhlmay](https://avatars.githubusercontent.com/u/57705869?v=4)](https://github.com/PhilippKuhlmay "PhilippKuhlmay (3 commits)")[![localheinz](https://avatars.githubusercontent.com/u/605483?v=4)](https://github.com/localheinz "localheinz (3 commits)")[![werkraum-admin](https://avatars.githubusercontent.com/u/11212230?v=4)](https://github.com/werkraum-admin "werkraum-admin (2 commits)")[![infabo](https://avatars.githubusercontent.com/u/3999104?v=4)](https://github.com/infabo "infabo (2 commits)")[![macjohnny](https://avatars.githubusercontent.com/u/5589029?v=4)](https://github.com/macjohnny "macjohnny (2 commits)")[![Patta](https://avatars.githubusercontent.com/u/2151127?v=4)](https://github.com/Patta "Patta (2 commits)")[![peterkraume](https://avatars.githubusercontent.com/u/4234704?v=4)](https://github.com/peterkraume "peterkraume (1 commits)")[![mbrodala](https://avatars.githubusercontent.com/u/5037116?v=4)](https://github.com/mbrodala "mbrodala (1 commits)")

---

Tags

cache-warmupcrawlerextensionhacktoberfestindexerphptypo3

###  Code Quality

TestsPHPUnit

Static AnalysisPHPStan

Code StyleECS

Type Coverage Yes

### Embed Badge

![Health badge](/badges/aoepeople-crawler/health.svg)

```
[![Health](https://phpackages.com/badges/aoepeople-crawler/health.svg)](https://phpackages.com/packages/aoepeople-crawler)
```

###  Alternatives

[eliashaeussler/typo3-warming

Warming - Warms up Frontend caches based on an XML sitemap. Cache warmup can be triggered via TYPO3 backend or using a console command. Supports multiple languages and custom crawler implementations.

20229.9k](/packages/eliashaeussler-typo3-warming)[sylius/sylius

E-Commerce platform for PHP, based on Symfony framework.

8.4k5.6M651](/packages/sylius-sylius)[shopware/platform

The Shopware e-commerce core

3.3k1.5M3](/packages/shopware-platform)[tomasnorre/crawler

Crawler extension for TYPO3

58397.5k1](/packages/tomasnorre-crawler)[shopware/core

Shopware platform is the core for all Shopware ecommerce products.

595.2M386](/packages/shopware-core)[neos/flow

Flow Application Framework

862.0M451](/packages/neos-flow)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)
