PHPackages                             lbonnet/crawler-toolkit - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [HTTP & Networking](/categories/http)
4. /
5. lbonnet/crawler-toolkit

ActiveLibrary[HTTP & Networking](/categories/http)

lbonnet/crawler-toolkit
=======================

Shared, framework-agnostic building blocks for polite and safe web crawlers: SSRF-aware HTTP throttling, robots.txt parsing, and HTML link discovery.

v0.1.0(today)01↑2900%MITPHP >=8.1

Since Aug 31Compare

[ Source](https://github.com/lbonnet-gda/crawler-toolkit)[ Packagist](https://packagist.org/packages/lbonnet/crawler-toolkit)[ RSS](/packages/lbonnet-crawler-toolkit/feed)WikiDiscussions Synced today

READMEChangelogDependencies (7)Versions (2)Used By (0)

### README not available

The README for this package hasn't been synced yet. View it on [GitHub](https://github.com/lbonnet-gda/crawler-toolkit).

###  Health Score

36

LowBetter than 79% of packages

Maintenance100

Actively maintained with recent releases

Popularity2

Limited adoption so far

Community2

Small or concentrated contributor base

Maturity32

Early-stage or recently created project

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Unknown

Total

1

Last Release

0d ago

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/191601779?v=4)[Léonard Bonnet](/maintainers/lbonnet-gda)[@lbonnet-gda](https://github.com/lbonnet-gda)

---

Tags

http clienthtmlrobots-txtcrawlerlinksssrf

###  Code Quality

TestsPHPUnit

Static AnalysisPHPStan

Type Coverage Yes

### Embed Badge

![Health badge](/badges/lbonnet-crawler-toolkit/health.svg)

```
[![Health](https://phpackages.com/badges/lbonnet-crawler-toolkit/health.svg)](https://phpackages.com/packages/lbonnet-crawler-toolkit)
```

###  Alternatives

[craftcms/cms

Craft CMS

3.6k3.7M3.5k](/packages/craftcms-cms)[spatie/crawler

Crawl all internal links found on a website

2.8k20.1M76](/packages/spatie-crawler)[sulu/sulu

Core framework that implements the functionality of the Sulu content management system

1.4k1.4M241](/packages/sulu-sulu)[chameleon-system/chameleon-base

The Chameleon System core.

1029.4k7](/packages/chameleon-system-chameleon-base)[contao/core-bundle

Contao Open Source CMS

1231.7M3.2k](/packages/contao-core-bundle)[bitrix24/b24phpsdk

An official PHP library for the Bitrix24 REST API

10258.0k6](/packages/bitrix24-b24phpsdk)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)