PHPackages                             innmind/crawler-app - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [API Development](/categories/api)
4. /
5. innmind/crawler-app

AbandonedArchivedProject[API Development](/categories/api)

innmind/crawler-app
===================

Crawl the web and publish the graph to an api

1.5.2(5y ago)0121[2 PRs](https://github.com/Innmind/CrawlerApp/pulls)proprietaryPHPPHP ~7.4CI failing

Since Sep 23Pushed 4mo ago2 watchersCompare

[ Source](https://github.com/Innmind/CrawlerApp)[ Packagist](https://packagist.org/packages/innmind/crawler-app)[ RSS](/packages/innmind-crawler-app/feed)WikiDiscussions develop Synced 2w ago

READMEChangelogDependencies (22)Versions (13)Used By (0)

Crawler Robot
=============

[](#crawler-robot)

[![Build Status](https://github.com/Innmind/CrawlerApp/workflows/CI/badge.svg)](https://github.com/Innmind/CrawlerApp/actions?query=workflow%3ACI)[![codecov](https://camo.githubusercontent.com/cc285b8b9bdeb9b35a6948efc03d63ae259b35e848213cc874149085f151d2fd/68747470733a2f2f636f6465636f762e696f2f67682f496e6e6d696e642f437261776c65724170702f6272616e63682f646576656c6f702f67726170682f62616467652e737667)](https://codecov.io/gh/Innmind/CrawlerApp)[![Type Coverage](https://camo.githubusercontent.com/9a46f404b8a244adf6d62aa04bff8f4928c76f4872690991716259297d7dd3e9/68747470733a2f2f73686570686572642e6465762f6769746875622f496e6e6d696e642f437261776c65724170702f636f7665726167652e737667)](https://shepherd.dev/github/Innmind/CrawlerApp)

This is an app to crawl internet and publish resource attributes to a [Library](https://github.com/Innmind/Library).

Installation
------------

[](#installation)

```
composer install
docker-compose up -d
```

Copy `config/.env.dist` to `config/.env` and adapt the url of the amqp server to your need.

Usage
-----

[](#usage)

```
bin/crawler consume crawler
```

This will launch a consumer to read the urls to crawl

```
bin/console crawl http://the.url/to/crawl https://innmind_library.host/
```

This will crawl `http://the.url/to/crawl`, extract the resource attributes and publish them to the library `https://innmind_library.host/`. It will automatically detect the api resource to publish to.

###  Health Score

37

—

LowBetter than 81% of packages

Maintenance51

Moderate activity, may be stable

Popularity6

Limited adoption so far

Community9

Small or concentrated contributor base

Maturity69

Established project with proven stability

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~95 days

Recently: every ~135 days

Total

9

Last Release

2073d ago

PHP version history (2 changes)1.0.0PHP ~7.2

1.4.0PHP ~7.4

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/851425?v=4)[Baptiste Langlade](/maintainers/Baptouuuu)[@Baptouuuu](https://github.com/Baptouuuu)

---

Top Contributors

[![Baptouuuu](https://avatars.githubusercontent.com/u/851425?v=4)](https://github.com/Baptouuuu "Baptouuuu (345 commits)")

###  Code Quality

TestsPHPUnit

Static AnalysisPsalm

Type Coverage Yes

### Embed Badge

![Health badge](/badges/innmind-crawler-app/health.svg)

```
[![Health](https://phpackages.com/badges/innmind-crawler-app/health.svg)](https://phpackages.com/packages/innmind-crawler-app)
```

###  Alternatives

[phpdocumentor/phpdocumentor

Documentation Generator for PHP

4.3k3.1M903](/packages/phpdocumentor-phpdocumentor)[phpro/grumphp

A composer plugin that enables source code quality checks.

4.3k16.3M978](/packages/phpro-grumphp)[matomo/matomo

Matomo is the leading Free/Libre open analytics platform

21.6k38.2k](/packages/matomo-matomo)[shopware/core

Shopware platform is the core for all Shopware ecommerce products.

585.4M524](/packages/shopware-core)[jolicode/castor

A lightweight and modern task runner. Automate everything. In PHP.

54642.4k4](/packages/jolicode-castor)[team-reflex/discord-php

An unofficial API to interact with the voice and text service Discord.

1.1k406.5k25](/packages/team-reflex-discord-php)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)