PHPackages                             teamtnt/crawler - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. teamtnt/crawler

ActiveProject[Utility & Helpers](/categories/utility)

teamtnt/crawler
===============

Distributed Crawler Architecture

1013[3 PRs](https://github.com/teamtnt/crawler/pulls)PHP

Since Jun 10Pushed 3y ago3 watchersCompare

[ Source](https://github.com/teamtnt/crawler)[ Packagist](https://packagist.org/packages/teamtnt/crawler)[ RSS](/packages/teamtnt-crawler/feed)WikiDiscussions master Synced 3d ago

READMEChangelogDependenciesVersions (4)Used By (0)

About
-----

[](#about)

A distributed crawler

Requirements
------------

[](#requirements)

- [PHP >= 7.1](http://php.net)

Installation
------------

[](#installation)

Via [Composer](https://getcomposer.org):

```
composer require teamtnt/crawler
```

Configuration
-------------

[](#configuration)

Each instance needs to have an identifier. This can be added in `.env`

```
NODE_NAME="Instance 1"
```

The domain feeder needs to start with a seed domain. After that, running

`php artisan crawler`

For scraping a single url

`php artisan url:frontier www.example.com/something`

### Crawler Topology

[](#crawler-topology)

[![Crawler Topology](https://camo.githubusercontent.com/d269e2c6495e82fd1dac32aa0a564c4b3b9700f2bc8f39fbe34bc9e93471f804/68747470733a2f2f692e696d6775722e636f6d2f4d6c43354474712e706e67)](https://camo.githubusercontent.com/d269e2c6495e82fd1dac32aa0a564c4b3b9700f2bc8f39fbe34bc9e93471f804/68747470733a2f2f692e696d6775722e636f6d2f4d6c43354474712e706e67)

### Domain Feeder

[](#domain-feeder)

[![Domain Feeder](https://camo.githubusercontent.com/6dd316f7901784a5b7133c304c67cf543cb6db9890f87b792970aeb1a90e5247/68747470733a2f2f692e696d6775722e636f6d2f56584c483070472e706e67)](https://camo.githubusercontent.com/6dd316f7901784a5b7133c304c67cf543cb6db9890f87b792970aeb1a90e5247/68747470733a2f2f692e696d6775722e636f6d2f56584c483070472e706e67)

### Single Instance

[](#single-instance)

[![Single Instance](https://camo.githubusercontent.com/759fe09c8983893bb841460057ba727e62690f7015a69c9749e1905cbc091720/68747470733a2f2f692e696d6775722e636f6d2f47314e375a30572e706e67)](https://camo.githubusercontent.com/759fe09c8983893bb841460057ba727e62690f7015a69c9749e1905cbc091720/68747470733a2f2f692e696d6775722e636f6d2f47314e375a30572e706e67)

### URL Frontier

[](#url-frontier)

[![URL Frontier](https://camo.githubusercontent.com/14383e1056be3a4db06874cf300afdb109b8a6718d9a29422f8ab3a53684800b/68747470733a2f2f692e696d6775722e636f6d2f693343725866782e706e67)](https://camo.githubusercontent.com/14383e1056be3a4db06874cf300afdb109b8a6718d9a29422f8ab3a53684800b/68747470733a2f2f692e696d6775722e636f6d2f693343725866782e706e67)

###  Health Score

22

—

LowBetter than 22% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity10

Limited adoption so far

Community10

Small or concentrated contributor base

Maturity41

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

### Community

Maintainers

![](https://www.gravatar.com/avatar/6fc0f9546f5f7b8a91fa32ca0de9f2c590d00ec113c621783eeca82516bb006f?d=identicon)[nticaric](/maintainers/nticaric)

---

Top Contributors

[![nticaric](https://avatars.githubusercontent.com/u/824840?v=4)](https://github.com/nticaric "nticaric (18 commits)")

### Embed Badge

![Health badge](/badges/teamtnt-crawler/health.svg)

```
[![Health](https://phpackages.com/badges/teamtnt-crawler/health.svg)](https://phpackages.com/packages/teamtnt-crawler)
```

###  Alternatives

[nizsheanez/yii2-asset-converter

Less, Sass, Scss and Phamlp converter for Yii2. No system requires. yii2-composer support, Less autoupdate, customizing of output directory

64167.5k6](/packages/nizsheanez-yii2-asset-converter)[jijunair/laravel-referral

Laravel package for a referral system

9223.8k](/packages/jijunair-laravel-referral)[japanese-holiday/japanese-holiday

30122.9k](/packages/japanese-holiday-japanese-holiday)[topshelfcraft/environment-label

...so you don't forget where you are.

16231.4k10](/packages/topshelfcraft-environment-label)[moc/notfound

Neos CMS package that loads a normal editable page for displaying a 404 error

18167.5k](/packages/moc-notfound)[phpinnacle/buffer

PHPinnacle binary buffer implementation

2493.7k10](/packages/phpinnacle-buffer)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)