PHPackages                             imarc/crawler - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. imarc/crawler

ActiveLibrary[Utility & Helpers](/categories/utility)

imarc/crawler
=============

crawl a site and get all the links

0.2.0(8y ago)1231MITPHP

Since Oct 16Pushed 8y ago4 watchersCompare

[ Source](https://github.com/imarc/crawler)[ Packagist](https://packagist.org/packages/imarc/crawler)[ RSS](/packages/imarc-crawler/feed)WikiDiscussions master Synced 3w ago

READMEChangelogDependencies (6)Versions (3)Used By (0)

Crawler
=======

[](#crawler)

Crawls a website and does something with the URLs. By default it will output each URL on a single line in a txt file.

This could fairly easily be extended to do many other things. You would just need to create a new Observer (`src/Observer`)

install
-------

[](#install)

`composer require imarc/crawler`

usage
-----

[](#usage)

From your project's directory: `./vendor/bin/crawler csv URL DESTINATION`

From the repo: `./crawler.php csv URL DESTINATION`

options
-------

[](#options)

`crawler --help`

```
Usage:
  csv [options] [--]

Arguments:
  url                    URL to crawl.
  destination            Write CSV to FILE

Options:
  -s, --show-progress    Show the crawl's progress
  -e, --crawl-external   Crawl external URLs
  -q, --quiet            Do not output any message
      --exclude=EXCLUDE  Exclude certain extensions [default: ["css","gif","ico","jpg","jpg","js","pdf","pdf","png","rss","txt"]] (multiple values allowed)
  -h, --help             Display this help message
  -V, --version          Display this application version
      --ansi             Force ANSI output
      --no-ansi          Disable ANSI output
  -n, --no-interaction   Do not ask any interactive question
  -v|vv|vvv, --verbose   Increase the verbosity of messages: 1 for normal output, 2 for more verbose output and 3 for debug

```

tests
-----

[](#tests)

`codecept run`

###  Health Score

25

—

LowBetter than 36% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity9

Limited adoption so far

Community10

Small or concentrated contributor base

Maturity54

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~16 days

Total

2

Last Release

3155d ago

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/2153342?v=4)[Chandler](/maintainers/chantron)[@chantron](https://github.com/chantron)

---

Top Contributors

[![chantron](https://avatars.githubusercontent.com/u/2153342?v=4)](https://github.com/chantron "chantron (2 commits)")

###  Code Quality

TestsCodeception

### Embed Badge

![Health badge](/badges/imarc-crawler/health.svg)

```
[![Health](https://phpackages.com/badges/imarc-crawler/health.svg)](https://phpackages.com/packages/imarc-crawler)
```

###  Alternatives

[spatie/laravel-export

Create a static site bundle from a Laravel app

672139.5k6](/packages/spatie-laravel-export)[shlinkio/shlink

A self-hosted and PHP-based URL shortener application with CLI and REST interfaces

5.0k4.9k](/packages/shlinkio-shlink)[oat-sa/tao-core

TAO core extension

66140.1k108](/packages/oat-sa-tao-core)[friendsoftypo3/content-blocks

TYPO3 CMS Content Blocks - Content Types API | Define reusable components via YAML

101466.4k45](/packages/friendsoftypo3-content-blocks)[phel-lang/phel-lang

Phel is a functional programming language that compiles to PHP

5155.1k17](/packages/phel-lang-phel-lang)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)