PHPackages                             bootjp/crawler - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility &amp; Helpers](/categories/utility)
4. /
5. bootjp/crawler

AbandonedArchivedLibrary[Utility &amp; Helpers](/categories/utility)

bootjp/crawler
==============

Web pages 404 and soft 404 checker

0.0.7(9y ago)0161[1 issues](https://github.com/bootjp/crawler/issues)MITPHP

Since Mar 14Pushed 8y ago1 watchersCompare

[ Source](https://github.com/bootjp/crawler)[ Packagist](https://packagist.org/packages/bootjp/crawler)[ RSS](/packages/bootjp-crawler/feed)WikiDiscussions master Synced today

READMEChangelog (6)Dependencies (1)Versions (8)Used By (0)

OreTokuCrawler
==============

[](#oretokucrawler)

[![Build Status](https://camo.githubusercontent.com/80c0d45aab9883f389c460f714ea8e78e9d0e4bef10939632794a3371c33d10d/68747470733a2f2f7472617669732d63692e6f72672f626f6f746a702f637261776c65722e7376673f6272616e63683d6d6173746572)](https://travis-ci.org/bootjp/crawler)[![Scrutinizer Code Quality](https://camo.githubusercontent.com/f8b2b9e9d4a4606aec5ece0112ee9f82ab480a8952b18af159b1b37fb657185d/68747470733a2f2f7363727574696e697a65722d63692e636f6d2f672f626f6f746a702f637261776c65722f6261646765732f7175616c6974792d73636f72652e706e673f623d6d6173746572)](https://scrutinizer-ci.com/g/bootjp/crawler/?branch=master)

Now Beta2 Version relese.
-------------------------

[](#now-beta2-version-relese)

-

### Makeing now...

[](#makeing-now)

### How To Use

[](#how-to-use)

- Use composer
    - You do not know composer?
        - OK, GO to page =&gt;

### Introduction

[](#introduction)

```
$ curl -s http://getcomposer.org/installer | php
$ php composer.phar install
or
$ composer install
```

### Use Ex.

[](#use-ex)

```
$ php wrapper.php --url=https://bootjp.me
or
$  php wrapper.php --url=https://bootjp.me --recursion=false
```

-&gt;  is root on the contents link check

```
$ php wrapper.php --url=https://bootjp.me --recursion=true
```

-&gt;  is on the contents link all check

### Use docker images

[](#use-docker-images)

dockerImage is hire -&gt;

```
docker pull bootjp/crawler
docker run bootjp/crawler php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password
```

### Basic Auth

[](#basic-auth)

```
$ php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password
```

[LICENSE](https://github.com/bootjp/crawler/blob/master/LICENSE)

[日本語での解説記事(ちょっと古い)](https://bootjp.me/2015/03/14/%E5%8D%98%E8%AA%9E-or-404%E3%82%A8%E3%83%A9%E3%83%BCsoft%E5%90%AB%E3%82%80%E3%83%81%E3%82%A7%E3%83%83%E3%82%AB%E3%83%BC%E4%BD%9C%E3%81%A3%E3%81%9F%E3%81%9E-%E4%BB%96%E5%A0%B1%E5%91%8A%E7%AD%89/)

###  Health Score

26

—

LowBetter than 46% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity7

Limited adoption so far

Community8

Small or concentrated contributor base

Maturity58

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~112 days

Total

5

Last Release

3578d ago

### Community

Maintainers

![](https://www.gravatar.com/avatar/c563447e0a5e11d7fcc7a4e5cfda56bdbaaf552f0b499d6334a3909d24d6bd5e?d=identicon)[bootjp](/maintainers/bootjp)

---

Top Contributors

[![bootjp](https://avatars.githubusercontent.com/u/1306365?v=4)](https://github.com/bootjp "bootjp (80 commits)")

### Embed Badge

![Health badge](/badges/bootjp-crawler/health.svg)

```
[![Health](https://phpackages.com/badges/bootjp-crawler/health.svg)](https://phpackages.com/packages/bootjp-crawler)
```

###  Alternatives

[nelexa/google-play-scraper

Scrapes app data from Google Play store.

88480.5k](/packages/nelexa-google-play-scraper)[oat-sa/lib-lti1p3-core

OAT LTI 1.3 Core Library

35327.1k9](/packages/oat-sa-lib-lti1p3-core)[aedart/athenaeum

Athenaeum is a mono repository; a collection of various PHP packages

245.2k](/packages/aedart-athenaeum)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)
