PHPackages                             bee4/robots.txt - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Parsing & Serialization](/categories/parsing)
4. /
5. bee4/robots.txt

AbandonedArchivedLibrary[Parsing & Serialization](/categories/parsing)

bee4/robots.txt
===============

Robots.txt parser and matcher

v2.0.3(10y ago)119.3kApache-2.0PHPPHP >=5.4

Since Mar 13Pushed 10y ago3 watchersCompare

[ Source](https://github.com/bee4/robots.txt)[ Packagist](https://packagist.org/packages/bee4/robots.txt)[ RSS](/packages/bee4-robotstxt/feed)WikiDiscussions master Synced 1mo ago

READMEChangelog (4)Dependencies (3)Versions (9)Used By (0)

bee4/robots.txt
===============

[](#bee4robotstxt)

[![Build Status](https://camo.githubusercontent.com/2b50ba2094d9f5f8a0a3269375b0dc43fdc3f6b15c2fc9c5f8b8ba69f2d35a8c/68747470733a2f2f696d672e736869656c64732e696f2f7472617669732f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://travis-ci.org/bee4/robots.txt)[![Scrutinizer Code Quality](https://camo.githubusercontent.com/0b361e3098462f0a5d6981384c2dc6fed7fedf3b2235b00b4a429cbea708721a/68747470733a2f2f696d672e736869656c64732e696f2f7363727574696e697a65722f672f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://scrutinizer-ci.com/g/bee4/robots.txt/?branch=master)[![Code Coverage](https://camo.githubusercontent.com/e737f0ce8c84643004753e69c184a33c31c095d5a57f6902a16770151a0ebc04/68747470733a2f2f696d672e736869656c64732e696f2f7363727574696e697a65722f636f7665726167652f672f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://scrutinizer-ci.com/g/bee4/robots.txt/)[![SensiolabInsight](https://camo.githubusercontent.com/8a6d1e9cdaa1986a1407961c44918e16b213518396cee02ae23c9051817dde6f/68747470733a2f2f696d672e736869656c64732e696f2f73656e73696f6c6162732f692f65656234383739342d366666622d346335342d383836372d3536633037376437373030382e7376673f7374796c653d666c61742d737175617265)](https://insight.sensiolabs.com/projects/eeb48794-6ffb-4c54-8867-56c077d77008)

[![License](https://camo.githubusercontent.com/d26d348cbc4c0b907a00fcffc3ac92a616686f34a115633a7ee301c0f093284f/68747470733a2f2f696d672e736869656c64732e696f2f7061636b61676973742f6c2f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://packagist.org/packages/bee4/robots.txt)

This library allow to parse a Robots.txt file and then check for URL status according to defined rules. It follow the rules defined in the RFC draft visible here:

Installing
----------

[](#installing)

[![Latest Stable Version](https://camo.githubusercontent.com/7344745d7120230ee373f0b564b3e5eaa04aa2843d2bfb8e24f4e70e5a12a73f/68747470733a2f2f696d672e736869656c64732e696f2f7061636b61676973742f762f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://packagist.org/packages/bee4/robots.txt)[![Total Downloads](https://camo.githubusercontent.com/ae107e07477e31eb4a310e7e1f099f101163df5a7058d2d6633280d581918429/68747470733a2f2f696d672e736869656c64732e696f2f7061636b61676973742f646d2f626565342f726f626f74732e7478742e7376673f7374796c653d666c61742d737175617265)](https://packagist.org/packages/bee4/robots.txt)

This project can be installed using Composer. Add the following to your composer.json:

```
{
    "require": {
        "bee4/robots.txt": "~2.0"
    }
}
```

or run this command:

```
composer require bee4/robots.txt:~2.0
```

Usage
-----

[](#usage)

```