PHPackages                             mediashare/spider - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [HTTP & Networking](/categories/http)
4. /
5. mediashare/spider

ActiveLibrary[HTTP & Networking](/categories/http)

mediashare/spider
=================

Spider is a php library for crawling website that allows you to scrape informations & automated actions.

0.4.7(4y ago)151211MITPHPCI failing

Since Dec 21Pushed 3y ago3 watchersCompare

[ Source](https://github.com/Mediashare/Spider)[ Packagist](https://packagist.org/packages/mediashare/spider)[ Docs](https://github.com/Mediashare/Spider)[ RSS](/packages/mediashare-spider/feed)WikiDiscussions master Synced 6d ago

READMEChangelog (10)Dependencies (8)Versions (35)Used By (0)

Spider
======

[](#spider)

💫 Spider is a PHP library with easily module integration for crawling website that allows you to scrape informations.

Spider is a crawler of website modulable write in PHP. The tool allows you to retrieve information and execute code on website pages. It can be useful for SEO or security audit purposes. Users have the possibility to use the modules created by the community or to create their own modules (written in PHP via a web interface).

### What is a Crawler?

[](#what-is-a-crawler)

A crawler is an indexing robot, it automatically explores the pages of a website. Using a crawler can have several interests:

- Information search & retrieval
- Validation of the SEO of your website
- Integration test
- Execution of PHP code on several pages in an automated way

### Features

[](#features)

- Get all links from website
- Check HTTP response
- Create your own [**Modules**](#modules) (Crawl & execute your PHP code)
- No database, Pure PHP
- Output json file
- Use default modules from the kernel for basic SEO audit. (Metadata, Images, HttpCode, Links...)

### Libraries

[](#libraries)

- Autoloader php class for code integration easily. [mediashare/modules-provider](https://packagist.org/packages/mediashare/modules-provider)
- Website bot crawler. [mediashare/crawler](https://packagist.org/packages/mediashare/crawler)
- Scraper with DomCrawler integration. [mediashare/scraper](https://packagist.org/packages/mediashare/scraper)

I would be happy to receive your ideas and contributions to the project 😃

Getting started
---------------

[](#getting-started)

### Installation

[](#installation)

#### [Composer Usage](https://packagist.org/packages/Mediashare%5CSpider/spider)

[](#composer-usage)

Use Spider library in your project & create your own modules.

```
composer require mediashare/spider
```

##### Usage

[](#usage)

```