PHPackages                             smweb/web-scrapper - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. smweb/web-scrapper

ActiveApp[Utility & Helpers](/categories/utility)

smweb/web-scrapper
==================

Web scrapper for 10web's blog

05PHP

Since Apr 3Pushed 3y ago1 watchersCompare

[ Source](https://github.com/smwebstudio/web-scrap)[ Packagist](https://packagist.org/packages/smweb/web-scrapper)[ RSS](/packages/smweb-web-scrapper/feed)WikiDiscussions master Synced yesterday

READMEChangelogDependenciesVersions (1)Used By (0)

A PHP/JS web scraper
--------------------

[](#a-phpjs-web-scraper)

Simple CLI web application that scrapes and aggregates latest blog posts and shows them on the front page.

Please notice, that the app is in dev mode.

Some of the feature include:

- Dependencies managed through composer
- Options for date range and article limit

### Dependencies

[](#dependencies)

- PHP web server
- PHP >= 7.1
- MySQL >= 8.0

#### How to quickly setup

[](#how-to-quickly-setup)

- Ensure you have [composer](www.getcomposer.org) installed

    - You can use composer (recommended) to create the project using `composer create-project smweb/web-scrapper:dev-master myproject` (rename {myproject} to any)
    - or download the project in zip format [here](https://github.com/smwebstudio/web-scrap/archive/refs/heads/master.zip) and extract it to your http server.
- In the root folder, run composer install
- In the app/ folder, edit db\_config.php for proper DB credentials
- After DB config edited, run command in the root folder `php app/create_tables.php` to create DB tables
- To scrap posts and save to DB run command in the root folder `php app/scraper_cli.php --count "{count}" --startDate "{startDate}" --endDate "{endDate}" ` , where

    - {count} is articles count to scrap, integer // 10 by default
    - {startDate} is article's published min date
    - {endDate} is article's published max date
    - Date format: mm/dd/yyyy (example: 04/23/2021 )
- To view frontpage with scraped data, run command in the root folder `php -S localhost:800` to start a server at the root folder. Frontpage can be accessed at `localhost:800` .

### Versioning

[](#versioning)

Project uses [GitHub](https://github.com/) for versioning.

###  Health Score

14

—

LowBetter than 1% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity4

Limited adoption so far

Community7

Small or concentrated contributor base

Maturity23

Early-stage or recently created project

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/13343476?v=4)[smweb](/maintainers/smweb)[@SMWEB](https://github.com/SMWEB)

---

Top Contributors

[![fr44lancer](https://avatars.githubusercontent.com/u/108418180?v=4)](https://github.com/fr44lancer "fr44lancer (1 commits)")

### Embed Badge

![Health badge](/badges/smweb-web-scrapper/health.svg)

```
[![Health](https://phpackages.com/badges/smweb-web-scrapper/health.svg)](https://phpackages.com/packages/smweb-web-scrapper)
```

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)