PHPackages                             mehrdad-dadkhah/article-scrapping-php-wrapper - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility &amp; Helpers](/categories/utility)
4. /
5. mehrdad-dadkhah/article-scrapping-php-wrapper

ActiveLibrary[Utility &amp; Helpers](/categories/utility)

mehrdad-dadkhah/article-scrapping-php-wrapper
=============================================

Simple php wrapper on Newspaper3k Article scraping &amp; curation

1.0.5(5y ago)41162[1 issues](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper/issues)[1 PRs](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper/pulls)GPL-3.0-or-laterPythonPHP &gt;=7.0CI failing

Since Jun 13Pushed 2y ago1 watchersCompare

[ Source](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper)[ Packagist](https://packagist.org/packages/mehrdad-dadkhah/article-scrapping-php-wrapper)[ Docs](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper)[ RSS](/packages/mehrdad-dadkhah-article-scrapping-php-wrapper/feed)WikiDiscussions master Synced 3w ago

READMEChangelog (3)Dependencies (1)Versions (10)Used By (0)

article-scrapping-php-wrapper
=============================

[](#article-scrapping-php-wrapper)

Simple php wrapper on Newspaper3k Article scraping &amp; curation

[![Software License](https://camo.githubusercontent.com/e1514dd3f2095dbf68a0008ae62a631142953ad2e86aa94c504343f2c2c191da/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6c6963656e73652d47504c2d627269676874677265656e2e7376673f7374796c653d666c61742d737175617265)](LICENSE)[![Packagist Version](https://camo.githubusercontent.com/52898b15c7d10cda49e430910a0a80b546f7bdc6fb88e5bb0612515ff798618e/68747470733a2f2f696d672e736869656c64732e696f2f7061636b61676973742f762f4d6568726461642d4461646b6861682f61727469636c652d736372617070696e672d7068702d777261707065722e7376673f7374796c653d666c61742d737175617265)](https://packagist.org/packages/Mehrdad-Dadkhah/ArticleScrappingPhpWrapper)

Features
--------

[](#features)

- Multi-threaded article download framework
- News url identification
- Text extraction from html
- Top image extraction from html
- All image extraction from html
- Keyword extraction from text
- Summary extraction from text
- Author extraction from text
- Google trending terms extraction
- Works in 10+ languages (English, Chinese, German, Arabic, ...)

.. code-block:: pycon

```
>>> import newspaper
>>> newspaper.languages()

Your available languages are:
input code      full name

  ar              Arabic
  be              Belarusian
  bg              Bulgarian
  da              Danish
  de              German
  el              Greek
  en              English
  es              Spanish
  et              Estonian
  fa              Persian
  fi              Finnish
  fr              French
  he              Hebrew
  hi              Hindi
  hr              Croatian
  hu              Hungarian
  id              Indonesian
  it              Italian
  ja              Japanese
  ko              Korean
  lt              Lithuanian
  mk              Macedonian
  nb              Norwegian (Bokmål)
  nl              Dutch
  no              Norwegian
  pl              Polish
  pt              Portuguese
  ro              Romanian
  ru              Russian
  sl              Slovenian
  sr              Serbian
  sv              Swedish
  sw              Swahili
  th              Thai
  tr              Turkish
  uk              Ukrainian
  vi              Vietnamese
  zh              Chinese

```

Get it now
----------

[](#get-it-now)

Run ✅ `pip3 install newspaper3k` ✅

NOT ⛔ `pip3 install newspaper` ⛔

On python3 you must install `newspaper3k`, **not** `newspaper`. `newspaper` is our python2 library. Although installing newspaper is simple with `pip `\_, you will run into fixable issues if you are trying to install on ubuntu.

**If you are on Debian / Ubuntu**, install using the following:

- Install `pip3` command needed to install `newspaper3k` package::

    $ sudo apt-get install python3-pip
- Python development version, needed for Python.h::

    $ sudo apt-get install python-dev
- lxml requirements::

    $ sudo apt-get install libxml2-dev libxslt-dev
- For PIL to recognize .jpg images::

    $ sudo apt-get install libjpeg-dev zlib1g-dev libpng12-dev

NOTE: If you find problem installing `libpng12-dev`, try installing `libpng-dev`.

- Download NLP related corpora::

    $ curl [https://raw.githubusercontent.com/codelucas/newspaper/master/download\_corpora.py](https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py) | python3
- Install the distribution via pip::

    $ pip3 install newspaper3k

**If you are on OSX**, install using the following, you may use both homebrew or macports:

::

```
$ brew install libxml2 libxslt

$ brew install libtiff libjpeg webp little-cms2

$ pip3 install newspaper3k

$ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python3

```

**Otherwise**, install with the following:

NOTE: You will still most likely need to install the following libraries via your package manager

- PIL: `libjpeg-dev` `zlib1g-dev` `libpng12-dev`
- lxml: `libxml2-dev` `libxslt-dev`
- Python Development version: `python-dev`

::

```
$ pip3 install newspaper3k

$ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python3

```

Installation
------------

[](#installation)

```
composer require mehrdad-dadkhah/article-scrapping-php-wrapper

```

```
python:

import nltk
nltk.download('all')

```

Usage
-----

[](#usage)

```
use MehrdadDadkhah\Scrapp\ArticleScrappingWrapper;

$parser = new ArticleScrappingWrapper();

$parser->scrapp('your url');
```

Read more
---------

[](#read-more)

(Newspaper)\[\]

(nltk)\[\]

(Scrape &amp; Summarize News Articles Using Python)\[\]

(Corpora Iranian Persian)\[\]

###  Health Score

27

—

LowBetter than 47% of packages

Maintenance15

Infrequent updates — may be unmaintained

Popularity15

Limited adoption so far

Community9

Small or concentrated contributor base

Maturity57

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~13 days

Recently: every ~26 days

Total

9

Last Release

2102d ago

Major Versions

0.1.1 → 1.0.02020-06-18

0.1.2 → 1.0.42020-09-06

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/3860685?v=4)[Mehrdad-Dadkhah](/maintainers/Mehrdad-Dadkhah)[@Mehrdad-Dadkhah](https://github.com/Mehrdad-Dadkhah)

---

Top Contributors

[![Mehrdad-Dadkhah](https://avatars.githubusercontent.com/u/3860685?v=4)](https://github.com/Mehrdad-Dadkhah "Mehrdad-Dadkhah (7 commits)")

---

Tags

language newsarticlepersiannatural-processingNewspaper3kscrapp

### Embed Badge

![Health badge](/badges/mehrdad-dadkhah-article-scrapping-php-wrapper/health.svg)

```
[![Health](https://phpackages.com/badges/mehrdad-dadkhah-article-scrapping-php-wrapper/health.svg)](https://phpackages.com/packages/mehrdad-dadkhah-article-scrapping-php-wrapper)
```

###  Alternatives

[matomo/matomo

Matomo is the leading Free/Libre open analytics platform

21.7k38.9k](/packages/matomo-matomo)[civicrm/civicrm-core

Open source constituent relationship management for non-profits, NGOs and advocacy organizations.

751291.4k43](/packages/civicrm-civicrm-core)[spatie/laravel-export

Create a static site bundle from a Laravel app

674146.0k6](/packages/spatie-laravel-export)[georgringer/news

News system - Versatile news system based on Extbase &amp; Fluid and using the latest technologies provided by TYPO3 CMS.

2985.3M123](/packages/georgringer-news)[illuminate/process

The Illuminate Process package.

44869.2k99](/packages/illuminate-process)[dagger/dagger

Dagger PHP SDK

261.1k](/packages/dagger-dagger)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)
