PHPackages                             mehrdad-dadkhah/article-scrapping-php-wrapper - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility &amp; Helpers](/categories/utility)
4. /
5. mehrdad-dadkhah/article-scrapping-php-wrapper

ActiveLibrary[Utility &amp; Helpers](/categories/utility)

mehrdad-dadkhah/article-scrapping-php-wrapper
=============================================

Simple php wrapper on Newspaper3k Article scraping &amp; curation

1.0.5(5y ago)41162[1 issues](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper/issues)[1 PRs](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper/pulls)GPL-3.0-or-laterPythonPHP &gt;=7.0CI failing

Since Jun 13Pushed 2y ago1 watchersCompare

[ Source](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper)[ Packagist](https://packagist.org/packages/mehrdad-dadkhah/article-scrapping-php-wrapper)[ Docs](https://github.com/Mehrdad-Dadkhah/article-scrapping-php-wrapper)[ RSS](/packages/mehrdad-dadkhah-article-scrapping-php-wrapper/feed)WikiDiscussions master Synced today

READMEChangelog (3)Dependencies (1)Versions (10)Used By (0)

article-scrapping-php-wrapper
=============================

[](#article-scrapping-php-wrapper)

Simple php wrapper on Newspaper3k Article scraping &amp; curation

[![Software License](https://camo.githubusercontent.com/e1514dd3f2095dbf68a0008ae62a631142953ad2e86aa94c504343f2c2c191da/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6c6963656e73652d47504c2d627269676874677265656e2e7376673f7374796c653d666c61742d737175617265)](LICENSE)[![Packagist Version](https://camo.githubusercontent.com/52898b15c7d10cda49e430910a0a80b546f7bdc6fb88e5bb0612515ff798618e/68747470733a2f2f696d672e736869656c64732e696f2f7061636b61676973742f762f4d6568726461642d4461646b6861682f61727469636c652d736372617070696e672d7068702d777261707065722e7376673f7374796c653d666c61742d737175617265)](https://packagist.org/packages/Mehrdad-Dadkhah/ArticleScrappingPhpWrapper)

Features
--------

[](#features)

- Multi-threaded article download framework
- News url identification
- Text extraction from html
- Top image extraction from html
- All image extraction from html
- Keyword extraction from text
- Summary extraction from text
- Author extraction from text
- Google trending terms extraction
- Works in 10+ languages (English, Chinese, German, Arabic, ...)

.. code-block:: pycon

```
>>> import newspaper
>>> newspaper.languages()

Your available languages are:
input code      full name

  ar              Arabic
  be              Belarusian
  bg              Bulgarian
  da              Danish
  de              German
  el              Greek
  en              English
  es              Spanish
  et              Estonian
  fa              Persian
  fi              Finnish
  fr              French
  he              Hebrew
  hi              Hindi
  hr              Croatian
  hu              Hungarian
  id              Indonesian
  it              Italian
  ja              Japanese
  ko              Korean
  lt              Lithuanian
  mk              Macedonian
  nb              Norwegian (Bokmål)
  nl              Dutch
  no              Norwegian
  pl              Polish
  pt              Portuguese
  ro              Romanian
  ru              Russian
  sl              Slovenian
  sr              Serbian
  sv              Swedish
  sw              Swahili
  th              Thai
  tr              Turkish
  uk              Ukrainian
  vi              Vietnamese
  zh              Chinese

```

Get it now
----------

[](#get-it-now)

Run ✅ `pip3 install newspaper3k` ✅

NOT ⛔ `pip3 install newspaper` ⛔

On python3 you must install `newspaper3k`, **not** `newspaper`. `newspaper` is our python2 library. Although installing newspaper is simple with `pip `\_, you will run into fixable issues if you are trying to install on ubuntu.

**If you are on Debian / Ubuntu**, install using the following:

- Install `pip3` command needed to install `newspaper3k` package::

    $ sudo apt-get install python3-pip
- Python development version, needed for Python.h::

    $ sudo apt-get install python-dev
- lxml requirements::

    $ sudo apt-get install libxml2-dev libxslt-dev
- For PIL to recognize .jpg images::

    $ sudo apt-get install libjpeg-dev zlib1g-dev libpng12-dev

NOTE: If you find problem installing `libpng12-dev`, try installing `libpng-dev`.

- Download NLP related corpora::

    $ curl [https://raw.githubusercontent.com/codelucas/newspaper/master/download\_corpora.py](https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py) | python3
- Install the distribution via pip::

    $ pip3 install newspaper3k

**If you are on OSX**, install using the following, you may use both homebrew or macports:

::

```
$ brew install libxml2 libxslt

$ brew install libtiff libjpeg webp little-cms2

$ pip3 install newspaper3k

$ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python3

```

**Otherwise**, install with the following:

NOTE: You will still most likely need to install the following libraries via your package manager

- PIL: `libjpeg-dev` `zlib1g-dev` `libpng12-dev`
- lxml: `libxml2-dev` `libxslt-dev`
- Python Development version: `python-dev`

::

```
$ pip3 install newspaper3k

$ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python3

```

Installation
------------

[](#installation)

```
composer require mehrdad-dadkhah/article-scrapping-php-wrapper

```

```
python:

import nltk
nltk.download('all')

```

Usage
-----

[](#usage)

```
use MehrdadDadkhah\Scrapp\ArticleScrappingWrapper;

$parser = new ArticleScrappingWrapper();

$parser->scrapp('your url');
```

Read more
---------

[](#read-more)

(Newspaper)\[\]

(nltk)\[\]

(Scrape &amp; Summarize News Articles Using Python)\[\]

(Corpora Iranian Persian)\[\]

###  Health Score

26

—

LowBetter than 43% of packages

Maintenance15

Infrequent updates — may be unmaintained

Popularity15

Limited adoption so far

Community9

Small or concentrated contributor base

Maturity56

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~13 days

Recently: every ~26 days

Total

9

Last Release

2049d ago

Major Versions

0.1.1 → 1.0.02020-06-18

0.1.2 → 1.0.42020-09-06

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/3860685?v=4)[Mehrdad-Dadkhah](/maintainers/Mehrdad-Dadkhah)[@Mehrdad-Dadkhah](https://github.com/Mehrdad-Dadkhah)

---

Top Contributors

[![Mehrdad-Dadkhah](https://avatars.githubusercontent.com/u/3860685?v=4)](https://github.com/Mehrdad-Dadkhah "Mehrdad-Dadkhah (7 commits)")

---

Tags

language newsarticlepersiannatural-processingNewspaper3kscrapp

### Embed Badge

![Health badge](/badges/mehrdad-dadkhah-article-scrapping-php-wrapper/health.svg)

```
[![Health](https://phpackages.com/badges/mehrdad-dadkhah-article-scrapping-php-wrapper/health.svg)](https://phpackages.com/packages/mehrdad-dadkhah-article-scrapping-php-wrapper)
```

###  Alternatives

[phpoption/phpoption

Option Type for PHP

2.7k541.2M159](/packages/phpoption-phpoption)[georgringer/news

News system - Versatile news system based on Extbase &amp; Fluid and using the latest technologies provided by TYPO3 CMS.

2815.1M90](/packages/georgringer-news)[patrickschur/language-detection

A language detection library for PHP. Detects the language from a given text string.

8513.2M18](/packages/patrickschur-language-detection)[matriphe/iso-639

PHP library to convert ISO-639-1 code to language name.

503.3M6](/packages/matriphe-iso-639)[andrefigueira/blog-article-faker

Generate random blog article titles and content (including markdown) using faker

1415.0k](/packages/andrefigueira-blog-article-faker)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)
