PHPackages                             dhii/tokenizer-abstract - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. dhii/tokenizer-abstract

ActiveLibrary[Utility & Helpers](/categories/utility)

dhii/tokenizer-abstract
=======================

Abstract common functionality for tokenizers.

044PHP

Since Aug 27Pushed 8y ago2 watchersCompare

[ Source](https://github.com/Dhii/tokenizer-abstract)[ Packagist](https://packagist.org/packages/dhii/tokenizer-abstract)[ RSS](/packages/dhii-tokenizer-abstract/feed)WikiDiscussions develop Synced 3w ago

READMEChangelogDependenciesVersions (2)Used By (0)

Dhii - Tokenizer - Abstract
===========================

[](#dhii---tokenizer---abstract)

[![Build Status](https://camo.githubusercontent.com/bd382ae71f6bd6d9a5125fb0d85d131646d8e6b96b5b5e94d6a4a7485a16ea05/68747470733a2f2f7472617669732d63692e6f72672f646869692f746f6b656e697a65722d61627374726163742e7376673f6272616e63683d6d6173746572)](https://travis-ci.org/dhii/tokenizer-abstract)[![Code Climate](https://camo.githubusercontent.com/66a69166c24851b61031e596878e292c59789ec361752a24392c808491a088ad/68747470733a2f2f636f6465636c696d6174652e636f6d2f6769746875622f646869692f746f6b656e697a65722d61627374726163742f6261646765732f6770612e737667)](https://codeclimate.com/github/dhii/tokenizer-abstract)[![Test Coverage](https://camo.githubusercontent.com/7ae1adebfde9f885b45e0f2b5d19765f890ff9fbc98d4c1be9f1898ad63613b1/68747470733a2f2f636f6465636c696d6174652e636f6d2f6769746875622f646869692f746f6b656e697a65722d61627374726163742f6261646765732f636f7665726167652e737667)](https://codeclimate.com/github/dhii/tokenizer-abstract/coverage)[![Latest Stable Version](https://camo.githubusercontent.com/8c7066abdcb9b39df1e1e21c1e3b0c69cb3cd1f12bc451c0094f01071ffd19af/68747470733a2f2f706f7365722e707567782e6f72672f646869692f746f6b656e697a65722d61627374726163742f76657273696f6e)](https://packagist.org/packages/dhii/tokenizer-abstract)[![This package complies with Dhii standards](https://camo.githubusercontent.com/44bbe8c7678c1784cfc53cabce5d3e32fc22a840453c5ed9c08601522fe7c213/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f446869692d436f6d706c69616e742d677265656e2e7376673f7374796c653d666c61742d737175617265)](https://github.com/Dhii/dhii)

Abstract common functionality for tokenizers.

###  Health Score

22

—

LowBetter than 21% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity8

Limited adoption so far

Community8

Small or concentrated contributor base

Maturity43

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

### Community

Maintainers

![](https://www.gravatar.com/avatar/1894e91b32c9f80d8f30a42d360af6983a507f1cf2c621b7c9a0a0de14e011c5?d=identicon)[XedinUnknown](/maintainers/XedinUnknown)

---

Top Contributors

[![XedinUnknown](https://avatars.githubusercontent.com/u/1428973?v=4)](https://github.com/XedinUnknown "XedinUnknown (21 commits)")

### Embed Badge

![Health badge](/badges/dhii-tokenizer-abstract/health.svg)

```
[![Health](https://phpackages.com/badges/dhii-tokenizer-abstract/health.svg)](https://phpackages.com/packages/dhii-tokenizer-abstract)
```

###  Alternatives

[sbine/route-viewer

A Laravel Nova tool to view your registered routes.

57239.7k](/packages/sbine-route-viewer)[mostafaznv/php-x-sendfile

Serve large files using web server with support for laravel

5312.0k](/packages/mostafaznv-php-x-sendfile)[keyword-extractor/keyword-extractor

A package to extract keywords from text

118.7k](/packages/keyword-extractor-keyword-extractor)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)