PHPackages                             dhii/tokenizer-base - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Utility & Helpers](/categories/utility)
4. /
5. dhii/tokenizer-base

ActiveLibrary[Utility & Helpers](/categories/utility)

dhii/tokenizer-base
===================

Base concrete functionality for tokenizers

08PHP

Since Oct 27Pushed 8y ago2 watchersCompare

[ Source](https://github.com/Dhii/tokenizer-base)[ Packagist](https://packagist.org/packages/dhii/tokenizer-base)[ RSS](/packages/dhii-tokenizer-base/feed)WikiDiscussions develop Synced 2w ago

READMEChangelogDependenciesVersions (2)Used By (0)

Dhii - Tokenizer - Base
=======================

[](#dhii---tokenizer---base)

[![Build Status](https://camo.githubusercontent.com/01732d525b97f0f8fb27305d843572b218e306bb638023c05e7865a743c90da6/68747470733a2f2f7472617669732d63692e6f72672f646869692f746f6b656e697a65722d626173652e7376673f6272616e63683d6d6173746572)](https://travis-ci.org/dhii/tokenizer-base)[![Code Climate](https://camo.githubusercontent.com/7dbf2533f6c5838cc9f53ee1fd866477b2be1fd55e9096a91461569aae33c878/68747470733a2f2f636f6465636c696d6174652e636f6d2f6769746875622f646869692f746f6b656e697a65722d626173652f6261646765732f6770612e737667)](https://codeclimate.com/github/dhii/tokenizer-base)[![Test Coverage](https://camo.githubusercontent.com/ce060267c62ea32f44b611d28b6515cf42e2851c6d7a49d74fef3b57659247e5/68747470733a2f2f636f6465636c696d6174652e636f6d2f6769746875622f646869692f746f6b656e697a65722d626173652f6261646765732f636f7665726167652e737667)](https://codeclimate.com/github/dhii/tokenizer-base/coverage)[![Latest Stable Version](https://camo.githubusercontent.com/173a04ba855455a6e8c3d71e8e842375b0178089be4bd23c7fe22c917433a51a/68747470733a2f2f706f7365722e707567782e6f72672f646869692f746f6b656e697a65722d626173652f76657273696f6e)](https://packagist.org/packages/dhii/tokenizer-base)[![This package complies with Dhii standards](https://camo.githubusercontent.com/44bbe8c7678c1784cfc53cabce5d3e32fc22a840453c5ed9c08601522fe7c213/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f446869692d436f6d706c69616e742d677265656e2e7376673f7374796c653d666c61742d737175617265)](https://github.com/Dhii/dhii)

Base concrete functionality for tokenizers

###  Health Score

20

—

LowBetter than 12% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity4

Limited adoption so far

Community8

Small or concentrated contributor base

Maturity43

Maturing project, gaining track record

 Bus Factor1

Top contributor holds 100% of commits — single point of failure

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

### Community

Maintainers

![](https://www.gravatar.com/avatar/1894e91b32c9f80d8f30a42d360af6983a507f1cf2c621b7c9a0a0de14e011c5?d=identicon)[XedinUnknown](/maintainers/XedinUnknown)

---

Top Contributors

[![XedinUnknown](https://avatars.githubusercontent.com/u/1428973?v=4)](https://github.com/XedinUnknown "XedinUnknown (23 commits)")

### Embed Badge

![Health badge](/badges/dhii-tokenizer-base/health.svg)

```
[![Health](https://phpackages.com/badges/dhii-tokenizer-base/health.svg)](https://phpackages.com/packages/dhii-tokenizer-base)
```

###  Alternatives

[cleaniquecoders/shrinkr

Shrinkr is a Laravel package for shortening URLs, with custom slugs, analytics, branded domains, and seamless API integration.

1510.4k](/packages/cleaniquecoders-shrinkr)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)