PHPackages                             scheldejonas/phpunit-php-token-stream - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Parsing & Serialization](/categories/parsing)
4. /
5. scheldejonas/phpunit-php-token-stream

ActiveLibrary[Parsing & Serialization](/categories/parsing)

scheldejonas/phpunit-php-token-stream
=====================================

Wrapper around PHP's tokenizer extension.

4.0.5(5y ago)0208BSD-3-ClausePHP ^7.3 || ^8.0

Since Sep 23Compare

[ Source](https://github.com/scheldejonas/phpunit-php-token-stream)[ Packagist](https://packagist.org/packages/scheldejonas/phpunit-php-token-stream)[ Docs](https://github.com/sebastianbergmann/php-token-stream/)[ GitHub Sponsors](https://github.com/sebastianbergmann)[ RSS](/packages/scheldejonas-phpunit-php-token-stream/feed)WikiDiscussions Synced 1mo ago

READMEChangelogDependencies (1)Versions (38)Used By (0)

### README not available

The README for this package hasn't been synced yet. View it on [GitHub](https://github.com/scheldejonas/phpunit-php-token-stream).

###  Health Score

33

—

LowBetter than 74% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity11

Limited adoption so far

Community2

Small or concentrated contributor base

Maturity80

Battle-tested with a long release history

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~82 days

Recently: every ~47 days

Total

37

Last Release

2003d ago

Major Versions

1.4.11 → 2.0.02017-08-03

1.4.12 → 3.0.02018-02-01

3.1.x-dev → 4.0.02020-02-07

PHP version history (6 changes)1.1.4PHP >=5.2.7

1.1.5PHP >=5.3.3

2.0.0PHP ^7.0

3.0.0PHP ^7.1

4.0.0PHP ^7.3

4.0.3PHP ^7.3 || ^8.0

### Community

Maintainers

![](https://www.gravatar.com/avatar/f2de6e4fecc0228fcf874f2025ac740913533d0efad64cc326a9fc4ced4daf44?d=identicon)[scheldejonas](/maintainers/scheldejonas)

---

Tags

tokenizer

###  Code Quality

TestsPHPUnit

### Embed Badge

![Health badge](/badges/scheldejonas-phpunit-php-token-stream/health.svg)

```
[![Health](https://phpackages.com/badges/scheldejonas-phpunit-php-token-stream/health.svg)](https://phpackages.com/packages/scheldejonas-phpunit-php-token-stream)
```

###  Alternatives

[yethee/tiktoken

PHP version of tiktoken

1583.1M15](/packages/yethee-tiktoken)[gioni06/gpt3-tokenizer

PHP package for Byte Pair Encoding (BPE) used by GPT-3.

85537.5k8](/packages/gioni06-gpt3-tokenizer)[rajentrivedi/tokenizer-x

TokenizerX calculates required tokens for given prompt

91214.0k3](/packages/rajentrivedi-tokenizer-x)[nicoswd/php-rule-parser

Rule Engine - Rule Parser & Evaluator

13078.6k7](/packages/nicoswd-php-rule-parser)[jeremeamia/functionparser

Function parser for PHP functions, methods, and closures

48169.7k6](/packages/jeremeamia-functionparser)[danny50610/bpe-tokeniser

PHP port for openai/tiktoken (most)

10422.0k1](/packages/danny50610-bpe-tokeniser)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)