PHPackages                             mathematicator-core/tokenizer - PHPackages - PHPackages  [Skip to content](#main-content)[PHPackages](/)[Directory](/)[Categories](/categories)[Trending](/trending)[Leaderboard](/leaderboard)[Changelog](/changelog)[Analyze](/analyze)[Collections](/collections)[Log in](/login)[Sign up](/register)

1. [Directory](/)
2. /
3. [Parsing &amp; Serialization](/categories/parsing)
4. /
5. mathematicator-core/tokenizer

ActiveLibrary[Parsing &amp; Serialization](/categories/parsing)

mathematicator-core/tokenizer
=============================

Math Tokenizer

v3.0.1(5y ago)104.9k[4 PRs](https://github.com/mathematicator-core/tokenizer/pulls)6MITPHP ^8.0

Since Jul 25Compare

[ Source](https://github.com/mathematicator-core/tokenizer)[ Packagist](https://packagist.org/packages/mathematicator-core/tokenizer)[ Docs](https://github.com/mathematicator-core/tokenizer)[ RSS](/packages/mathematicator-core-tokenizer/feed)WikiDiscussions Synced 1mo ago

READMEChangelogDependencies (12)Versions (21)Used By (6)

### README not available

The README for this package hasn't been synced yet. View it on [GitHub](https://github.com/mathematicator-core/tokenizer).

###  Health Score

36

—

LowBetter than 82% of packages

Maintenance20

Infrequent updates — may be unmaintained

Popularity27

Limited adoption so far

Community9

Small or concentrated contributor base

Maturity73

Established project with proven stability

How is this calculated?**Maintenance (25%)** — Last commit recency, latest release date, and issue-to-star ratio. Uses a 2-year decay window.

**Popularity (30%)** — Total and monthly downloads, GitHub stars, and forks. Logarithmic scaling prevents top-heavy scores.

**Community (15%)** — Contributors, dependents, forks, watchers, and maintainers. Measures real ecosystem engagement.

**Maturity (30%)** — Project age, version count, PHP version support, and release stability.

###  Release Activity

Cadence

Every ~43 days

Recently: every ~64 days

Total

14

Last Release

1923d ago

Major Versions

v1.0.6 → v2.0.02020-04-14

v2.1.2 → v3.0.02021-02-10

PHP version history (3 changes)v1.0.0PHP &gt;=7.1

v2.1.0PHP &gt;=7.2

v3.0.0PHP ^8.0

### Community

Maintainers

![](https://avatars.githubusercontent.com/u/3382204?v=4)[baraja](/maintainers/baraja)[@baraja](https://github.com/baraja)

---

Tags

phpmathtokenizermathematicator

###  Code Quality

Static AnalysisPHPStan

Type Coverage Yes

### Embed Badge

![Health badge](/badges/mathematicator-core-tokenizer/health.svg)

```
[![Health](https://phpackages.com/badges/mathematicator-core-tokenizer/health.svg)](https://phpackages.com/packages/mathematicator-core-tokenizer)
```

###  Alternatives

[rajentrivedi/tokenizer-x

TokenizerX calculates required tokens for given prompt

91214.0k3](/packages/rajentrivedi-tokenizer-x)[nikic/phlexy

Lexing experiments in PHP

162570.9k13](/packages/nikic-phlexy)[corveda/php-sandbox

A PHP library that can be used to run PHP code in a sandboxed environment

23483.5k2](/packages/corveda-php-sandbox)[bupy7/xml-constructor

The array-like constructor of XML document structure.

1337.9k](/packages/bupy7-xml-constructor)

PHPackages © 2026

[Directory](/)[Categories](/categories)[Trending](/trending)[Changelog](/changelog)[Analyze](/analyze)
