Crates / tokenizers / Maintained?
Rust crate maintenance · data Oct 27, 2026
Is tokenizers still maintained?
Short answerYes: actively maintained. tokenizers's newest version, 1.0.0-rc.3, shipped on Oct 19, 2026 (8 days ago). It has had 5 releases in the last 12 months and 16 in 24, and 42 non-yanked versions since 2019. 1,028 crates depend on it and it gets 183,031 real downloads a day.
The signals
- Last release: 8 days ago (1.0.0-rc.3, Oct 19, 2026).
- Release rhythm: 5 in the last year, 16 in two.
- Still used: 183,031 real downloads a day, quiet-day trend +20% against the field.
- Yanked versions: 1 (a normal sign of a maintainer fixing a bad release).
Releases per quarter, last 2 years
| Quarter | Releases | |
|---|---|---|
| Oct 30 to Jan 28, 2025 | 5 | |
| Jan 29 to Apr 29, 2025 | 1 | |
| Apr 30 to Jul 29, 2025 | 3 | |
| Jul 30 to Oct 28, 2025 | 2 | |
| Oct 29 to Jan 27, 2026 | 1 | |
| Jan 28 to Apr 28, 2026 | 1 | |
| Apr 29 to Jul 28, 2026 | 0 | |
| Jul 29 to Oct 27, 2026 | 3 |
If you need something more active
Rules
From crates.io release history (non-yanked versions), fetched Oct 27, 2026: last release within 6 months = actively maintained; within 18 months = slow cadence; older with 1,000+ dependents = quiet and widely relied on; otherwise quiet. We do not read commits or issues: a crate can be finished and safe without new releases, and active on GitHub without publishing. Before you rely on it, look at the repository for recent commits and open issues. Run cargo audit for security advisories.
Up next
The full numbers: Widely used and gaining. Chart, alternatives and badge.tokenizersRust crate. Fastest implementation of the most used tokenizers in AI. Real use: 183K downloads a day on quiet days; 1,028 crates depend on it.Read it next →Also worth your time
Art: Nicholas Roerich, Nag Lake (1925). Public domain, via Wikimedia Commons.
.jpg){kind=link}