Hugging Face's logo

pvlabs
/
Chytrej2-Tokenizer

tokenizer
Model card Files
xet
 Community

Chytrej2-Tokenizer

A custom 32k vocab BPE tokenizer trained on the FineWeb Edu dataset. Will be used for all Chytrej2 series models.

Built by PingVortex Labs.

Tokenizer Details

  • Vocab: 32k
  • License: MIT

Made by PingVortex.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including pvlabs/Chytrej2-Tokenizer