ettin-encoder-400m-tokenizer-fix / tokenizer_config.json

Commit History

fix: apply tokenizer fixes (taken from my ModernBERT repo: https://huggingface.co/stefan-it/ModernBERT-large-tokenizer-fix/blob/main/tokenizer_config.json)
82d97b3
verified

stefan-it commited on

feat: import original files from main (7662476d60abb071a5bd319c9f3074f3072c062d)
7a55cb0
verified

stefan-it commited on