Quark3Tokenizer / tokenizer.json
ThingsAI's picture
BPE 16k tokenizer, Italian-first bilingual with ChatML
a101152 verified
Raw
History Contribute Delete
1.12 MB
File too large to display, you can check the raw version instead.