ThingAI
/

Quark3Tokenizer

Model card Files Files and versions

Quark3Tokenizer

1.12 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

ThingsAI's picture

BPE 16k tokenizer, Italian-first bilingual with ChatML

a101152 verified about 20 hours ago

.gitattributes

1.52 kB
initial commit about 20 hours ago
special_tokens_map.json

146 Bytes
BPE 16k tokenizer, Italian-first bilingual with ChatML about 20 hours ago
tokenizer.json

1.12 MB
BPE 16k tokenizer, Italian-first bilingual with ChatML about 20 hours ago
tokenizer_config.json

418 Bytes
BPE 16k tokenizer, Italian-first bilingual with ChatML about 20 hours ago