gi111f11cb7f354a74a8c123f5b155498e
/
MobileLLM-1B_a13581075518844928403906
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
MobileLLM-1B_a1358107551884.../tokenizer_config.json

1 line
141 B
JSON
Raw Normal View History

first commit
2024-11-13 14:53:13 +08:00
{"bos_token": "", "eos_token": "", "model_max_length": 1000000000000000019884624838656, "tokenizer_class": "LlamaTokenizer", "unk_token": ""}