neuroflow-cpp / scripts

530 kB

Ctrl+K

1 contributor

History: 1 commit

cwenzi

Upload folder using huggingface_hub

26d5b81 verified 3 days ago

check_json_format.py

677 Bytes
Upload folder using huggingface_hub 3 days ago
config_generator.py

8.14 kB
Upload folder using huggingface_hub 3 days ago
continue_curriculum.sh

1.09 kB
Upload folder using huggingface_hub 3 days ago
curriculum_train.sh

2.21 kB
Upload folder using huggingface_hub 3 days ago
curriculum_v2.sh

2.15 kB
Upload folder using huggingface_hub 3 days ago
curriculum_v3.sh

1.16 kB
Upload folder using huggingface_hub 3 days ago
deploy_dsw.sh

7.29 kB
Upload folder using huggingface_hub 3 days ago
deploy_tianchi.sh

5.82 kB
Upload folder using huggingface_hub 3 days ago
direct_train.sh

1.1 kB
Upload folder using huggingface_hub 3 days ago
extract_prompts.py

4.28 kB
Upload folder using huggingface_hub 3 days ago
gen_distill_data.py

6.36 kB
Upload folder using huggingface_hub 3 days ago
gen_distill_full.py

11.4 kB
Upload folder using huggingface_hub 3 days ago
gen_from_prompts.py

3.66 kB
Upload folder using huggingface_hub 3 days ago
infer_full.py

13.2 kB
Upload folder using huggingface_hub 3 days ago
lmh2_to_lmh1.py

6.48 kB
Upload folder using huggingface_hub 3 days ago
mix_training_data.py

3.9 kB
Upload folder using huggingface_hub 3 days ago
pad_tokenizer.py

856 Bytes
Upload folder using huggingface_hub 3 days ago
prepare_training_data.py

13.3 kB
Upload folder using huggingface_hub 3 days ago
preprocess_128k.sh

1.22 kB
Upload folder using huggingface_hub 3 days ago
preprocess_all.sh

1.08 kB
Upload folder using huggingface_hub 3 days ago
preprocess_corpus.py

14.8 kB
Upload folder using huggingface_hub 3 days ago
preprocess_distill.py

1.43 kB
Upload folder using huggingface_hub 3 days ago
rebuild_tokenizer.py

940 Bytes
Upload folder using huggingface_hub 3 days ago
stub_evaluator.py

5.78 kB
Upload folder using huggingface_hub 3 days ago
test_generate

295 kB
xet

Upload folder using huggingface_hub 3 days ago
test_generate.cpp

6.81 kB
Upload folder using huggingface_hub 3 days ago
test_nan.cpp

9.31 kB
Upload folder using huggingface_hub 3 days ago
train_128k_tokenizer.py

10.6 kB
Upload folder using huggingface_hub 3 days ago
train_distill.py

16.3 kB
Upload folder using huggingface_hub 3 days ago
train_optimized.sh

5.33 kB
Upload folder using huggingface_hub 3 days ago
video_downloader.cpp

52.3 kB
Upload folder using huggingface_hub 3 days ago
vocab_adapter.py

4.93 kB
Upload folder using huggingface_hub 3 days ago
vocab_converter.py

4.17 kB
Upload folder using huggingface_hub 3 days ago
vocab_minification.py

6.31 kB
Upload folder using huggingface_hub 3 days ago