LlamaFactory/scripts
hiyouga c1768cfb14 support batch infer in vllm
Former-commit-id: 3ef5ed3b9a44eed2f7e3ff221dfc343d0a97c0b5
2024-12-04 13:50:00 +00:00
..
api_example support batch infer in vllm 2024-12-04 13:50:00 +00:00
convert_ckpt support batch infer in vllm 2024-12-04 13:50:00 +00:00
stat_utils support batch infer in vllm 2024-12-04 13:50:00 +00:00
llama_pro.py use pre-commit 2024-10-29 09:07:46 +00:00
loftq_init.py use pre-commit 2024-10-29 09:07:46 +00:00
pissa_init.py use pre-commit 2024-10-29 09:07:46 +00:00
vllm_infer.py support batch infer in vllm 2024-12-04 13:50:00 +00:00