p04798526
/
LLaMA-Factory-Mirror
1
0
Fork 1
Code Issues Pull Requests Packages Projects Releases Wiki Activity
LLaMA-Factory-Mirror/examples/merge_lora
History
hiyouga d07ad5cc1c support vllm 2024-03-07 20:26:31 +08:00
..
README.md support vllm 2024-03-07 20:26:31 +08:00
merge.sh support vllm 2024-03-07 20:26:31 +08:00
quantize.sh support vllm 2024-03-07 20:26:31 +08:00

README.md

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)