LLaMA-Factory-Mirror/examples/merge_lora/README.md

127 B

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)