p04798526
/
LLaMA-Factory-Mirror
1
0
Fork 1
Code Issues Pull Requests Packages Projects Releases Wiki Activity
LLaMA-Factory-Mirror/examples/lora_single_gpu
History
hiyouga d07ad5cc1c support vllm 2024-03-07 20:26:31 +08:00
..
README.md support vllm 2024-03-07 20:26:31 +08:00
dpo.sh update examples 2024-03-06 13:14:57 +08:00
ppo.sh update examples 2024-03-06 13:14:57 +08:00
predict.sh update examples 2024-03-06 13:14:57 +08:00
pretrain.sh update examples 2024-03-06 13:14:57 +08:00
reward.sh update examples 2024-03-06 13:14:57 +08:00
sft.sh update examples 2024-03-06 13:14:57 +08:00

README.md

Usage:

  • pretrain.sh: do pre-train (optional)
  • sft.sh: do supervised fine-tune
  • reward.sh: do reward modeling (must after sft.sh)
  • ppo.sh: do PPO training (must after sft.sh and reward.sh)
  • dpo.sh: do DPO training (must after sft.sh)
  • predict.sh: do predict (must after sft.sh and dpo.sh)