p04798526
/
LLaMA-Factory-Mirror
1
0
Fork 1
Code Issues Pull Requests Packages Projects Releases Wiki Activity
LLaMA-Factory-Mirror/examples/fsdp_qlora
History
hiyouga 8408225162 support fsdp + qlora 2024-03-21 00:36:06 +08:00
..
README.md support fsdp + qlora 2024-03-21 00:36:06 +08:00
fsdp.sh support fsdp + qlora 2024-03-21 00:36:06 +08:00

README.md 

pip install git+https://github.com/huggingface/transformers.git
pip install "accelerate>=0.28.0"
pip install "bitsandbytes>=0.43.0"