add the pre-built version of bitsandbytes library for windows user

This commit is contained in:
codemayq 2023-07-03 13:58:10 +08:00
parent 0db9d29111
commit d3b30ecde3
1 changed files with 6 additions and 0 deletions

View File

@ -89,6 +89,12 @@ huggingface-cli login
And **powerful GPUs**!
If you want to enable LoRA(QLoRA) or Freeze quantization on Windows, you will be required to install a pre-built version of `bitsandbytes` library, which supports CUDA 11.1 to 12.1.
```
pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl
```
## Getting Started
### Data Preparation (optional)