From d3b30ecde31ef36c9cb1326666996aee838a55d2 Mon Sep 17 00:00:00 2001 From: codemayq Date: Mon, 3 Jul 2023 13:58:10 +0800 Subject: [PATCH] add the pre-built version of bitsandbytes library for windows user --- README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/README.md b/README.md index 14941517..e1e03ca1 100644 --- a/README.md +++ b/README.md @@ -89,6 +89,12 @@ huggingface-cli login And **powerful GPUs**! +If you want to enable LoRA(QLoRA) or Freeze quantization on Windows, you will be required to install a pre-built version of `bitsandbytes` library, which supports CUDA 11.1 to 12.1. + +``` +pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl +``` + ## Getting Started ### Data Preparation (optional)