From 031775ade8612e6dab5ae67bcfe93f3ad4b69055 Mon Sep 17 00:00:00 2001 From: hiyouga Date: Fri, 26 Apr 2024 20:09:14 +0800 Subject: [PATCH] update readme --- README.md | 18 +++++++++--------- README_zh.md | 18 +++++++++--------- 2 files changed, 18 insertions(+), 18 deletions(-) diff --git a/README.md b/README.md index d6f59989..eb28c89d 100644 --- a/README.md +++ b/README.md @@ -292,15 +292,15 @@ huggingface-cli login \* *estimated* -| Method | Bits | 7B | 13B | 30B | 70B | 8x7B | 8x22B | -| ----------------- | ---- | ----- | ----- | ----- | ------ | ----- | ------ | -| Full | AMP | 120GB | 240GB | 600GB | 1200GB | 900GB | 2400GB | -| Full | 16 | 60GB | 120GB | 300GB | 600GB | 400GB | 1200GB | -| Freeze | 16 | 20GB | 40GB | 80GB | 200GB | 160GB | 400GB | -| LoRA/GaLore/BAdam | 16 | 16GB | 32GB | 64GB | 160GB | 120GB | 320GB | -| QLoRA | 8 | 10GB | 20GB | 40GB | 80GB | 60GB | 160GB | -| QLoRA | 4 | 6GB | 12GB | 24GB | 48GB | 30GB | 96GB | -| QLoRA | 2 | 4GB | 8GB | 16GB | 24GB | 18GB | 48GB | +| Method | Bits | 7B | 13B | 30B | 70B | 110B | 8x7B | 8x22B | +| ----------------- | ---- | ----- | ----- | ----- | ------ | ------ | ----- | ------ | +| Full | AMP | 120GB | 240GB | 600GB | 1200GB | 2000GB | 900GB | 2400GB | +| Full | 16 | 60GB | 120GB | 300GB | 600GB | 900GB | 400GB | 1200GB | +| Freeze | 16 | 20GB | 40GB | 80GB | 200GB | 360GB | 160GB | 400GB | +| LoRA/GaLore/BAdam | 16 | 16GB | 32GB | 64GB | 160GB | 240GB | 120GB | 320GB | +| QLoRA | 8 | 10GB | 20GB | 40GB | 80GB | 140GB | 60GB | 160GB | +| QLoRA | 4 | 6GB | 12GB | 24GB | 48GB | 72GB | 30GB | 96GB | +| QLoRA | 2 | 4GB | 8GB | 16GB | 24GB | 48GB | 18GB | 48GB | ## Getting Started diff --git a/README_zh.md b/README_zh.md index d0534858..bfcf3870 100644 --- a/README_zh.md +++ b/README_zh.md @@ -292,15 +292,15 @@ huggingface-cli login \* *估算值* -| 方法 | 精度 | 7B | 13B | 30B | 70B | 8x7B | 8x22B | -| ----------------- | ---- | ----- | ----- | ----- | ------ | ----- | ------ | -| Full | AMP | 120GB | 240GB | 600GB | 1200GB | 900GB | 2400GB | -| Full | 16 | 60GB | 120GB | 300GB | 600GB | 400GB | 1200GB | -| Freeze | 16 | 20GB | 40GB | 80GB | 200GB | 160GB | 400GB | -| LoRA/GaLore/BAdam | 16 | 16GB | 32GB | 64GB | 160GB | 120GB | 320GB | -| QLoRA | 8 | 10GB | 20GB | 40GB | 80GB | 60GB | 160GB | -| QLoRA | 4 | 6GB | 12GB | 24GB | 48GB | 30GB | 96GB | -| QLoRA | 2 | 4GB | 8GB | 16GB | 24GB | 18GB | 48GB | +| 方法 | 精度 | 7B | 13B | 30B | 70B | 110B | 8x7B | 8x22B | +| ----------------- | ---- | ----- | ----- | ----- | ------ | ------ | ----- | ------ | +| Full | AMP | 120GB | 240GB | 600GB | 1200GB | 2000GB | 900GB | 2400GB | +| Full | 16 | 60GB | 120GB | 300GB | 600GB | 900GB | 400GB | 1200GB | +| Freeze | 16 | 20GB | 40GB | 80GB | 200GB | 360GB | 160GB | 400GB | +| LoRA/GaLore/BAdam | 16 | 16GB | 32GB | 64GB | 160GB | 240GB | 120GB | 320GB | +| QLoRA | 8 | 10GB | 20GB | 40GB | 80GB | 140GB | 60GB | 160GB | +| QLoRA | 4 | 6GB | 12GB | 24GB | 48GB | 72GB | 30GB | 96GB | +| QLoRA | 2 | 4GB | 8GB | 16GB | 24GB | 48GB | 18GB | 48GB | ## 如何使用