LLaMA-Factory-Mirror/Dockerfile

FROM nvcr.io/nvidia/pytorch:24.01-py3

WORKDIR /app

COPY requirements.txt /app/
RUN pip install -r requirements.txt

COPY . /app/
RUN pip install -e .[metrics,bitsandbytes,qwen]

VOLUME [ "/root/.cache/huggingface/", "/app/data", "/app/output" ]
EXPOSE 7860

CMD [ "llamafactory-cli", "webui" ]
Use official Nvidia base image Note that the flash-attn library is installed in this image and the qwen model will use it automatically. However, if the the host machine's GPU is not compatible with the library, an exception will be raised during the training process as follows: FlashAttention only supports Ampere GPUs or newer. So if the --flash_attn flag is not set, an additional patch for the qwen model's config is necessary to set the default value of use_flash_attn from "auto" to False. 2024-03-14 18:03:33 +08:00			`FROM nvcr.io/nvidia/pytorch:24.01-py3`
Add dockerize support Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure. 2024-03-08 10:47:28 +08:00
			`WORKDIR /app`

			`COPY requirements.txt /app/`
improve Docker build and runtime parameters Modify installation method of extra python library. Utilize shared memory of the host machine to increase training performance. 2024-03-12 14:05:10 +08:00			`RUN pip install -r requirements.txt`
Add dockerize support Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure. 2024-03-08 10:47:28 +08:00
			`COPY . /app/`
rename package 2024-05-16 18:39:08 +08:00			`RUN pip install -e .[metrics,bitsandbytes,qwen]`
Add dockerize support Already tested with the model of Qwen:1.8B and the dataset of alpaca_data_zh. Some python libraries are added to the Dockerfile as a result of the exception messages displayed throughout test procedure. 2024-03-08 10:47:28 +08:00
			`VOLUME [ "/root/.cache/huggingface/", "/app/data", "/app/output" ]`
			`EXPOSE 7860`

fix: splitted Dockerfile's CMD 2024-05-07 14:09:48 +08:00			`CMD [ "llamafactory-cli", "webui" ]`