p04798526
/
LLaMA-Factory-310P3
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
LLaMA-Factory-310P3/examples/inference/llama3_vllm.yaml

5 lines
118 B
YAML
Raw Permalink Blame History

model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
template: llama3
infer_backend: vllm
vllm_enforce_eager: true
Reference in New Issue View Git Blame Copy Permalink