LLaMA-Factory: 大语言模型统一高效微调框架（ACL 2024） [24 03 21] Our paper "LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models" is available at arXiv! [24 03 20] We supported FSDP+QLoRA that fine-tunes a 70B model on 2x24GB GPUs
llamafactory · PyPI docker run -it --rm --gpus = all --ipc = host hiyouga llamafactory:latest This image is built on Ubuntu 22 04 (x86_64), CUDA 12 4, Python 3 11, PyTorch 2 6 0, and Flash-attn 2 7 4