LLaMA-Factory is a fine-tuning and training framework for Meta's LLaMA language models. It enables researchers and developers to train and customize LLaMA models efficiently using advanced optimization techniques.

Features

  • Supports fine-tuning of LLaMA models for specific tasks
  • Optimized training with LoRA and QLoRA to reduce resource usage
  • Provides pre-configured training scripts for faster setup
  • Multi-GPU and distributed training support for scalability
  • Integrates seamlessly with Hugging Face Transformers
  • Compatible with FP16 and BF16 precision for efficient computation

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow LLaMA-Factory

LLaMA-Factory Web Site

Other Useful Business Software
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of LLaMA-Factory!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Artificial Intelligence Software, Python Large Language Models (LLM)

Registered

2025-03-04