LLaMA-Factory

LLaMA-Factory is a fine-tuning and training framework for Meta's LLaMA language models. It enables researchers and developers to train and customize LLaMA models efficiently using advanced optimization techniques.

Features

Supports fine-tuning of LLaMA models for specific tasks
Optimized training with LoRA and QLoRA to reduce resource usage
Provides pre-configured training scripts for faster setup
Multi-GPU and distributed training support for scalability
Integrates seamlessly with Hugging Face Transformers
Compatible with FP16 and BF16 precision for efficient computation

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow LLaMA-Factory

LLaMA-Factory Web Site

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Rate This Project

User Reviews

Be the first to post a review of LLaMA-Factory!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Artificial Intelligence Software, Python Large Language Models (LLM)

Registered

2025-03-04

Similar Business Software

LLaMA-Factory

LLaMA-Factory is an open source platform designed to streamline and enhance the fine-tuning process of over 100 Large Language Models (LLMs) and Vision-Language Models (VLMs). It supports various fine-tuning techniques, including Low-Rank Adaptation (LoRA), Quantized LoRA (QLoRA), and...

See Software
Vertex AI

Build, deploy, and scale machine learning (ML) models faster, with fully managed ML tools for any use case. Through Vertex AI Workbench, Vertex AI is natively integrated with BigQuery, Dataproc, and Spark. You can use BigQuery ML to create and execute machine learning models in BigQuery...

See Software
Google Cloud BigQuery

BigQuery is a serverless, multicloud data warehouse that simplifies the process of working with all types of data so you can focus on getting valuable business insights quickly. At the core of Google’s data cloud, BigQuery allows you to simplify data integration, cost effectively and securely...

See Software
LM-Kit.NET

LM-Kit.NET is a cutting-edge, high-level inference SDK designed specifically to bring the advanced capabilities of Large Language Models (LLM) into the C# ecosystem. Tailored for developers working within .NET, LM-Kit.NET provides a comprehensive suite of powerful Generative AI tools, making...

See Software
LTX

Control every aspect of your video using AI, from ideation to final edits, on one holistic platform. We’re pioneering the integration of AI and video production, enabling the transformation of a single idea into a cohesive, AI-generated video. LTX empowers individuals to share their visions,...

See Software
Pipedrive

Pipedrive is a web-based sales CRM (customer relationship management) software that lets sales teams track pipelines, optimize leads, manage deals and automate their entire sales process to focus on selling. Pipedrive’s simple interface empowers salespeople to streamline workflows and unite...

See Software

Report inappropriate content

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Get an email when there's a new version of LLaMA-Factory

Features

Project Samples

Project Activity

Categories

License

Follow LLaMA-Factory

User Reviews

Additional Project Details

Operating Systems

Programming Language

Related Categories

Registered