Download
LitGPT is a collection of over 20 high-performance large language models (LLMs) accompanied by recipes to pretrain, finetune, and deploy them at scale. It provides implementations without abstractions, making it beginner-friendly while offering advanced features like flash attention and support for various precision levels. LitGPT is designed to run efficiently across multiple GPUs or TPUs, catering to both small-scale and large-scale deployments.
Features
- Collection of 20+ high-performance LLMs
- Recipes for pretraining and finetuning models
- Scalable deployment across GPUs and TPUs
- Beginner-friendly implementations without abstractions
- Support for flash attention mechanisms
- Flexible precision levels (fp4/8/16/32)
- Integration with Lightning AI platform
- Extensive tutorials and documentation
- Active community and support channels
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LitGPT
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LitGPT!
