Download
State-of-the-art transformers, brick by brick. Curated Transformers is a transformer library for PyTorch. It provides state-of-the-art models that are composed of a set of reusable components. Supports state-of-the-art transformer models, including LLMs such as Falcon, Llama, and Dolly v2. Implementing a feature or bugfix benefits all models. For example, all models support 4/8-bit inference through the bitsandbytes library and each model can use the PyTorch meta device to avoid unnecessary allocations and initialization.
Features
- Each model is composed from a set of reusable building blocks, providing many benefits
- Consistent type annotations of all public APIs
- Integrates well with your existing type-checked code
- Great for education, because the building blocks are easy to study
- Minimal dependencies
- Adding new models to the library is low-effort
Project Samples
License
MIT LicenseFollow Curated Transformers
Other Useful Business Software
Cut Cloud Costs with Google Compute Engine
Save on compute costs with Compute Engine. Reduce your batch jobs and workload bill 60-91% with Spot VMs. Compute Engine's committed use offers customers up to 70% savings through sustained use discounts. Plus, you get one free e2-micro VM monthly and $300 credit to start.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Curated Transformers!
