OpenRLHF is an easy-to-use, scalable, and high-performance framework for Reinforcement Learning with Human Feedback (RLHF). It supports various training techniques and model architectures.
Features
- Implements Proximal Policy Optimization (PPO) for training
- Supports Iterative Direct Preference Optimization (DPO)
- Provides Low-Rank Adaptation (LoRA) for efficient fine-tuning
- Includes RingAttention and Retrieval-augmented Fine-Tuning (RFT)
- Scales to large models with high performance
- Offers comprehensive documentation and examples
Categories
Machine Learning, Reinforcement Learning Frameworks, Reinforcement Learning Libraries, Reinforcement Learning AlgorithmsLicense
Apache License V2.0Follow OpenRLHF
Other Useful Business Software
Managed MySQL, PostgreSQL, and SQL Databases on Google Cloud
Cloud SQL is a fully managed relational database for MySQL, PostgreSQL, and SQL Server. We handle patching, backups, replication, encryption, and failover—so you can focus on your app. Migrate from on-prem or other clouds with free Database Migration Service. IDC found customers achieved 246% ROI. New customers get $300 in credits plus a 30-day free trial.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of OpenRLHF!