OpenRLHF is an easy-to-use, scalable, and high-performance framework for Reinforcement Learning with Human Feedback (RLHF). It supports various training techniques and model architectures.

Features

  • Implements Proximal Policy Optimization (PPO) for training
  • Supports Iterative Direct Preference Optimization (DPO)
  • Provides Low-Rank Adaptation (LoRA) for efficient fine-tuning
  • Includes RingAttention and Retrieval-augmented Fine-Tuning (RFT)
  • Scales to large models with high performance
  • Offers comprehensive documentation and examples

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow OpenRLHF

OpenRLHF Web Site

Other Useful Business Software
Managed MySQL, PostgreSQL, and SQL Databases on Google Cloud Icon
Managed MySQL, PostgreSQL, and SQL Databases on Google Cloud

Get back to your application and leave the database to us. Cloud SQL automatically handles backups, replication, and scaling.

Cloud SQL is a fully managed relational database for MySQL, PostgreSQL, and SQL Server. We handle patching, backups, replication, encryption, and failover—so you can focus on your app. Migrate from on-prem or other clouds with free Database Migration Service. IDC found customers achieved 246% ROI. New customers get $300 in credits plus a 30-day free trial.
Try Cloud SQL Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of OpenRLHF!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software, Python Reinforcement Learning Frameworks, Python Reinforcement Learning Libraries, Python Reinforcement Learning Algorithms

Registered

2025-02-04