Shypd.aiThe largest open index of AI toolsRLHF-Reward-Modeling is an Open Source tool that provides recipes to train reward models for Reinforcement Learning from Human Feedback (RLHF). It includes various techniques like Bradley-Terry and pairwise preference models.
Trending
About
RLHF-Reward-Modeling is an open-source repository offering comprehensive recipes and code for training reward models essential for Reinforcement Learning from Human Feedback (RLHF). The project supports various advanced techniques, including the classic Bradley-Terry reward model, pairwise preference models, and more recent innovations like Semi-Supervised Reward Modeling (SSRM) and ArmoRM for multi-objective reward modeling. It also provides code for process-supervised and outcome-supervised reward models, as well as decision-tree reward models. The repository emphasizes reproducibility, offering data, code, and hyperparameters for robust model training. It is designed to facilitate the development of state-of-the-art reward models, as evidenced by its models achieving top ranks on RewardBench.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
