yyqoni
/

rlhflow-llama-3-sft-8b-v2-token-rm-700k

Text Classification

text-embeddings-inference

Model card Files Files and versions

This is the token-wise reward model introduced in the preprint Segmenting Text and Learning Their Rewards for Improved RLHF in Language Models (https://arxiv.org/abs/2501.02790). For more details, please visit our repository at https://github.com/yinyueqin/DenseRewardRLHF-PPO.

Downloads last month: 2

Safetensors

Model size

8B params

Tensor type

BF16

·

Model tree for yyqoni/rlhflow-llama-3-sft-8b-v2-token-rm-700k

Base model

RLHFlow/LLaMA3-SFT-v2

Finetuned

(6)

this model

Dataset used to train yyqoni/rlhflow-llama-3-sft-8b-v2-token-rm-700k

Collection including yyqoni/rlhflow-llama-3-sft-8b-v2-token-rm-700k

DenseRewardRLHF-PPO

This repository contains the released models for our paper Segmenting Text and Learning Their Rewards for Improved RLHF in Language Model. • 18 items • Updated Jan 11, 2025 • 1

Paper for yyqoni/rlhflow-llama-3-sft-8b-v2-token-rm-700k

Segmenting Text and Learning Their Rewards for Improved RLHF in Language Model

Paper • 2501.02790 • Published Jan 6, 2025 • 8