CFPO-RLVR

asparius 's Collections

CFPO-RLVR

CFPO-RLHF

updated Feb 7

RLHF Checkpoints from Clipping Free Policy Optimization for Large Language Models

Upvote

asparius/Qwen2.5-7B-Instruct-GRPO-1ep-iter16

Text Generation • 8B • Updated Jan 8 • 3
asparius/Qwen2.5-7B-Instruct-GRPO-1ep-iter8

Text Generation • 8B • Updated Jan 7 • 2
asparius/Qwen2.5-7B-Instruct-GRPO-1ep-iter4

Text Generation • 8B • Updated Jan 7 • 2
asparius/Qwen2.5-7B-Instruct-GRPO-1ep-iter2

Text Generation • 8B • Updated Jan 7 • 1
asparius/Qwen2.5-7B-Instruct-CFPO-1ep-iter2

Text Generation • 8B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-7B-Instruct-CFPO-1ep-iter4

Text Generation • 8B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-7B-Instruct-CFPO-1ep-iter8

Text Generation • 8B • Updated Dec 31, 2025 • 2
asparius/Qwen2.5-7B-Instruct-CFPO-1ep-iter16

Text Generation • 8B • Updated Jan 1 • 2
asparius/Qwen2.5-7B-GRPO-1ep-iter2

Text Generation • 8B • Updated Dec 24, 2025 • 2
asparius/Qwen2.5-7B-GRPO-1ep-iter4

Text Generation • 8B • Updated Dec 25, 2025 • 2
asparius/Qwen2.5-7B-GRPO-1ep-iter8

Text Generation • 8B • Updated Dec 25, 2025 • 1
asparius/Qwen2.5-7B-GRPO-1ep-iter16

Text Generation • 8B • Updated Dec 26, 2025 • 3
asparius/Qwen2.5-3B-Instruct-GRPO-1ep-iter2

3B • Updated Dec 30, 2025 • 3
asparius/Qwen2.5-3B-Instruct-GRPO-1ep-iter4

Text Generation • 3B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-3B-Instruct-GRPO-1ep-iter8

Text Generation • 3B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-3B-Instruct-GRPO-1ep-iter16

Text Generation • 3B • Updated Dec 31, 2025 • 5
asparius/Qwen2.5-1.5B-Instruct-GRPO-1ep-iter16

Text Generation • 2B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-1.5B-Instruct-GRPO-1ep-iter2

Text Generation • 2B • Updated Dec 30, 2025 • 1
asparius/Qwen2.5-1.5B-Instruct-GRPO-1ep-iter4

Text Generation • 2B • Updated Dec 30, 2025 • 2
asparius/Qwen2.5-1.5B-Instruct-GRPO-1ep-iter8

Text Generation • 2B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-1.5B-GRPO-1ep-iter2

Text Generation • 2B • Updated Dec 24, 2025 • 2 •
asparius/Qwen2.5-1.5B-GRPO-1ep-iter4

Text Generation • 2B • Updated Dec 24, 2025 • 1
asparius/Qwen2.5-1.5B-GRPO-1ep-iter16

Text Generation • 2B • Updated Dec 25, 2025 • 2
asparius/Qwen2.5-1.5B-GRPO-1ep-iter8

Text Generation • 2B • Updated Dec 24, 2025 • 1
asparius/Qwen2.5-1.5B-CFPO-1ep-iter2

Text Generation • 2B • Updated Dec 26, 2025 • 2 •
asparius/Qwen2.5-1.5B-CFPO-1ep-iter4

Text Generation • 2B • Updated Dec 26, 2025 • 1
asparius/Qwen2.5-1.5B-CFPO-1ep-iter16

Text Generation • 2B • Updated Dec 27, 2025 • 2
asparius/Qwen2.5-1.5B-CFPO-1ep-iter8

Text Generation • 2B • Updated Dec 27, 2025 • 2
asparius/Qwen2.5-1.5B-Instruct-CFPO-1ep-iter2

Text Generation • 2B • Updated Dec 30, 2025
asparius/Qwen2.5-1.5B-Instruct-CFPO-1ep-iter4

Text Generation • 2B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-1.5B-Instruct-CFPO-1ep-iter8

Text Generation • 2B • Updated Dec 31, 2025 • 2
asparius/Qwen2.5-1.5B-Instruct-CFPO-1ep-iter16

Text Generation • 2B • Updated Jan 7 • 2
asparius/Qwen2.5-3B-Instruct-CFPO-1ep-iter2

Text Generation • 3B • Updated Dec 31, 2025 • 1
asparius/Qwen2.5-3B-Instruct-CFPO-1ep-iter16

Text Generation • 3B • Updated Dec 31, 2025 • 2
asparius/Qwen2.5-3B-Instruct-CFPO-1ep-iter4

Text Generation • 3B • Updated Dec 31, 2025 • 2
asparius/Qwen2.5-3B-Instruct-CFPO-1ep-iter8

Text Generation • 3B • Updated Dec 31, 2025 • 2
asparius/Qwen2.5-3B-CFPO-1ep-iter2

Text Generation • 3B • Updated Dec 24, 2025 • 1
asparius/Qwen2.5-3B-CFPO-1ep-iter4

Text Generation • 3B • Updated Dec 24, 2025 • 1
asparius/Qwen2.5-3B-CFPO-1ep-iter8

Text Generation • 3B • Updated Dec 25, 2025 • 1
asparius/Qwen2.5-3B-CFPO-1ep-iter16

Text Generation • 3B • Updated Dec 25, 2025 • 1
asparius/Qwen2.5-7B-CFPO-1ep-iter2

Text Generation • 8B • Updated Dec 25, 2025 • 1
asparius/Qwen2.5-7B-CFPO-1ep-iter16

Text Generation • 8B • Updated Dec 26, 2025 • 2
asparius/Qwen2.5-7B-CFPO-1ep-iter4

Text Generation • 8B • Updated Dec 25, 2025 • 1
asparius/Qwen2.5-7B-CFPO-1ep-iter8

Text Generation • 8B • Updated Dec 26, 2025 • 1

Upvote