Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
jmajkutewicz
's Collections
Opposing polish political views
Evaluation of DPO Configurations
EditPrefs
Evaluation of DPO Configurations
updated
Sep 30, 2025
An Empirical Study of DPO Configuration Choices for LLM Alignment
Upvote
-
Sort: Collection
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation
•
Updated
Sep 26, 2025
•
9
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation
•
Updated
Sep 26, 2025
•
4
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation
•
Updated
Sep 26, 2025
•
5
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation
•
Updated
Sep 26, 2025
•
4
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_dataset-mix
Text Generation
•
Updated
Sep 26, 2025
•
4
jmajkutewicz/zephyr-7b-dpo_hh-rlhf
Text Generation
•
Updated
Sep 26, 2025
•
4
jmajkutewicz/zephyr-7b-dpo_oasst1
Text Generation
•
Updated
Sep 26, 2025
•
4
jmajkutewicz/zephyr-7b-dpo_PKU-SafeRLHF
Text Generation
•
Updated
Sep 26, 2025
•
9
jmajkutewicz/zephyr-7b-dpo_ultrafeedback
Text Generation
•
Updated
Sep 26, 2025
•
5
jmajkutewicz/zephyr-7b-dpo_dataset-mix
Text Generation
•
Updated
Sep 26, 2025
•
5
jmajkutewicz/hh-rlhf-binarized
Viewer
•
Updated
Sep 26, 2025
•
169k
•
28
jmajkutewicz/oasst1-binarized
Viewer
•
Updated
Sep 26, 2025
•
14.9k
•
9
jmajkutewicz/PKU-SafeRLHF-binarized
Viewer
•
Updated
Sep 26, 2025
•
82.1k
•
37
jmajkutewicz/SHP-binarized
Viewer
•
Updated
Sep 26, 2025
•
121k
•
10
Upvote
-
Sort: Collection
Share collection
View history
Collection guide
Browse collections