Jan Majkutewicz
jmajkutewicz
AI & ML interests
None yet
Organizations
None yet
An Empirical Study of DPO Configuration Choices for LLM Alignment
-
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation • Updated • 10 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation • Updated • 4 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation • Updated • 6 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation • Updated • 5
An Empirical Study of DPO Configuration Choices for LLM Alignment
-
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation • Updated • 10 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation • Updated • 4 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation • Updated • 6 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation • Updated • 5
models 16
jmajkutewicz/pllum-12b-opposing-views-right-wing
Text Generation • Updated • 5
jmajkutewicz/pllum-12b-opposing-views-left-wing
Text Generation • Updated • 7
jmajkutewicz/Qwen3.5-9B-medadapt
Text Generation • 9B • Updated • 7
jmajkutewicz/gemma-4-E2B-medadapt
Text Generation • 5B • Updated • 8
jmajkutewicz/Bielik-11B-v3.0-medadapt
Text Generation • 11B • Updated • 22 • 1
jmajkutewicz/Bielik-4.5B-v3.0-medadapt
Text Generation • 5B • Updated • 14 • 1
jmajkutewicz/zephyr-7b-dpo_dataset-mix
Text Generation • Updated • 5
jmajkutewicz/zephyr-7b-dpo_PKU-SafeRLHF
Text Generation • Updated • 9
jmajkutewicz/zephyr-7b-dpo_ultrafeedback
Text Generation • Updated • 5
jmajkutewicz/zephyr-7b-dpo_hh-rlhf
Text Generation • Updated • 4
datasets 6
jmajkutewicz/sql-create-context
Viewer • Updated • 78.6k • 11
jmajkutewicz/PKU-SafeRLHF-binarized
Viewer • Updated • 82.1k • 37
jmajkutewicz/hh-rlhf-binarized
Viewer • Updated • 169k • 30
jmajkutewicz/oasst1-binarized
Viewer • Updated • 14.9k • 9
jmajkutewicz/SHP-binarized
Viewer • Updated • 121k • 11
jmajkutewicz/WikiPrefs
Viewer • Updated • 65.3k • 23