--- license: apache-2.0 base_model: sathiiiii/polyalign-qwen2.5-1.5b-zh-dist-sft tags: - polyalign - hdpo - chinese - full-finetune --- # PolyAlign Chinese HDPO - Qwen2.5-1.5B This model is the Chinese HDPO checkpoint for Qwen2.5-1.5B. Base model used for HDPO policy training: `sathiiiii/polyalign-qwen2.5-1.5b-zh-dist-sft` The HDPO preference data was scored offline with the PolyAlign MLP critic.