subbuc
/

qwen3-8b-dpo-lmsys

Model card Files Files and versions

qwen3-8b-dpo-lmsys

278 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

subbuc's picture

Upload DPO fine-tuned Qwen model

4d7184e verified 9 months ago

checkpoint-500
Upload DPO fine-tuned Qwen model 9 months ago
.gitattributes

1.64 kB
Upload DPO fine-tuned Qwen model 9 months ago
README.md

919 Bytes
Upload DPO fine-tuned Qwen model 9 months ago
adapter_config.json

876 Bytes
Upload DPO fine-tuned Qwen model 9 months ago
adapter_model.safetensors

61.4 MB
xet

Upload DPO fine-tuned Qwen model 9 months ago
added_tokens.json

707 Bytes
Upload DPO fine-tuned Qwen model 9 months ago
chat_template.jinja

4.17 kB
Upload DPO fine-tuned Qwen model 9 months ago
merges.txt

1.67 MB
Upload DPO fine-tuned Qwen model 9 months ago
special_tokens_map.json

496 Bytes
Upload DPO fine-tuned Qwen model 9 months ago
tokenizer.json

11.4 MB
xet

Upload DPO fine-tuned Qwen model 9 months ago
tokenizer_config.json

5.4 kB
Upload DPO fine-tuned Qwen model 9 months ago
training_args.bin
Detected Pickle imports (11)
- "trl.trainer.dpo_config.DPOConfig",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.state.PartialState",
- "torch.device",
- "trl.trainer.dpo_config.FDivergenceType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.SaveStrategy"
How to fix it?
6.87 kB
xet

Upload DPO fine-tuned Qwen model 9 months ago
vocab.json

2.78 MB
Upload DPO fine-tuned Qwen model 9 months ago