Instructions to use jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("allenai/Llama-3.1-Tulu-3-8B-SFT") model = PeftModel.from_pretrained(base_model, "jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF") - Notebooks
- Google Colab
- Kaggle
File size: 134 Bytes
1ecb77d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:de815a55feddc5a831214dcf596f6b9d243bc1a2f671c53c982a79e82fb6b6d9
size 335605144
|