Instructions to use trl-lib/OpenHermes-2-Mistral-7B-kto-beta-0.2-steps-800 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use trl-lib/OpenHermes-2-Mistral-7B-kto-beta-0.2-steps-800 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("teknium/OpenHermes-2.5-Mistral-7B") model = PeftModel.from_pretrained(base_model, "trl-lib/OpenHermes-2-Mistral-7B-kto-beta-0.2-steps-800") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 4ece39bbce9f460030aa98f49c50d45ea90495ffd36dce53d17a7979c2ff5517
- Size of remote file:
- 168 MB
- SHA256:
- ea89985214e13b86c35d3af66fa01b672872f515fa1fa03136e5fe4998c8246d
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.