# Nous-Hermes-2-Mistral-7B-DPO

I converted [NousResearch/Nous-Hermes-2-Mistral-7B-DPO](https://huggingface.co/NousResearch/Nous-Hermes-2-Mistral-7B-DPO) to GGUF and quantized it to my favorite quantizations. 

I quickly quantized this model using a modified version of [AutoGGUF](https://t.co/oUuxN2fvSX) from [Maxime Labonne](https://huggingface.co/mlabonne)

Here is my Ollama modelfile:
```
FROM ./phi-2-openhermes-2.5.Q5_K_M.gguf
PARAMETER num_ctx 2048
TEMPLATE """{{ .System }}
### USER: {{ .Prompt }}<|endoftext|>
### ASSISTANT:
"""
PARAMETER stop "<|endoftext|>"
```