boapps/szurkemarha
Viewer • Updated • 57.9k • 43 • 4
How to use Cseti/PULI-LlumiX-Llama-3.1-Instruct-SZM-merge-gguf with PEFT:
Task type is invalid.
This model was trained on RunPod cloud GPUs.
These models are the GGUF versions of this LoRA: Cseti/PULI-LlumiX-Llama-3.1-Instruct-LoRA.
I created them by merging the base model with the qlora, then converted them to GGUF format.
Please note that this model is experimental, and I trained it quickly for testing purposes. I'm still testing it. I'll finetune it further if I feel it is worth it.
Producing and sharing this kind of open-source work requires renting cloud GPUs, which gets expensive quickly. If you find it useful and would like me to keep contributing, your support is very much appreciated:
Base model
NYTK/PULI-LlumiX-Llama-3.1