Training

This model was trained on RunPod cloud GPUs.

Model Details

These models are the GGUF versions of this LoRA: Cseti/PULI-LlumiX-Llama-3.1-Instruct-LoRA.

I created them by merging the base model with the qlora, then converted them to GGUF format.

Please note that this model is experimental, and I trained it quickly for testing purposes. I'm still testing it. I'll finetune it further if I feel it is worth it.

Support

Producing and sharing this kind of open-source work requires renting cloud GPUs, which gets expensive quickly. If you find it useful and would like me to keep contributing, your support is very much appreciated:

Ko-fi Liberapay

Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Cseti/PULI-LlumiX-Llama-3.1-Instruct-SZM-merge-gguf

Adapter
(2)
this model

Dataset used to train Cseti/PULI-LlumiX-Llama-3.1-Instruct-SZM-merge-gguf