Legal Chatbot SLM Indonesian (16-bit / QLoRA Fine-Tuned)
Model ini adalah Small Language Model (SLM) hasil fine-tuning dan GRPO Reinforcement Learning untuk tugas asisten tanya-jawab tim legal di Indonesia berbasis Qwen 2.5 7B Instruct.
Informasi Model:
- Base Model:
unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit - Dataset:
Ichsan2895/alpaca-gpt4-indonesian(ChatML Format) - Teknik Training: QLoRA 4-bit Double Quantization (SFT 800 steps) + GRPO (Group Relative Policy Optimization)
- Kemampuan: Penalaran penal hukum dengan token
<think> ... </think>dan integrasi sistem Advanced RAG.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support