File size: 1,365 Bytes
0d427cd | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 | ---
base_model: Qwen/Qwen3-0.6B
library_name: peft
pipeline_tag: text-generation
tags:
- lora
- sft
- wolof
- senegal
- education
---
# Wolof LoRA Adapter
This repository contains a LoRA adapter fine-tuned for a classroom demo on
Wolof instruction following in Senegalese/African contexts.
## Base Model
- `Qwen/Qwen3-0.6B`
## Intended Use
This adapter is designed for teaching:
- instruction fine-tuning,
- LoRA deployment,
- local inference,
- basic evaluation with Exact Match, F1, BLEU, ROUGE-L, and perplexity.
It is not a production Wolof assistant.
## Loading Example
```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model = "Qwen/Qwen3-0.6B"
adapter_id = "YOUR_USERNAME/YOUR_REPO"
tokenizer = AutoTokenizer.from_pretrained(adapter_id, trust_remote_code=True)
base = AutoModelForCausalLM.from_pretrained(base_model, trust_remote_code=True)
model = PeftModel.from_pretrained(base, adapter_id)
```
## Training Setup
- LoRA rank: 16
- LoRA alpha: 32
- Target modules: attention and MLP projection layers
- Dataset schema: `instruction`, `input`, `output`
- Chat template rendered without hidden thinking traces when supported.
## Limitations
The dataset is small and classroom-oriented. The model may repeat short Wolof
phrases or fail outside the covered categories. Evaluate before reuse.
|