README.md

---
base_model: Qwen/Qwen3-0.6B
library_name: peft
pipeline_tag: text-generation
tags:
- lora
- sft
- wolof
- senegal
- education
---

# Wolof LoRA Adapter

This repository contains a LoRA adapter fine-tuned for a classroom demo on
Wolof instruction following in Senegalese/African contexts.

## Base Model

- `Qwen/Qwen3-0.6B`

## Intended Use

This adapter is designed for teaching:

- instruction fine-tuning,
- LoRA deployment,
- local inference,
- basic evaluation with Exact Match, F1, BLEU, ROUGE-L, and perplexity.

It is not a production Wolof assistant.

## Loading Example

```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model = "Qwen/Qwen3-0.6B"
adapter_id = "YOUR_USERNAME/YOUR_REPO"

tokenizer = AutoTokenizer.from_pretrained(adapter_id, trust_remote_code=True)
base = AutoModelForCausalLM.from_pretrained(base_model, trust_remote_code=True)
model = PeftModel.from_pretrained(base, adapter_id)
```

## Training Setup

- LoRA rank: 16
- LoRA alpha: 32
- Target modules: attention and MLP projection layers
- Dataset schema: `instruction`, `input`, `output`
- Chat template rendered without hidden thinking traces when supported.

## Limitations

The dataset is small and classroom-oriented. The model may repeat short Wolof
phrases or fail outside the covered categories. Evaluate before reuse.