EduGanda Gemma 3 1B

The best-performing model from the FabAI Foundational Literacy & Numeracy project. A 1B parameter bilingual (English/Luganda) model for generating pedagogical content aligned to Uganda's P1โ€“P3 curriculum.

Model Description

  • Architecture: Gemma 3 1B (Gemma3ForCausalLM)
  • Method: Linear weight interpolation (70% Learner + 30% GRPO-600)
  • Base: CraneAILabs/ganda-gemma-1b (Luganda continual pre-training of google/gemma-3-1b-it)
  • No additional training โ€” EduGanda is a merge, not a fine-tuned model

Lineage

google/gemma-3-1b-it
  โ†’ Luganda CPT (1.33M tokens, 70/30 Luganda/English mix)
  โ†’ CraneAILabs/ganda-gemma-1b
    โ†’ Learner: SFT on 17,561 FLN items (MCQ + content generation)
    โ†’ GRPO-600: Reinforcement learning on tool-calling + translation
    โ†’ EduGanda: 70% Learner + 30% GRPO-600 (linear merge)

Evaluation Results

Evaluated on clean benchmarks with verified zero data contamination:

Metric EduGanda Base (unmodified) Gap Closed
Pedagogical Content Knowledge (PCK) 66% 51% 44% of gap to 12B
Luganda Linguistic Understanding (ELL MC) 58.8% 39% 90% of gap to 12B
ELL Overall 31.0% โ€” โ€”
Luganda generation quality Partial โ€” Structured lesson plans

Comparison to Other Variants

Model Method PCK ELL MC Status
EduGanda (v6-07) 70/30 merge 66% 58.8% Shipped
Reader (v5-sft) SFT only 66% 51.0% Tied PCK, lower ELL
Speaker (v6-fln-on-grpo) SFT on RL base 64% 47.1% Lower on both
Scholar (v7-fln) SFT on EduGanda 71% 41.2% Rejected (ELL collapse)

Known Limitations

  • Position bias: 52-point accuracy spread between best position (B: 93%) and worst (D: 41%). Retraining with position-balanced MCQ data is the clearest fix.
  • Short-form ELL: ~0% on 47 short-form items across all 1B variants. Requires targeted training data.
  • Arithmetic: Cannot reliably multiply two-digit numbers at 1B parameters.
  • Long-context Luganda: Coherence degrades beyond ~500 tokens of Luganda output.
  • Requires repetition_penalty=1.2 for stable Luganda generation (without it, output loops).

Intended Use

  • Generating structured bilingual lesson plans for Ugandan primary school teachers
  • Creating literacy assessments (MCQ, fill-in-blank) aligned to P1โ€“P3 curriculum
  • Offline teacher assistant on mobile devices (~30 tokens/sec on phone hardware)
  • Research on low-resource language educational AI

How to Use

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("CraneAILabs/EduGanda-Gemma-3-1B")
tokenizer = AutoTokenizer.from_pretrained("CraneAILabs/EduGanda-Gemma-3-1B")

prompt = "<start_of_turn>user\nCreate a P2 phonics lesson on syllable segmentation in Luganda<end_of_turn>\n<start_of_turn>model\n"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=500, temperature=0.7, repetition_penalty=1.2)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Citation

@misc{craneailabs2026eduganda,
  title={EduGanda: A 1B Bilingual Model for Ugandan Primary School Literacy Instruction},
  author={Bakunga, Bronson and Mubiru, Kato Steven and Tukamushaba, Catherine},
  year={2026},
  publisher={Crane AI Labs},
  url={https://huggingface.co/CraneAILabs/EduGanda-Gemma-3-1B}
}

Acknowledgments

Supported by Fab Inc, funded by the Bill & Melinda Gates Foundation. Field research and Luganda linguistic validation conducted by Crane AI Labs.

Downloads last month
8
Safetensors
Model size
1.0B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for CraneAILabs/EduGanda-Gemma-3-1B

Finetuned
(3)
this model
Finetunes
1 model

Space using CraneAILabs/EduGanda-Gemma-3-1B 1

Collection including CraneAILabs/EduGanda-Gemma-3-1B