bm-whisper-large-v4-training-2

A LoRA adapter for Bambara speech recognition, trained on djelia/bm-whisper-large-v3-tuned — Whisper large-v3 geometry: hidden size 1280, 32 encoder + 32 decoder layers, 128 mel bins, 51,866-token vocabulary.

Adapter weights only — load onto the base model below.

Usage

from peft import PeftModel
from transformers import WhisperForConditionalGeneration, WhisperProcessor

base = WhisperForConditionalGeneration.from_pretrained("djelia/bm-whisper-large-v3-tuned")
model = PeftModel.from_pretrained(base, "djelia/bm-whisper-large-v4-training-2")
model.eval()

# tokenizer and feature extractor ship with the adapter
processor = WhisperProcessor.from_pretrained("djelia/bm-whisper-large-v4-training-2")

# Optional: fold the LoRA deltas into the base weights for inference.
# merged = model.merge_and_unload()

Adapter configuration

Key	Value
peft_type	LORA
r / lora_alpha	32 / 64 (scaling 2.0)
lora_dropout	0.05
bias	none
target_modules	["q_proj", "k_proj", "v_proj", "out_proj"]
base_model_class	WhisperForConditionalGeneration
Adapter dtype	F32

Notes

target_modules is a plain name list, so every matching projection in both towers is adapted: encoder self-attention, decoder self-attention and decoder cross-attention, layers 0-31. MLP blocks, the convolutional front-end, embeddings, layer norms and proj_out are untouched.

Audio should be 16 kHz mono.