yashvshetty's picture
Updated LoRA: new section structure Feb 2026
8a2fbb6 verified
|
Raw
History Blame
603 Bytes
metadata
library_name: peft
base_model: google/medgemma-27b-text-it
tags:
  - medgemma
  - medical
  - nhs
  - clinical-documentation
  - lora
  - qlora
  - kaggle-competition
license: apache-2.0

Clarke LoRA Adapter — MedGemma 27B for NHS Clinic Letters

QLoRA fine-tuned adapter for google/medgemma-27b-text-it.

  • Method: QLoRA (4-bit NF4, LoRA rank 16, alpha 32)
  • Target modules: q_proj, k_proj, v_proj, o_proj
  • Training data: 5 gold-standard NHS clinic letters
  • Final loss: 0.9159
  • Competition: MedGemma Impact Challenge