Upload 3 files

MediGuide-QLoRA-README.md

@@ -0,0 +1,148 @@
+---
+base_model: Qwen/Qwen2.5-1.5B-Instruct
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen2.5-1.5B-Instruct
+- lora
+- qlora
+- transformers
+- peft
+- medical
+---
+
+# MediGuide QLoRA
+
+MediGuide is a fine-tuned medical conversational assistant based on `Qwen/Qwen2.5-1.5B-Instruct`.
+
+This repository contains the **QLoRA adapter weights** trained for the MediGuide project. The base Qwen model is not included and must be loaded separately.
+
+## Model Details
+
+- **Base model:** `Qwen/Qwen2.5-1.5B-Instruct`
+- **Fine-tuning method:** QLoRA
+- **PEFT method:** LoRA
+- **LoRA rank:** 16
+- **LoRA alpha:** 32
+- **LoRA dropout:** 0.05
+- **Task:** Medical dialogue generation
+- **Framework:** Hugging Face Transformers + PEFT
+- **PEFT version:** 0.20.0
+- **License:** See the base model's license and the MediGuide project repository for applicable terms.
+
+## Intended Use
+
+This adapter is intended for research and educational experimentation with medical dialogue generation and parameter-efficient fine-tuning.
+
+It is not intended to replace a qualified healthcare professional, provide definitive diagnoses, or make medical decisions.
+
+## Out-of-Scope Use
+
+Do not use this model as an autonomous clinical decision-maker, for emergency medical guidance, or as a substitute for professional medical advice.
+
+## Training
+
+The adapter was trained on the cleaned MediDialog-derived MediGuide dataset used in the project.
+
+The project uses an 80/10/10 train/validation/test split and compares multiple parameter-efficient fine-tuning approaches, including LoRA, QLoRA, and Prompt Tuning.
+
+### QLoRA Configuration
+
+The adapter targets:
+
+- `q_proj`
+- `k_proj`
+- `v_proj`
+- `o_proj`
+- `gate_proj`
+- `up_proj`
+- `down_proj`
+
+The adapter configuration uses `r=16`, `alpha=32`, and `dropout=0.05`.
+
+## Evaluation
+
+On the MediGuide evaluation setup, QLoRA achieved:
+
+| Metric | QLoRA |
+|---|---:|
+| ROUGE-1 | 0.1319 |
+| ROUGE-2 | 0.0269 |
+| ROUGE-L | 0.1319 |
+| BLEU | 2.40 |
+| Perplexity | 14.65 |
+
+These results come from the project's current evaluation setup and should not be interpreted as clinical performance benchmarks.
+
+## How to Use
+
+Install the required packages:
+
+```bash
+pip install transformers peft torch
+```
+
+Load the base model and adapter:
+
+```python
+import torch
+from transformers import AutoTokenizer, AutoModelForCausalLM
+from peft import PeftModel
+
+base_model_id = "Qwen/Qwen2.5-1.5B-Instruct"
+adapter_id = "rolmaxx/MediGuide-QLoRA"
+
+tokenizer = AutoTokenizer.from_pretrained(base_model_id)
+
+model = AutoModelForCausalLM.from_pretrained(
+    base_model_id,
+    torch_dtype=torch.float16,
+    device_map="auto"
+)
+
+model = PeftModel.from_pretrained(model, adapter_id)
+
+prompt = "What are common symptoms of the flu?"
+
+inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
+
+with torch.no_grad():
+    outputs = model.generate(
+        **inputs,
+        max_new_tokens=256,
+        temperature=0.7,
+        do_sample=True
+    )
+
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
+
+## Repository
+
+GitHub: https://github.com/lxzy8/MediGuide
+
+## Files
+
+- `adapter_config.json` — PEFT/LoRA adapter configuration
+- `adapter_model.safetensors` — trained adapter weights
+
+The base Qwen model is not included in this repository.
+
+## Limitations
+
+The model was trained on a relatively small dataset and evaluated using automated text-generation metrics. Automated metrics such as ROUGE and BLEU do not establish medical correctness, safety, or clinical usefulness.
+
+Model outputs may contain incorrect, incomplete, or unsafe medical information. Human review is required for any real-world medical application.
+
+## Citation
+
+If you use this adapter in your work, please cite the MediGuide project repository:
+
+```text
+MediGuide — QLoRA fine-tuned medical conversational assistant.
+https://github.com/lxzy8/MediGuide
+```
+
+## Framework Versions
+
+- PEFT: 0.20.0

adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen2.5-1.5B-Instruct",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "monteclora_config": null,
+  "peft_type": "LORA",
+  "peft_version": "0.20.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "k_proj",
+    "o_proj",
+    "down_proj",
+    "q_proj",
+    "gate_proj",
+    "up_proj",
+    "v_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false,
+  "velora_config": null
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b148eb1c6d1e876804ca408ea7a07c71304e27269b9e85996c906a368afe0c6f
+size 73911112