Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1,3 +1,23 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: llama3
|
| 3 |
+
base_model: aaditya/Llama3-OpenBioLLM-8B
|
| 4 |
+
tags:
|
| 5 |
+
- medical
|
| 6 |
+
- llama
|
| 7 |
+
- merged
|
| 8 |
+
- lora
|
| 9 |
+
language:
|
| 10 |
+
- en
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
# MediSimplifier — Merged OpenBioLLM-8B
|
| 14 |
+
|
| 15 |
+
Merged LoRA adapter (r=32, all_attn, rsLoRA) into `aaditya/Llama3-OpenBioLLM-8B` for medical text simplification.
|
| 16 |
+
|
| 17 |
+
**Built with Meta Llama 3.** Released under the [Llama 3 Community License](https://llama.meta.com/llama3/license/).
|
| 18 |
+
|
| 19 |
+
Base model: `aaditya/Llama3-OpenBioLLM-8B` (Llama-3-based)
|
| 20 |
+
Fine-tuning: LoRA r=32, target modules Q/K/V/O, 3 epochs on GuyDor007/medisimplifier-dataset
|
| 21 |
+
Evaluation: ROUGE-L 0.6638 on 1,001-sample test split
|
| 22 |
+
|
| 23 |
+
For details, see [github.com/deepset01-sys/medisimplifier-nebius](https://github.com/deepset01-sys/medisimplifier-nebius).
|