Dart66 commited on
Commit
10975b3
·
verified ·
1 Parent(s): 2e5cbb5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +88 -37
README.md CHANGED
@@ -1,62 +1,113 @@
 
 
 
 
1
  ---
2
  base_model: Qwen/Qwen2.5-0.5B-Instruct
3
  library_name: peft
4
- model_name: qwen2_5_lora_grupo3
 
5
  tags:
6
- - base_model:adapter:Qwen/Qwen2.5-0.5B-Instruct
7
- - lora
8
- - sft
9
- - transformers
10
- - trl
 
 
11
  licence: license
12
  pipeline_tag: text-generation
13
  ---
14
 
15
- # Model Card for qwen2_5_lora_grupo3
16
 
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
18
- It has been trained using [TRL](https://github.com/huggingface/trl).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
- ## Quick start
 
 
 
 
 
 
 
 
 
 
21
 
22
  ```python
23
- from transformers import pipeline
 
 
 
 
 
 
 
 
 
 
 
 
 
24
 
25
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
26
- generator = pipeline("text-generation", model="None", device="cuda")
27
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
28
- print(output["generated_text"])
 
29
  ```
30
 
31
- ## Training procedure
32
 
33
-
 
34
 
 
35
 
36
- This model was trained with SFT.
 
 
 
 
37
 
38
  ### Framework versions
39
 
40
- - PEFT 0.18.1
41
- - TRL: 0.27.2
42
- - Transformers: 5.1.0
43
- - Pytorch: 2.10.0
44
- - Datasets: 4.5.0
45
  - Tokenizers: 0.22.2
46
 
47
  ## Citations
48
 
49
-
50
-
51
- Cite TRL as:
52
-
53
- ```bibtex
54
- @misc{vonwerra2022trl,
55
- title = {{TRL: Transformer Reinforcement Learning}},
56
- author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
57
- year = 2020,
58
- journal = {GitHub repository},
59
- publisher = {GitHub},
60
- howpublished = {\url{https://github.com/huggingface/trl}}
61
- }
62
- ```
 
1
+ # GRUPO # 8
2
+ Integrantes:
3
+ - Sharon Añejandra Calcina
4
+
5
  ---
6
  base_model: Qwen/Qwen2.5-0.5B-Instruct
7
  library_name: peft
8
+ model_name: model_regulations-eu_grupo8-SharonCalcina_final
9
+ pipeline_tag: text-generation
10
  tags:
11
+ - base_model:adapter:Qwen/Qwen2.5-0.5B-Instruct
12
+ - lora
13
+ - sft
14
+ - gdpr
15
+ - legal
16
+ - transformers
17
+ - trl
18
  licence: license
19
  pipeline_tag: text-generation
20
  ---
21
 
 
22
 
23
+ # GDPR Q&A Qwen2.5 LoRA Model
24
+
25
+ This repository contains **LoRA adapters** fine-tuned on a **GDPR Question–Answering dataset**
26
+ derived from **Regulation (EU) 2016/679 (GDPR)**.
27
+
28
+ The model is intended for **educational and informational purposes only** and does **not**
29
+ provide legal advice.
30
+
31
+ ---
32
+
33
+
34
+ ## Academic Information
35
+
36
+ - **Course / Practice**: Fine-tuning & Distillation (GDPR QA)
37
+ - **Group**: **Grupo 8**
38
+ - **Students**:
39
+ - Sharon Alejandra Calcina
40
+ - **Organization**: `umsa-v1`
41
+
42
+ ---
43
+
44
+ ## Base Model
45
+
46
+ - **Base model**: `Qwen/Qwen2.5-0.5B-Instruct`
47
+ - **Fine-tuning method**: Supervised Fine-Tuning (SFT)
48
+ - **Adaptation**: LoRA (PEFT)
49
+
50
+ ---
51
 
52
+ ## Dataset
53
+
54
+ The model was trained using the following dataset:
55
+
56
+ https://huggingface.co/datasets/umsa-v1/dataset_regulations-eu_grupo8-SharonCalcina_final
57
+
58
+ The dataset contains GDPR-related question–answer pairs with paraphrased variants.
59
+
60
+ ---
61
+
62
+ ## Quick Start
63
 
64
  ```python
65
+ from transformers import AutoModelForCausalLM, AutoTokenizer
66
+ from peft import PeftModel
67
+
68
+ base_model = AutoModelForCausalLM.from_pretrained(
69
+ "Qwen/Qwen2.5-0.5B-Instruct",
70
+ device_map="auto"
71
+ )
72
+
73
+ model = PeftModel.from_pretrained(
74
+ base_model,
75
+ "umsa-v1/model_regulations-eu_grupo8-SharonCalcina_final"
76
+ )
77
+
78
+ tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-0.5B-Instruct")
79
 
80
+ prompt = "What rights does a data subject have under GDPR?"
81
+ inputs = tokenizer(prompt, return_tensors="pt")
82
+
83
+ outputs = model.generate(**inputs, max_new_tokens=200)
84
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
85
  ```
86
 
87
+ # Model Card for qwen2_5_lora_grupo3
88
 
89
+ This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
90
+ It has been trained using [TRL](https://github.com/huggingface/trl).
91
 
92
+ ## Training procedure
93
 
94
+ This model was trained using **Supervised Fine-Tuning (SFT)** with a
95
+ Low-Rank Adaptation (LoRA) approach on top of the
96
+ Qwen/Qwen2.5-0.5B-Instruct base model.
97
+ The training data consists of GDPR-related question–answer pairs with
98
+ paraphrased variants.
99
 
100
  ### Framework versions
101
 
102
+ - PEFT: 0.18.1
103
+ - TRL: 0.27.2
104
+ - Transformers: 5.1.0
105
+ - PyTorch: 2.1.0
106
+ - Datasets: 4.5.0
107
  - Tokenizers: 0.22.2
108
 
109
  ## Citations
110
 
111
+ author = {Sharon Calcina},
112
+ year = 2026,
113
+ howpublished = {huggingface repo}