lucas-sousa-pereira commited on
Commit
41ee4b7
·
verified ·
1 Parent(s): 1bc6d5c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md CHANGED
@@ -1,3 +1,70 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: ibm-granite/granite-3.3-8b-instruct
4
+ language:
5
+ - en
6
+ tags:
7
+ - instructlab
8
+ - lora
9
+ - code
10
+ - java
11
+ - code-refactoring
12
+ - granite
13
+ pipeline_tag: text-generation
14
  ---
15
+
16
+ # Granite-3.3-8B-Instruct Fine-Tuned for Java Code Refactoring
17
+
18
+ ## Overview
19
+
20
+ This model is a fine-tuned version of **IBM Granite-3.3-8B-Instruct** specialized for **Java code refactoring** using the **InstructLab** framework.
21
+
22
+ The training dataset was generated using the **Skills** pipeline of InstructLab, with **GPT-4o** acting as the teacher model to generate instruction-response pairs. A total of **1,440 synthetic training instances** were used for fine-tuning.
23
+
24
+ ## Base Model
25
+
26
+ - ibm-granite/granite-3.3-8b-instruct
27
+
28
+ ## Training
29
+
30
+ The dataset was generated using:
31
+
32
+ ```bash
33
+ ilab data generate \
34
+ --model "openai/gpt-4o" \
35
+ --endpoint-url "http://localhost:8000/v1" \
36
+ --api-key "$ILAB_API_KEY" \
37
+ --pipeline simple
38
+ ```
39
+
40
+ The model was fine-tuned using:
41
+
42
+ ```bash
43
+ ilab model train \
44
+ --model-path ibm-granite/granite-3.3-8b-instruct \
45
+ --num-epochs 3 \
46
+ --device cpu \
47
+ --max-seq-len 2048 \
48
+ --max-batch-len 10000 \
49
+ --effective-batch-size 128 \
50
+ --lora-rank 32 \
51
+ --lora-alpha 64 \
52
+ --lora-dropout 0.1 \
53
+ --learning-rate 1e-4 \
54
+ --is-padding-free false
55
+ ```
56
+
57
+ ## Intended Use
58
+
59
+ This model is intended for Java code refactoring tasks. It is designed to generate refactored Java code while preserving the original program behavior.
60
+
61
+ ## Training Data
62
+
63
+ - Framework: InstructLab
64
+ - Pipeline: Skills
65
+ - Teacher model: GPT-4o
66
+ - Number of training instances: 1,440
67
+
68
+ ## License
69
+
70
+ This model is released under the Apache 2.0 license, consistent with the license of the base model.