ikedachin commited on
Commit
f7846b3
·
verified ·
1 Parent(s): 6a27936

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +175 -13
README.md CHANGED
@@ -1,21 +1,183 @@
1
  ---
2
- base_model: ikedachin/Qwen3.5-27B-imabari-v2
3
  tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen3_5
8
- license: apache-2.0
 
 
 
 
9
  language:
10
- - en
 
 
 
11
  ---
12
 
13
- # Uploaded finetuned model
14
 
15
- - **Developed by:** ikedachin
16
- - **License:** apache-2.0
17
- - **Finetuned from model :** ikedachin/Qwen3.5-27B-imabari-v2
18
 
19
- This qwen3_5 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
  tags:
4
+ - unsloth
5
+ - dialect
6
+ - japanese
7
+ - qwen3.5
8
+ - question-answering
9
+ license: other
10
+ # license_name: Apache-2.0 base model; CC BY-SA 3.0 data notice — see LICENSE and model card
11
+ datasets:
12
+ - ikedachin/JaQuAD_imabari_v2
13
  language:
14
+ - ja
15
+ base_model:
16
+ - unsloth/Qwen3.5-27B
17
+ pipeline_tag: text-generation
18
  ---
19
 
20
+ # ikedachin/Qwen3.5-27B-imabari-v2
21
 
22
+ 日本語の説明は下にあります。
23
+ Japanese description is available below.
 
24
 
25
+ ## Overview
26
 
27
+ `ikedachin/Qwen3.5-27B-imabari-v2` is a **fully merged model** created by taking **unsloth/Qwen3.5-27B** as the base model and merging a LoRA adapter trained on **ikedachin/JaQuAD_imabari_v2**.
28
+
29
+ This model was trained on a Japanese question-answering dataset derived from JaQuAD, and is tuned to generate responses that incorporate the **style and linguistic flavor of the Imabari dialect**.
30
+
31
+ ## What This Repository Contains
32
+
33
+ This repository contains the **merged full model**, not a LoRA adapter.
34
+ Therefore, you do **not** need to load the base model separately at inference time.
35
+
36
+ - **Base model:** `unsloth/Qwen3.5-27B`
37
+ - **License:** Apache-2.0
38
+
39
+ ## Training Data
40
+
41
+ The following dataset was used for training:
42
+
43
+ - **Dataset:** `ikedachin/JaQuAD_imabari_v2`
44
+ - Training includes a dataset containing material licensed under **CC BY-SA 3.0**.
45
+ - Review of attribution, source notice, and possible ShareAlike obligations may be required for this dataset.
46
+
47
+ This dataset is a reconstructed Japanese QA dataset based on JaQuAD contexts.
48
+ It is characterized by generating **questions, reasoning traces, and answers**, with a particular focus on expressing the **reasoning process and final answers in the Imabari dialect**.
49
+
50
+ ## Training Method
51
+
52
+ This model was created through the following process:
53
+
54
+ 1. Use **unsloth/Qwen3.5-27B** as the base model
55
+ 2. Perform LoRA fine-tuning using **ikedachin/JaQuAD_imabari_v2**
56
+ 3. Merge the trained LoRA adapter into the base model
57
+ 4. Release the merged model
58
+
59
+ - **Base model:** `Qwen/Qwen3.5-27B`
60
+ - **Method:** LoRA fine-tuning + merged model export
61
+ - **Libraries:** Unsloth / Transformers / TRL / PEFT
62
+
63
+ ## Training Environment
64
+
65
+ Training was conducted on a local workstation environment rather than a cloud notebook.
66
+
67
+ - **Workstation:** Lenovo ThinkStation PGX
68
+ - **Frameworks:** PyTorch, TRL, PEFT
69
+ - **Optimization library:** Unsloth
70
+ ## Usage
71
+
72
+ ```python
73
+ from transformers import AutoModelForCausalLM, AutoTokenizer
74
+ import torch
75
+
76
+ model_name = "ikedachin/Qwen3.5-27B-imabari-v2"
77
+
78
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
79
+
80
+ model = AutoModelForCausalLM.from_pretrained(
81
+ model_name,
82
+ torch_dtype=torch.float16,
83
+ device_map="auto",
84
+ )
85
+ ```
86
+
87
+
88
+ ## Notes
89
+
90
+ If you redistribute this model, continue training from it, merge it into another model, use it commercially, or publish derivative models, please make sure to review the following:
91
+
92
+ 1. The Apache-2.0 terms of the Qwen3.5 base model
93
+ 2. The CC BY-SA 3.0 terms of the dataset used for training
94
+ 3. Whether additional obligations apply depending on the form of distribution
95
+ 4. Any required attribution, copyright notice, and source notice
96
+
97
+ This section is provided to improve transparency and does not constitute legal advice.
98
+
99
+
100
+ ---
101
+
102
+
103
+ ## Japanese Description / 日本語説明
104
+
105
+ ## 概要
106
+
107
+ `ikedachin/Qwen3.5-27B-imabari-v2` は、**unsloth/Qwen3.5-27B** をベースモデルとして、
108
+ **ikedachin/JaQuAD_imabari_v2** で LoRA 学習したアダプタを **マージした完成モデル** です。
109
+
110
+ このモデルは、JaQuAD をもとに作成した日本語QAデータセットを用いて学習しており、
111
+ **今治方言の文体や語感を取り入れた応答**を行えるように調整されています。
112
+
113
+ ## このリポジトリに含まれるもの
114
+
115
+ このリポジトリには **LoRAアダプタではなく、マージ済みモデル本体** が含まれています。
116
+ そのため、推論時にベースモデルを別途読み込む必要はありません。
117
+
118
+ - **Base model:** `unsloth/Qwen3.5-27B`
119
+ - License: Apache-2.0
120
+
121
+
122
+ ## 学習データ
123
+
124
+ 学習には以下のデータセットを使用しています。
125
+
126
+ - **Dataset:** `ikedachin/JaQuAD_imabari_v2`
127
+ - 学習には CC BY-SA 3.0 条件のデータを含むデータセットを使用しています。
128
+ - このデータセットは JaQuAD の context をもとに再構成した日本語QAデータセッ���で、 **質問・思考過程・回答**の生成を行い、特に**思考過程や回答を今治方言で表現する**ことを特徴としています。
129
+
130
+ ## 学習方法
131
+
132
+ 本モデルは以下の流れで作成しています。
133
+
134
+ 1. **unsloth/Qwen3.5-27B** をベースモデルとして使用
135
+ 2. **ikedachin/JaQuAD_imabari_v2** を用いて LoRA fine-tuning を実施
136
+ 3. 学習後の LoRA アダプタをベースモデルへマージ
137
+ 4. マージ済みモデルとして公開
138
+
139
+ - **Base model:** `unsloth/Qwen3.5-27B`
140
+ - **Method:** LoRA fine-tuning + merged model export
141
+ - **Libraries:** Unsloth / Transformers / TRL / PEFT
142
+
143
+ ## 学習環境
144
+
145
+ 学習はクラウドノートブックではなく、ローカルのワークステーション環境で実施しました。
146
+
147
+ - **Workstation:** Lenovo ThinkStation PGX
148
+ - **Frameworks:** PyTorch, TRL, PEFT
149
+ - **Optimization library:** Unsloth
150
+
151
+ ## 注意事項
152
+ このモデルを再配布、再学習、マージ、商用利用、または派生モデルとして公開する場合は、以下を必ず確認してください。
153
+
154
+ 1. ベースモデル Qwen3.5 の Apache-2.0 条件
155
+ 2. 学習に使用したデータセットの CC BY-SA 3.0 条件
156
+ 3. 配布形態ごとの追加義務の有無
157
+ 4. 必要な attribution(著作権表示・出典表示)
158
+
159
+ この記載は法的助言ではなく、公開時の透明性を高めるための説明です。
160
+
161
+
162
+ ## License
163
+
164
+ This repository provides a fine-tuned model based on `unsloth/Qwen3.5-27B`.
165
+
166
+ ### Base model
167
+ The base model, Qwen3.5 open-weight models, is provided by Qwen under the Apache License 2.0.
168
+
169
+ ### Training data notice
170
+ This model was trained using data that includes material licensed under CC BY-SA 3.0.
171
+ Creative Commons explains that, under a conservative approach, publicly shared AI models or outputs based on ShareAlike content may need to be shared under the same CC license. Creative Commons also notes that CC license obligations apply only where copyright permission is legally required, and that exceptions and limitations may change the analysis depending on jurisdiction. [oai_citation:12‡Creative Commons](https://creativecommons.org/using-cc-licensed-works-for-ai-training-2/)
172
+
173
+ ### Practical interpretation
174
+ For transparency, this repository does not treat the resulting model as being governed by a single simple license label alone.
175
+ Users should review:
176
+
177
+ - the Apache-2.0 terms applicable to the base model, and
178
+ - any attribution / ShareAlike considerations arising from the training data.
179
+
180
+ ### Redistribution notice
181
+ If you redistribute this model, merge it into another model, publish derivatives, or use it commercially, you are responsible for evaluating the applicable obligations of both the base model and the training data.
182
+
183
+ This section is provided for transparency and is not legal advice.