alobos commited on
Commit
e89aa7b
·
verified ·
1 Parent(s): d1feafc

Publish local 2B experimental recovery adapter

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,115 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen3.5-2B-Base
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ license: apache-2.0
6
+ tags:
7
+ - base_model:adapter:Qwen/Qwen3.5-2B-Base
8
+ - lora
9
+ - peft
10
+ - sft
11
+ - transformers
12
+ - trl
13
+ - andaluh
14
+ - marichatmen
15
+ ---
16
+
17
+ # MariChatmen 2B Experimental
18
+
19
+ MariChatmen 2B Experimental is a LoRA/PEFT adapter for
20
+ `Qwen/Qwen3.5-2B-Base`. It was trained locally on 2026-05-13 as a recovery
21
+ run after the original 2B experiment failed its behavioural gate and no
22
+ usable 2B artifact was available.
23
+
24
+ This is an experimental checkpoint. The current demo should prefer the 4B
25
+ adapter (`MariChatmen/MariChatmen-4B-Experimental`) when hardware allows it.
26
+
27
+ ## Intended Use
28
+
29
+ The adapter is intended for Spanish/Andaluh chat experiments around the
30
+ fictional MariChatmen assistant persona. It is not a general production
31
+ assistant and should not be used for high-stakes decisions.
32
+
33
+ ## Loading
34
+
35
+ ```python
36
+ from peft import PeftModel
37
+ from transformers import AutoModelForCausalLM, AutoTokenizer
38
+
39
+ base_id = "Qwen/Qwen3.5-2B-Base"
40
+ adapter_id = "MariChatmen/MariChatmen-2B-Experimental"
41
+
42
+ tokenizer = AutoTokenizer.from_pretrained(adapter_id)
43
+ base = AutoModelForCausalLM.from_pretrained(base_id, device_map="auto")
44
+ model = PeftModel.from_pretrained(base, adapter_id)
45
+ ```
46
+
47
+ ## Training Data
48
+
49
+ The local recovery mix contained 22,858 SFT training rows and 1,134 validation
50
+ rows. It combined:
51
+
52
+ - a broad local Andaluh SFT mix derived from Spanish SFT data transformed with
53
+ `andalugeeks/andaluh-py`;
54
+ - oversampled MariChatmen project-authored repair anchors covering identity,
55
+ style, safety, and instruction-following regressions.
56
+
57
+ The mixed training dataset is not uploaded with this model. The broad SFT
58
+ portion includes downloaded rows transformed with `andaluh-py`, so it should
59
+ not be republished as MariChatmen proprietary/project data. Uploadable project
60
+ data is tracked separately in `MariChatmen/MariChatmen-Project-Data`.
61
+
62
+ ## Credits and Copyright
63
+
64
+ - Base model: `Qwen/Qwen3.5-2B-Base`.
65
+ - Fine-tuning framework: Hugging Face Transformers, TRL, PEFT, and PyTorch.
66
+ - Transliteration / Andaluh transformation tooling: `andalugeeks/andaluh-py`.
67
+ - Broad Spanish SFT sources recorded in the local row metadata include
68
+ `VillanovaAI/villanova-sft-2603` and upstream sources such as
69
+ `CohereLabs/aya_collection`; original dataset licenses and attribution
70
+ requirements remain with those sources.
71
+ - MariChatmen repair anchors are project-authored/curated material for this
72
+ project and are documented in the project data repository.
73
+
74
+ ## Training Procedure
75
+
76
+ - Stage: supervised fine-tuning.
77
+ - Base model: `Qwen/Qwen3.5-2B-Base`.
78
+ - Tokenizer source: recovered MariChatmen 4B checkpoint tokenizer.
79
+ - Sequence length: 384.
80
+ - Prompt token cap: 256.
81
+ - Max steps: 600.
82
+ - LoRA rank: 16.
83
+ - LoRA alpha: 32.
84
+ - LoRA dropout: 0.05.
85
+ - Learning rate: 5e-5.
86
+ - Gradient accumulation: 16.
87
+ - Embeddings resized and trained to match the MariChatmen tokenizer.
88
+ - Hardware: local NVIDIA RTX 5060 Laptop GPU, 8 GB VRAM.
89
+
90
+ ## Evaluation Snapshot
91
+
92
+ The selected checkpoint is step 600, which was also the best checkpoint by
93
+ validation loss.
94
+
95
+ - Final validation loss: 2.2429933547973633.
96
+ - Final validation mean token accuracy: 0.5876548955053303.
97
+ - Training runtime: approximately 7,633 seconds.
98
+ - Generation probes showed usable instruction following and safety refusals,
99
+ with remaining roughness on some style and technical prompts.
100
+
101
+ ## Limitations
102
+
103
+ The model is a LoRA adapter, not a merged full model. Quality is expected to be
104
+ below the recovered 4B adapter, and the Andaluh style can be uneven. Outputs
105
+ may contain linguistic artifacts from automatic transformation and should be
106
+ reviewed before publication.
107
+
108
+ ## Framework Versions
109
+
110
+ - PEFT 0.19.1
111
+ - TRL 1.3.0
112
+ - Transformers 5.8.0.dev0
113
+ - PyTorch 2.11.0+cu130
114
+ - Datasets 4.8.5
115
+ - Tokenizers 0.22.2
adapter_config.json ADDED
@@ -0,0 +1,1618 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": null,
6
+ "base_model_name_or_path": "Qwen/Qwen3.5-2B-Base",
7
+ "bias": "none",
8
+ "corda_config": null,
9
+ "ensure_weight_tying": true,
10
+ "eva_config": null,
11
+ "exclude_modules": null,
12
+ "fan_in_fan_out": false,
13
+ "inference_mode": true,
14
+ "init_lora_weights": true,
15
+ "layer_replication": null,
16
+ "layers_pattern": null,
17
+ "layers_to_transform": null,
18
+ "loftq_config": {},
19
+ "lora_alpha": 32,
20
+ "lora_bias": false,
21
+ "lora_dropout": 0.05,
22
+ "lora_ga_config": null,
23
+ "megatron_config": null,
24
+ "megatron_core": "megatron.core",
25
+ "modules_to_save": null,
26
+ "peft_type": "LORA",
27
+ "peft_version": "0.19.1",
28
+ "qalora_group_size": 16,
29
+ "r": 16,
30
+ "rank_pattern": {},
31
+ "revision": null,
32
+ "target_modules": [
33
+ "gate_proj",
34
+ "k_proj",
35
+ "q_proj",
36
+ "down_proj",
37
+ "o_proj",
38
+ "v_proj",
39
+ "up_proj"
40
+ ],
41
+ "target_parameters": null,
42
+ "task_type": "CAUSAL_LM",
43
+ "trainable_token_indices": [
44
+ 248044,
45
+ 248045,
46
+ 248046,
47
+ 248047,
48
+ 248048,
49
+ 248049,
50
+ 248050,
51
+ 248051,
52
+ 248052,
53
+ 248053,
54
+ 248054,
55
+ 248055,
56
+ 248056,
57
+ 248057,
58
+ 248058,
59
+ 248059,
60
+ 248060,
61
+ 248061,
62
+ 248062,
63
+ 248063,
64
+ 248064,
65
+ 248065,
66
+ 248066,
67
+ 248067,
68
+ 248068,
69
+ 248069,
70
+ 248070,
71
+ 248071,
72
+ 248072,
73
+ 248073,
74
+ 248074,
75
+ 248075,
76
+ 248076,
77
+ 248077,
78
+ 248078,
79
+ 248079,
80
+ 248080,
81
+ 248081,
82
+ 248082,
83
+ 248083,
84
+ 248084,
85
+ 248085,
86
+ 248086,
87
+ 248087,
88
+ 248088,
89
+ 248089,
90
+ 248090,
91
+ 248091,
92
+ 248092,
93
+ 248093,
94
+ 248094,
95
+ 248095,
96
+ 248096,
97
+ 248097,
98
+ 248098,
99
+ 248099,
100
+ 248100,
101
+ 248101,
102
+ 248102,
103
+ 248103,
104
+ 248104,
105
+ 248105,
106
+ 248106,
107
+ 248107,
108
+ 248108,
109
+ 248109,
110
+ 248110,
111
+ 248111,
112
+ 248112,
113
+ 248113,
114
+ 248114,
115
+ 248115,
116
+ 248116,
117
+ 248117,
118
+ 248118,
119
+ 248119,
120
+ 248120,
121
+ 248121,
122
+ 248122,
123
+ 248123,
124
+ 248124,
125
+ 248125,
126
+ 248126,
127
+ 248127,
128
+ 248128,
129
+ 248129,
130
+ 248130,
131
+ 248131,
132
+ 248132,
133
+ 248133,
134
+ 248134,
135
+ 248135,
136
+ 248136,
137
+ 248137,
138
+ 248138,
139
+ 248139,
140
+ 248140,
141
+ 248141,
142
+ 248142,
143
+ 248143,
144
+ 248144,
145
+ 248145,
146
+ 248146,
147
+ 248147,
148
+ 248148,
149
+ 248149,
150
+ 248150,
151
+ 248151,
152
+ 248152,
153
+ 248153,
154
+ 248154,
155
+ 248155,
156
+ 248156,
157
+ 248157,
158
+ 248158,
159
+ 248159,
160
+ 248160,
161
+ 248161,
162
+ 248162,
163
+ 248163,
164
+ 248164,
165
+ 248165,
166
+ 248166,
167
+ 248167,
168
+ 248168,
169
+ 248169,
170
+ 248170,
171
+ 248171,
172
+ 248172,
173
+ 248173,
174
+ 248174,
175
+ 248175,
176
+ 248176,
177
+ 248177,
178
+ 248178,
179
+ 248179,
180
+ 248180,
181
+ 248181,
182
+ 248182,
183
+ 248183,
184
+ 248184,
185
+ 248185,
186
+ 248186,
187
+ 248187,
188
+ 248188,
189
+ 248189,
190
+ 248190,
191
+ 248191,
192
+ 248192,
193
+ 248193,
194
+ 248194,
195
+ 248195,
196
+ 248196,
197
+ 248197,
198
+ 248198,
199
+ 248199,
200
+ 248200,
201
+ 248201,
202
+ 248202,
203
+ 248203,
204
+ 248204,
205
+ 248205,
206
+ 248206,
207
+ 248207,
208
+ 248208,
209
+ 248209,
210
+ 248210,
211
+ 248211,
212
+ 248212,
213
+ 248213,
214
+ 248214,
215
+ 248215,
216
+ 248216,
217
+ 248217,
218
+ 248218,
219
+ 248219,
220
+ 248220,
221
+ 248221,
222
+ 248222,
223
+ 248223,
224
+ 248224,
225
+ 248225,
226
+ 248226,
227
+ 248227,
228
+ 248228,
229
+ 248229,
230
+ 248230,
231
+ 248231,
232
+ 248232,
233
+ 248233,
234
+ 248234,
235
+ 248235,
236
+ 248236,
237
+ 248237,
238
+ 248238,
239
+ 248239,
240
+ 248240,
241
+ 248241,
242
+ 248242,
243
+ 248243,
244
+ 248244,
245
+ 248245,
246
+ 248246,
247
+ 248247,
248
+ 248248,
249
+ 248249,
250
+ 248250,
251
+ 248251,
252
+ 248252,
253
+ 248253,
254
+ 248254,
255
+ 248255,
256
+ 248256,
257
+ 248257,
258
+ 248258,
259
+ 248259,
260
+ 248260,
261
+ 248261,
262
+ 248262,
263
+ 248263,
264
+ 248264,
265
+ 248265,
266
+ 248266,
267
+ 248267,
268
+ 248268,
269
+ 248269,
270
+ 248270,
271
+ 248271,
272
+ 248272,
273
+ 248273,
274
+ 248274,
275
+ 248275,
276
+ 248276,
277
+ 248277,
278
+ 248278,
279
+ 248279,
280
+ 248280,
281
+ 248281,
282
+ 248282,
283
+ 248283,
284
+ 248284,
285
+ 248285,
286
+ 248286,
287
+ 248287,
288
+ 248288,
289
+ 248289,
290
+ 248290,
291
+ 248291,
292
+ 248292,
293
+ 248293,
294
+ 248294,
295
+ 248295,
296
+ 248296,
297
+ 248297,
298
+ 248298,
299
+ 248299,
300
+ 248300,
301
+ 248301,
302
+ 248302,
303
+ 248303,
304
+ 248304,
305
+ 248305,
306
+ 248306,
307
+ 248307,
308
+ 248308,
309
+ 248309,
310
+ 248310,
311
+ 248311,
312
+ 248312,
313
+ 248313,
314
+ 248314,
315
+ 248315,
316
+ 248316,
317
+ 248317,
318
+ 248318,
319
+ 248319,
320
+ 248320,
321
+ 248321,
322
+ 248322,
323
+ 248323,
324
+ 248324,
325
+ 248325,
326
+ 248326,
327
+ 248327,
328
+ 248328,
329
+ 248329,
330
+ 248330,
331
+ 248331,
332
+ 248332,
333
+ 248333,
334
+ 248334,
335
+ 248335,
336
+ 248336,
337
+ 248337,
338
+ 248338,
339
+ 248339,
340
+ 248340,
341
+ 248341,
342
+ 248342,
343
+ 248343,
344
+ 248344,
345
+ 248345,
346
+ 248346,
347
+ 248347,
348
+ 248348,
349
+ 248349,
350
+ 248350,
351
+ 248351,
352
+ 248352,
353
+ 248353,
354
+ 248354,
355
+ 248355,
356
+ 248356,
357
+ 248357,
358
+ 248358,
359
+ 248359,
360
+ 248360,
361
+ 248361,
362
+ 248362,
363
+ 248363,
364
+ 248364,
365
+ 248365,
366
+ 248366,
367
+ 248367,
368
+ 248368,
369
+ 248369,
370
+ 248370,
371
+ 248371,
372
+ 248372,
373
+ 248373,
374
+ 248374,
375
+ 248375,
376
+ 248376,
377
+ 248377,
378
+ 248378,
379
+ 248379,
380
+ 248380,
381
+ 248381,
382
+ 248382,
383
+ 248383,
384
+ 248384,
385
+ 248385,
386
+ 248386,
387
+ 248387,
388
+ 248388,
389
+ 248389,
390
+ 248390,
391
+ 248391,
392
+ 248392,
393
+ 248393,
394
+ 248394,
395
+ 248395,
396
+ 248396,
397
+ 248397,
398
+ 248398,
399
+ 248399,
400
+ 248400,
401
+ 248401,
402
+ 248402,
403
+ 248403,
404
+ 248404,
405
+ 248405,
406
+ 248406,
407
+ 248407,
408
+ 248408,
409
+ 248409,
410
+ 248410,
411
+ 248411,
412
+ 248412,
413
+ 248413,
414
+ 248414,
415
+ 248415,
416
+ 248416,
417
+ 248417,
418
+ 248418,
419
+ 248419,
420
+ 248420,
421
+ 248421,
422
+ 248422,
423
+ 248423,
424
+ 248424,
425
+ 248425,
426
+ 248426,
427
+ 248427,
428
+ 248428,
429
+ 248429,
430
+ 248430,
431
+ 248431,
432
+ 248432,
433
+ 248433,
434
+ 248434,
435
+ 248435,
436
+ 248436,
437
+ 248437,
438
+ 248438,
439
+ 248439,
440
+ 248440,
441
+ 248441,
442
+ 248442,
443
+ 248443,
444
+ 248444,
445
+ 248445,
446
+ 248446,
447
+ 248447,
448
+ 248448,
449
+ 248449,
450
+ 248450,
451
+ 248451,
452
+ 248452,
453
+ 248453,
454
+ 248454,
455
+ 248455,
456
+ 248456,
457
+ 248457,
458
+ 248458,
459
+ 248459,
460
+ 248460,
461
+ 248461,
462
+ 248462,
463
+ 248463,
464
+ 248464,
465
+ 248465,
466
+ 248466,
467
+ 248467,
468
+ 248468,
469
+ 248469,
470
+ 248470,
471
+ 248471,
472
+ 248472,
473
+ 248473,
474
+ 248474,
475
+ 248475,
476
+ 248476,
477
+ 248477,
478
+ 248478,
479
+ 248479,
480
+ 248480,
481
+ 248481,
482
+ 248482,
483
+ 248483,
484
+ 248484,
485
+ 248485,
486
+ 248486,
487
+ 248487,
488
+ 248488,
489
+ 248489,
490
+ 248490,
491
+ 248491,
492
+ 248492,
493
+ 248493,
494
+ 248494,
495
+ 248495,
496
+ 248496,
497
+ 248497,
498
+ 248498,
499
+ 248499,
500
+ 248500,
501
+ 248501,
502
+ 248502,
503
+ 248503,
504
+ 248504,
505
+ 248505,
506
+ 248506,
507
+ 248507,
508
+ 248508,
509
+ 248509,
510
+ 248510,
511
+ 248511,
512
+ 248512,
513
+ 248513,
514
+ 248514,
515
+ 248515,
516
+ 248516,
517
+ 248517,
518
+ 248518,
519
+ 248519,
520
+ 248520,
521
+ 248521,
522
+ 248522,
523
+ 248523,
524
+ 248524,
525
+ 248525,
526
+ 248526,
527
+ 248527,
528
+ 248528,
529
+ 248529,
530
+ 248530,
531
+ 248531,
532
+ 248532,
533
+ 248533,
534
+ 248534,
535
+ 248535,
536
+ 248536,
537
+ 248537,
538
+ 248538,
539
+ 248539,
540
+ 248540,
541
+ 248541,
542
+ 248542,
543
+ 248543,
544
+ 248544,
545
+ 248545,
546
+ 248546,
547
+ 248547,
548
+ 248548,
549
+ 248549,
550
+ 248550,
551
+ 248551,
552
+ 248552,
553
+ 248553,
554
+ 248554,
555
+ 248555,
556
+ 248556,
557
+ 248557,
558
+ 248558,
559
+ 248559,
560
+ 248560,
561
+ 248561,
562
+ 248562,
563
+ 248563,
564
+ 248564,
565
+ 248565,
566
+ 248566,
567
+ 248567,
568
+ 248568,
569
+ 248569,
570
+ 248570,
571
+ 248571,
572
+ 248572,
573
+ 248573,
574
+ 248574,
575
+ 248575,
576
+ 248576,
577
+ 248577,
578
+ 248578,
579
+ 248579,
580
+ 248580,
581
+ 248581,
582
+ 248582,
583
+ 248583,
584
+ 248584,
585
+ 248585,
586
+ 248586,
587
+ 248587,
588
+ 248588,
589
+ 248589,
590
+ 248590,
591
+ 248591,
592
+ 248592,
593
+ 248593,
594
+ 248594,
595
+ 248595,
596
+ 248596,
597
+ 248597,
598
+ 248598,
599
+ 248599,
600
+ 248600,
601
+ 248601,
602
+ 248602,
603
+ 248603,
604
+ 248604,
605
+ 248605,
606
+ 248606,
607
+ 248607,
608
+ 248608,
609
+ 248609,
610
+ 248610,
611
+ 248611,
612
+ 248612,
613
+ 248613,
614
+ 248614,
615
+ 248615,
616
+ 248616,
617
+ 248617,
618
+ 248618,
619
+ 248619,
620
+ 248620,
621
+ 248621,
622
+ 248622,
623
+ 248623,
624
+ 248624,
625
+ 248625,
626
+ 248626,
627
+ 248627,
628
+ 248628,
629
+ 248629,
630
+ 248630,
631
+ 248631,
632
+ 248632,
633
+ 248633,
634
+ 248634,
635
+ 248635,
636
+ 248636,
637
+ 248637,
638
+ 248638,
639
+ 248639,
640
+ 248640,
641
+ 248641,
642
+ 248642,
643
+ 248643,
644
+ 248644,
645
+ 248645,
646
+ 248646,
647
+ 248647,
648
+ 248648,
649
+ 248649,
650
+ 248650,
651
+ 248651,
652
+ 248652,
653
+ 248653,
654
+ 248654,
655
+ 248655,
656
+ 248656,
657
+ 248657,
658
+ 248658,
659
+ 248659,
660
+ 248660,
661
+ 248661,
662
+ 248662,
663
+ 248663,
664
+ 248664,
665
+ 248665,
666
+ 248666,
667
+ 248667,
668
+ 248668,
669
+ 248669,
670
+ 248670,
671
+ 248671,
672
+ 248672,
673
+ 248673,
674
+ 248674,
675
+ 248675,
676
+ 248676,
677
+ 248677,
678
+ 248678,
679
+ 248679,
680
+ 248680,
681
+ 248681,
682
+ 248682,
683
+ 248683,
684
+ 248684,
685
+ 248685,
686
+ 248686,
687
+ 248687,
688
+ 248688,
689
+ 248689,
690
+ 248690,
691
+ 248691,
692
+ 248692,
693
+ 248693,
694
+ 248694,
695
+ 248695,
696
+ 248696,
697
+ 248697,
698
+ 248698,
699
+ 248699,
700
+ 248700,
701
+ 248701,
702
+ 248702,
703
+ 248703,
704
+ 248704,
705
+ 248705,
706
+ 248706,
707
+ 248707,
708
+ 248708,
709
+ 248709,
710
+ 248710,
711
+ 248711,
712
+ 248712,
713
+ 248713,
714
+ 248714,
715
+ 248715,
716
+ 248716,
717
+ 248717,
718
+ 248718,
719
+ 248719,
720
+ 248720,
721
+ 248721,
722
+ 248722,
723
+ 248723,
724
+ 248724,
725
+ 248725,
726
+ 248726,
727
+ 248727,
728
+ 248728,
729
+ 248729,
730
+ 248730,
731
+ 248731,
732
+ 248732,
733
+ 248733,
734
+ 248734,
735
+ 248735,
736
+ 248736,
737
+ 248737,
738
+ 248738,
739
+ 248739,
740
+ 248740,
741
+ 248741,
742
+ 248742,
743
+ 248743,
744
+ 248744,
745
+ 248745,
746
+ 248746,
747
+ 248747,
748
+ 248748,
749
+ 248749,
750
+ 248750,
751
+ 248751,
752
+ 248752,
753
+ 248753,
754
+ 248754,
755
+ 248755,
756
+ 248756,
757
+ 248757,
758
+ 248758,
759
+ 248759,
760
+ 248760,
761
+ 248761,
762
+ 248762,
763
+ 248763,
764
+ 248764,
765
+ 248765,
766
+ 248766,
767
+ 248767,
768
+ 248768,
769
+ 248769,
770
+ 248770,
771
+ 248771,
772
+ 248772,
773
+ 248773,
774
+ 248774,
775
+ 248775,
776
+ 248776,
777
+ 248777,
778
+ 248778,
779
+ 248779,
780
+ 248780,
781
+ 248781,
782
+ 248782,
783
+ 248783,
784
+ 248784,
785
+ 248785,
786
+ 248786,
787
+ 248787,
788
+ 248788,
789
+ 248789,
790
+ 248790,
791
+ 248791,
792
+ 248792,
793
+ 248793,
794
+ 248794,
795
+ 248795,
796
+ 248796,
797
+ 248797,
798
+ 248798,
799
+ 248799,
800
+ 248800,
801
+ 248801,
802
+ 248802,
803
+ 248803,
804
+ 248804,
805
+ 248805,
806
+ 248806,
807
+ 248807,
808
+ 248808,
809
+ 248809,
810
+ 248810,
811
+ 248811,
812
+ 248812,
813
+ 248813,
814
+ 248814,
815
+ 248815,
816
+ 248816,
817
+ 248817,
818
+ 248818,
819
+ 248819,
820
+ 248820,
821
+ 248821,
822
+ 248822,
823
+ 248823,
824
+ 248824,
825
+ 248825,
826
+ 248826,
827
+ 248827,
828
+ 248828,
829
+ 248829,
830
+ 248830,
831
+ 248831,
832
+ 248832,
833
+ 248833,
834
+ 248834,
835
+ 248835,
836
+ 248836,
837
+ 248837,
838
+ 248838,
839
+ 248839,
840
+ 248840,
841
+ 248841,
842
+ 248842,
843
+ 248843,
844
+ 248844,
845
+ 248845,
846
+ 248846,
847
+ 248847,
848
+ 248848,
849
+ 248849,
850
+ 248850,
851
+ 248851,
852
+ 248852,
853
+ 248853,
854
+ 248854,
855
+ 248855,
856
+ 248856,
857
+ 248857,
858
+ 248858,
859
+ 248859,
860
+ 248860,
861
+ 248861,
862
+ 248862,
863
+ 248863,
864
+ 248864,
865
+ 248865,
866
+ 248866,
867
+ 248867,
868
+ 248868,
869
+ 248869,
870
+ 248870,
871
+ 248871,
872
+ 248872,
873
+ 248873,
874
+ 248874,
875
+ 248875,
876
+ 248876,
877
+ 248877,
878
+ 248878,
879
+ 248879,
880
+ 248880,
881
+ 248881,
882
+ 248882,
883
+ 248883,
884
+ 248884,
885
+ 248885,
886
+ 248886,
887
+ 248887,
888
+ 248888,
889
+ 248889,
890
+ 248890,
891
+ 248891,
892
+ 248892,
893
+ 248893,
894
+ 248894,
895
+ 248895,
896
+ 248896,
897
+ 248897,
898
+ 248898,
899
+ 248899,
900
+ 248900,
901
+ 248901,
902
+ 248902,
903
+ 248903,
904
+ 248904,
905
+ 248905,
906
+ 248906,
907
+ 248907,
908
+ 248908,
909
+ 248909,
910
+ 248910,
911
+ 248911,
912
+ 248912,
913
+ 248913,
914
+ 248914,
915
+ 248915,
916
+ 248916,
917
+ 248917,
918
+ 248918,
919
+ 248919,
920
+ 248920,
921
+ 248921,
922
+ 248922,
923
+ 248923,
924
+ 248924,
925
+ 248925,
926
+ 248926,
927
+ 248927,
928
+ 248928,
929
+ 248929,
930
+ 248930,
931
+ 248931,
932
+ 248932,
933
+ 248933,
934
+ 248934,
935
+ 248935,
936
+ 248936,
937
+ 248937,
938
+ 248938,
939
+ 248939,
940
+ 248940,
941
+ 248941,
942
+ 248942,
943
+ 248943,
944
+ 248944,
945
+ 248945,
946
+ 248946,
947
+ 248947,
948
+ 248948,
949
+ 248949,
950
+ 248950,
951
+ 248951,
952
+ 248952,
953
+ 248953,
954
+ 248954,
955
+ 248955,
956
+ 248956,
957
+ 248957,
958
+ 248958,
959
+ 248959,
960
+ 248960,
961
+ 248961,
962
+ 248962,
963
+ 248963,
964
+ 248964,
965
+ 248965,
966
+ 248966,
967
+ 248967,
968
+ 248968,
969
+ 248969,
970
+ 248970,
971
+ 248971,
972
+ 248972,
973
+ 248973,
974
+ 248974,
975
+ 248975,
976
+ 248976,
977
+ 248977,
978
+ 248978,
979
+ 248979,
980
+ 248980,
981
+ 248981,
982
+ 248982,
983
+ 248983,
984
+ 248984,
985
+ 248985,
986
+ 248986,
987
+ 248987,
988
+ 248988,
989
+ 248989,
990
+ 248990,
991
+ 248991,
992
+ 248992,
993
+ 248993,
994
+ 248994,
995
+ 248995,
996
+ 248996,
997
+ 248997,
998
+ 248998,
999
+ 248999,
1000
+ 249000,
1001
+ 249001,
1002
+ 249002,
1003
+ 249003,
1004
+ 249004,
1005
+ 249005,
1006
+ 249006,
1007
+ 249007,
1008
+ 249008,
1009
+ 249009,
1010
+ 249010,
1011
+ 249011,
1012
+ 249012,
1013
+ 249013,
1014
+ 249014,
1015
+ 249015,
1016
+ 249016,
1017
+ 249017,
1018
+ 249018,
1019
+ 249019,
1020
+ 249020,
1021
+ 249021,
1022
+ 249022,
1023
+ 249023,
1024
+ 249024,
1025
+ 249025,
1026
+ 249026,
1027
+ 249027,
1028
+ 249028,
1029
+ 249029,
1030
+ 249030,
1031
+ 249031,
1032
+ 249032,
1033
+ 249033,
1034
+ 249034,
1035
+ 249035,
1036
+ 249036,
1037
+ 249037,
1038
+ 249038,
1039
+ 249039,
1040
+ 249040,
1041
+ 249041,
1042
+ 249042,
1043
+ 249043,
1044
+ 249044,
1045
+ 249045,
1046
+ 249046,
1047
+ 249047,
1048
+ 249048,
1049
+ 249049,
1050
+ 249050,
1051
+ 249051,
1052
+ 249052,
1053
+ 249053,
1054
+ 249054,
1055
+ 249055,
1056
+ 249056,
1057
+ 249057,
1058
+ 249058,
1059
+ 249059,
1060
+ 249060,
1061
+ 249061,
1062
+ 249062,
1063
+ 249063,
1064
+ 249064,
1065
+ 249065,
1066
+ 249066,
1067
+ 249067,
1068
+ 249068,
1069
+ 249069,
1070
+ 249070,
1071
+ 249071,
1072
+ 249072,
1073
+ 249073,
1074
+ 249074,
1075
+ 249075,
1076
+ 249076,
1077
+ 249077,
1078
+ 249078,
1079
+ 249079,
1080
+ 249080,
1081
+ 249081,
1082
+ 249082,
1083
+ 249083,
1084
+ 249084,
1085
+ 249085,
1086
+ 249086,
1087
+ 249087,
1088
+ 249088,
1089
+ 249089,
1090
+ 249090,
1091
+ 249091,
1092
+ 249092,
1093
+ 249093,
1094
+ 249094,
1095
+ 249095,
1096
+ 249096,
1097
+ 249097,
1098
+ 249098,
1099
+ 249099,
1100
+ 249100,
1101
+ 249101,
1102
+ 249102,
1103
+ 249103,
1104
+ 249104,
1105
+ 249105,
1106
+ 249106,
1107
+ 249107,
1108
+ 249108,
1109
+ 249109,
1110
+ 249110,
1111
+ 249111,
1112
+ 249112,
1113
+ 249113,
1114
+ 249114,
1115
+ 249115,
1116
+ 249116,
1117
+ 249117,
1118
+ 249118,
1119
+ 249119,
1120
+ 249120,
1121
+ 249121,
1122
+ 249122,
1123
+ 249123,
1124
+ 249124,
1125
+ 249125,
1126
+ 249126,
1127
+ 249127,
1128
+ 249128,
1129
+ 249129,
1130
+ 249130,
1131
+ 249131,
1132
+ 249132,
1133
+ 249133,
1134
+ 249134,
1135
+ 249135,
1136
+ 249136,
1137
+ 249137,
1138
+ 249138,
1139
+ 249139,
1140
+ 249140,
1141
+ 249141,
1142
+ 249142,
1143
+ 249143,
1144
+ 249144,
1145
+ 249145,
1146
+ 249146,
1147
+ 249147,
1148
+ 249148,
1149
+ 249149,
1150
+ 249150,
1151
+ 249151,
1152
+ 249152,
1153
+ 249153,
1154
+ 249154,
1155
+ 249155,
1156
+ 249156,
1157
+ 249157,
1158
+ 249158,
1159
+ 249159,
1160
+ 249160,
1161
+ 249161,
1162
+ 249162,
1163
+ 249163,
1164
+ 249164,
1165
+ 249165,
1166
+ 249166,
1167
+ 249167,
1168
+ 249168,
1169
+ 249169,
1170
+ 249170,
1171
+ 249171,
1172
+ 249172,
1173
+ 249173,
1174
+ 249174,
1175
+ 249175,
1176
+ 249176,
1177
+ 249177,
1178
+ 249178,
1179
+ 249179,
1180
+ 249180,
1181
+ 249181,
1182
+ 249182,
1183
+ 249183,
1184
+ 249184,
1185
+ 249185,
1186
+ 249186,
1187
+ 249187,
1188
+ 249188,
1189
+ 249189,
1190
+ 249190,
1191
+ 249191,
1192
+ 249192,
1193
+ 249193,
1194
+ 249194,
1195
+ 249195,
1196
+ 249196,
1197
+ 249197,
1198
+ 249198,
1199
+ 249199,
1200
+ 249200,
1201
+ 249201,
1202
+ 249202,
1203
+ 249203,
1204
+ 249204,
1205
+ 249205,
1206
+ 249206,
1207
+ 249207,
1208
+ 249208,
1209
+ 249209,
1210
+ 249210,
1211
+ 249211,
1212
+ 249212,
1213
+ 249213,
1214
+ 249214,
1215
+ 249215,
1216
+ 249216,
1217
+ 249217,
1218
+ 249218,
1219
+ 249219,
1220
+ 249220,
1221
+ 249221,
1222
+ 249222,
1223
+ 249223,
1224
+ 249224,
1225
+ 249225,
1226
+ 249226,
1227
+ 249227,
1228
+ 249228,
1229
+ 249229,
1230
+ 249230,
1231
+ 249231,
1232
+ 249232,
1233
+ 249233,
1234
+ 249234,
1235
+ 249235,
1236
+ 249236,
1237
+ 249237,
1238
+ 249238,
1239
+ 249239,
1240
+ 249240,
1241
+ 249241,
1242
+ 249242,
1243
+ 249243,
1244
+ 249244,
1245
+ 249245,
1246
+ 249246,
1247
+ 249247,
1248
+ 249248,
1249
+ 249249,
1250
+ 249250,
1251
+ 249251,
1252
+ 249252,
1253
+ 249253,
1254
+ 249254,
1255
+ 249255,
1256
+ 249256,
1257
+ 249257,
1258
+ 249258,
1259
+ 249259,
1260
+ 249260,
1261
+ 249261,
1262
+ 249262,
1263
+ 249263,
1264
+ 249264,
1265
+ 249265,
1266
+ 249266,
1267
+ 249267,
1268
+ 249268,
1269
+ 249269,
1270
+ 249270,
1271
+ 249271,
1272
+ 249272,
1273
+ 249273,
1274
+ 249274,
1275
+ 249275,
1276
+ 249276,
1277
+ 249277,
1278
+ 249278,
1279
+ 249279,
1280
+ 249280,
1281
+ 249281,
1282
+ 249282,
1283
+ 249283,
1284
+ 249284,
1285
+ 249285,
1286
+ 249286,
1287
+ 249287,
1288
+ 249288,
1289
+ 249289,
1290
+ 249290,
1291
+ 249291,
1292
+ 249292,
1293
+ 249293,
1294
+ 249294,
1295
+ 249295,
1296
+ 249296,
1297
+ 249297,
1298
+ 249298,
1299
+ 249299,
1300
+ 249300,
1301
+ 249301,
1302
+ 249302,
1303
+ 249303,
1304
+ 249304,
1305
+ 249305,
1306
+ 249306,
1307
+ 249307,
1308
+ 249308,
1309
+ 249309,
1310
+ 249310,
1311
+ 249311,
1312
+ 249312,
1313
+ 249313,
1314
+ 249314,
1315
+ 249315,
1316
+ 249316,
1317
+ 249317,
1318
+ 249318,
1319
+ 249319,
1320
+ 249320,
1321
+ 249321,
1322
+ 249322,
1323
+ 249323,
1324
+ 249324,
1325
+ 249325,
1326
+ 249326,
1327
+ 249327,
1328
+ 249328,
1329
+ 249329,
1330
+ 249330,
1331
+ 249331,
1332
+ 249332,
1333
+ 249333,
1334
+ 249334,
1335
+ 249335,
1336
+ 249336,
1337
+ 249337,
1338
+ 249338,
1339
+ 249339,
1340
+ 249340,
1341
+ 249341,
1342
+ 249342,
1343
+ 249343,
1344
+ 249344,
1345
+ 249345,
1346
+ 249346,
1347
+ 249347,
1348
+ 249348,
1349
+ 249349,
1350
+ 249350,
1351
+ 249351,
1352
+ 249352,
1353
+ 249353,
1354
+ 249354,
1355
+ 249355,
1356
+ 249356,
1357
+ 249357,
1358
+ 249358,
1359
+ 249359,
1360
+ 249360,
1361
+ 249361,
1362
+ 249362,
1363
+ 249363,
1364
+ 249364,
1365
+ 249365,
1366
+ 249366,
1367
+ 249367,
1368
+ 249368,
1369
+ 249369,
1370
+ 249370,
1371
+ 249371,
1372
+ 249372,
1373
+ 249373,
1374
+ 249374,
1375
+ 249375,
1376
+ 249376,
1377
+ 249377,
1378
+ 249378,
1379
+ 249379,
1380
+ 249380,
1381
+ 249381,
1382
+ 249382,
1383
+ 249383,
1384
+ 249384,
1385
+ 249385,
1386
+ 249386,
1387
+ 249387,
1388
+ 249388,
1389
+ 249389,
1390
+ 249390,
1391
+ 249391,
1392
+ 249392,
1393
+ 249393,
1394
+ 249394,
1395
+ 249395,
1396
+ 249396,
1397
+ 249397,
1398
+ 249398,
1399
+ 249399,
1400
+ 249400,
1401
+ 249401,
1402
+ 249402,
1403
+ 249403,
1404
+ 249404,
1405
+ 249405,
1406
+ 249406,
1407
+ 249407,
1408
+ 249408,
1409
+ 249409,
1410
+ 249410,
1411
+ 249411,
1412
+ 249412,
1413
+ 249413,
1414
+ 249414,
1415
+ 249415,
1416
+ 249416,
1417
+ 249417,
1418
+ 249418,
1419
+ 249419,
1420
+ 249420,
1421
+ 249421,
1422
+ 249422,
1423
+ 249423,
1424
+ 249424,
1425
+ 249425,
1426
+ 249426,
1427
+ 249427,
1428
+ 249428,
1429
+ 249429,
1430
+ 249430,
1431
+ 249431,
1432
+ 249432,
1433
+ 249433,
1434
+ 249434,
1435
+ 249435,
1436
+ 249436,
1437
+ 249437,
1438
+ 249438,
1439
+ 249439,
1440
+ 249440,
1441
+ 249441,
1442
+ 249442,
1443
+ 249443,
1444
+ 249444,
1445
+ 249445,
1446
+ 249446,
1447
+ 249447,
1448
+ 249448,
1449
+ 249449,
1450
+ 249450,
1451
+ 249451,
1452
+ 249452,
1453
+ 249453,
1454
+ 249454,
1455
+ 249455,
1456
+ 249456,
1457
+ 249457,
1458
+ 249458,
1459
+ 249459,
1460
+ 249460,
1461
+ 249461,
1462
+ 249462,
1463
+ 249463,
1464
+ 249464,
1465
+ 249465,
1466
+ 249466,
1467
+ 249467,
1468
+ 249468,
1469
+ 249469,
1470
+ 249470,
1471
+ 249471,
1472
+ 249472,
1473
+ 249473,
1474
+ 249474,
1475
+ 249475,
1476
+ 249476,
1477
+ 249477,
1478
+ 249478,
1479
+ 249479,
1480
+ 249480,
1481
+ 249481,
1482
+ 249482,
1483
+ 249483,
1484
+ 249484,
1485
+ 249485,
1486
+ 249486,
1487
+ 249487,
1488
+ 249488,
1489
+ 249489,
1490
+ 249490,
1491
+ 249491,
1492
+ 249492,
1493
+ 249493,
1494
+ 249494,
1495
+ 249495,
1496
+ 249496,
1497
+ 249497,
1498
+ 249498,
1499
+ 249499,
1500
+ 249500,
1501
+ 249501,
1502
+ 249502,
1503
+ 249503,
1504
+ 249504,
1505
+ 249505,
1506
+ 249506,
1507
+ 249507,
1508
+ 249508,
1509
+ 249509,
1510
+ 249510,
1511
+ 249511,
1512
+ 249512,
1513
+ 249513,
1514
+ 249514,
1515
+ 249515,
1516
+ 249516,
1517
+ 249517,
1518
+ 249518,
1519
+ 249519,
1520
+ 249520,
1521
+ 249521,
1522
+ 249522,
1523
+ 249523,
1524
+ 249524,
1525
+ 249525,
1526
+ 249526,
1527
+ 249527,
1528
+ 249528,
1529
+ 249529,
1530
+ 249530,
1531
+ 249531,
1532
+ 249532,
1533
+ 249533,
1534
+ 249534,
1535
+ 249535,
1536
+ 249536,
1537
+ 249537,
1538
+ 249538,
1539
+ 249539,
1540
+ 249540,
1541
+ 249541,
1542
+ 249542,
1543
+ 249543,
1544
+ 249544,
1545
+ 249545,
1546
+ 249546,
1547
+ 249547,
1548
+ 249548,
1549
+ 249549,
1550
+ 249550,
1551
+ 249551,
1552
+ 249552,
1553
+ 249553,
1554
+ 249554,
1555
+ 249555,
1556
+ 249556,
1557
+ 249557,
1558
+ 249558,
1559
+ 249559,
1560
+ 249560,
1561
+ 249561,
1562
+ 249562,
1563
+ 249563,
1564
+ 249564,
1565
+ 249565,
1566
+ 249566,
1567
+ 249567,
1568
+ 249568,
1569
+ 249569,
1570
+ 249570,
1571
+ 249571,
1572
+ 249572,
1573
+ 249573,
1574
+ 249574,
1575
+ 249575,
1576
+ 249576,
1577
+ 249577,
1578
+ 249578,
1579
+ 249579,
1580
+ 249580,
1581
+ 249581,
1582
+ 249582,
1583
+ 249583,
1584
+ 249584,
1585
+ 249585,
1586
+ 249586,
1587
+ 249587,
1588
+ 249588,
1589
+ 249589,
1590
+ 249590,
1591
+ 249591,
1592
+ 249592,
1593
+ 249593,
1594
+ 249594,
1595
+ 249595,
1596
+ 249596,
1597
+ 249597,
1598
+ 249598,
1599
+ 249599,
1600
+ 249600,
1601
+ 249601,
1602
+ 249602,
1603
+ 249603,
1604
+ 249604,
1605
+ 249605,
1606
+ 249606,
1607
+ 249607,
1608
+ 249608,
1609
+ 249609,
1610
+ 249610,
1611
+ 249611,
1612
+ 249612
1613
+ ],
1614
+ "use_bdlora": null,
1615
+ "use_dora": false,
1616
+ "use_qalora": false,
1617
+ "use_rslora": false
1618
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e7d5f5728b419ab268e935934c0b26904e10aa0bf01d2e3d0b035aae4f1cd25
3
+ size 2114209072
chat_template.jinja ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- for message in messages %}
2
+ {%- set content = message['content'] if message['content'] is string else '' %}
3
+ {%- if message['role'] == 'assistant' %}
4
+ {{- '<|im_start|>assistant
5
+ ' -}}{% generation %}{{- content + '<|im_end|>
6
+ ' }}{% endgeneration %}
7
+ {%- elif message['role'] == 'system' or message['role'] == 'user' %}
8
+ {{- '<|im_start|>' + message['role'] + '
9
+ ' + content + '<|im_end|>
10
+ ' }}
11
+ {%- endif %}
12
+ {%- endfor %}
13
+ {%- if add_generation_prompt %}
14
+ {{- '<|im_start|>assistant
15
+ ' }}
16
+ {%- endif %}
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df2c43f2febaed5d06aa3e37c16c538ca4d814af2eb1d78cedf7246ef20ef0a0
3
+ size 20276155
tokenizer_config.json ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "audio_bos_token": "<|audio_start|>",
4
+ "audio_eos_token": "<|audio_end|>",
5
+ "audio_token": "<|audio_pad|>",
6
+ "backend": "tokenizers",
7
+ "bos_token": null,
8
+ "clean_up_tokenization_spaces": false,
9
+ "eos_token": "<|endoftext|>",
10
+ "errors": "replace",
11
+ "image_token": "<|image_pad|>",
12
+ "is_local": true,
13
+ "local_files_only": false,
14
+ "model_max_length": 262144,
15
+ "model_specific_special_tokens": {
16
+ "audio_bos_token": "<|audio_start|>",
17
+ "audio_eos_token": "<|audio_end|>",
18
+ "audio_token": "<|audio_pad|>",
19
+ "image_token": "<|image_pad|>",
20
+ "video_token": "<|video_pad|>",
21
+ "vision_bos_token": "<|vision_start|>",
22
+ "vision_eos_token": "<|vision_end|>"
23
+ },
24
+ "pad_token": "<|endoftext|>",
25
+ "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
26
+ "split_special_tokens": false,
27
+ "tokenizer_class": "Qwen2Tokenizer",
28
+ "unk_token": null,
29
+ "video_token": "<|video_pad|>",
30
+ "vision_bos_token": "<|vision_start|>",
31
+ "vision_eos_token": "<|vision_end|>"
32
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3185c6d3f8b041b8a304606bf93341eb596f0d0562c5b079df7197845450a16b
3
+ size 5777