Hugging Face's logo

socius
/
Smoltaur-3B-LoRA-r16-f0.25

Text Generation
PEFT
Safetensors
English
psychology
cognitive science
human behavior
unsloth
lora
Model card Files
xet
 Community
nick-sh-oh commited on
Commit
eef0f4d
·
verified ·
1 Parent(s): 9b1f890

Upload ablation LoRA adapter

Browse files
Files changed (17) hide show
  1. .gitattributes +2 -0
  2. README.md +54 -20
  3. adapter_config.json +44 -0
  4. adapter_model.safetensors +3 -0
  5. checkpoint-471/README.md +210 -0
  6. checkpoint-471/adapter_config.json +44 -0
  7. checkpoint-471/adapter_model.safetensors +3 -0
  8. checkpoint-471/optimizer.pt +3 -0
  9. checkpoint-471/rng_state.pth +3 -0
  10. checkpoint-471/scheduler.pt +3 -0
  11. checkpoint-471/tokenizer.json +3 -0
  12. checkpoint-471/tokenizer_config.json +2067 -0
  13. checkpoint-471/trainer_state.json +363 -0
  14. checkpoint-471/training_args.bin +3 -0
  15. tokenizer.json +3 -0
  16. tokenizer_config.json +2067 -0
  17. training_args.bin +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ checkpoint-471/tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,29 +1,63 @@
1
  ---
 
2
  library_name: peft
 
3
  tags:
 
4
  - lora
5
- - centaur
6
- - psych-101
7
- - cognitive-modeling
8
- - ablation
9
- base_model_relation: adapter
 
10
  ---
11
 
12
- # Smoltaur-3B-LoRA-r16-f0.25
13
 
14
- LoRA adapter from the additional experiments (rank sweep / dataset-size
15
- ablation / new model families) for
16
- *Small Foundation Models of Human Cognition and Behaviour*.
17
 
18
- | field | value |
19
- |----------------|-------|
20
- | family | smollm |
21
- | model size | 3B |
22
- | LoRA rank | 16 (alpha = rank, rsLoRA) |
23
- | data fraction | 0.25 of Psych-101 |
24
- | axis | datasize_ablation |
25
- | precision | bf16 LoRA |
26
 
27
- Trained for 1 epoch on a stratified `0.25` subset of
28
- [`marcelbinz/Psych-101`](https://huggingface.co/datasets/marcelbinz/Psych-101).
29
- Evaluate with `eval_model.py --backend unsloth`.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: unsloth/SmolLM3-3B-Base
3
  library_name: peft
4
+ model_name: smoltaur-3b-r16-f0.25-bf16
5
  tags:
6
+ - base_model:adapter:unsloth/SmolLM3-3B-Base
7
  - lora
8
+ - sft
9
+ - transformers
10
+ - trl
11
+ - unsloth
12
+ licence: license
13
+ pipeline_tag: text-generation
14
  ---
15
 
16
+ # Model Card for smoltaur-3b-r16-f0.25-bf16
17
 
18
+ This model is a fine-tuned version of [unsloth/SmolLM3-3B-Base](https://huggingface.co/unsloth/SmolLM3-3B-Base).
19
+ It has been trained using [TRL](https://github.com/huggingface/trl).
 
20
 
21
+ ## Quick start
 
 
 
 
 
 
 
22
 
23
+ ```python
24
+ from transformers import pipeline
25
+
26
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
27
+ generator = pipeline("text-generation", model="None", device="cuda")
28
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
29
+ print(output["generated_text"])
30
+ ```
31
+
32
+ ## Training procedure
33
+
34
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/nick-sh-oh/smoltaur/runs/sko4wvw9)
35
+
36
+
37
+ This model was trained with SFT.
38
+
39
+ ### Framework versions
40
+
41
+ - PEFT 0.19.1
42
+ - TRL: 0.24.0
43
+ - Transformers: 5.5.0
44
+ - Pytorch: 2.10.0
45
+ - Datasets: 4.3.0
46
+ - Tokenizers: 0.22.2
47
+
48
+ ## Citations
49
+
50
+
51
+
52
+ Cite TRL as:
53
+
54
+ ```bibtex
55
+ @misc{vonwerra2022trl,
56
+ title = {{TRL: Transformer Reinforcement Learning}},
57
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
58
+ year = 2020,
59
+ journal = {GitHub repository},
60
+ publisher = {GitHub},
61
+ howpublished = {\url{https://github.com/huggingface/trl}}
62
+ }
63
+ ```
adapter_config.json ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": {
6
+ "base_model_class": "SmolLM3ForCausalLM",
7
+ "parent_library": "transformers.models.smollm3.modeling_smollm3",
8
+ "unsloth_fixed": true
9
+ },
10
+ "base_model_name_or_path": "unsloth/SmolLM3-3B-Base",
11
+ "bias": "none",
12
+ "corda_config": null,
13
+ "ensure_weight_tying": false,
14
+ "eva_config": null,
15
+ "exclude_modules": null,
16
+ "fan_in_fan_out": false,
17
+ "inference_mode": true,
18
+ "init_lora_weights": true,
19
+ "layer_replication": null,
20
+ "layers_pattern": null,
21
+ "layers_to_transform": null,
22
+ "loftq_config": {},
23
+ "lora_alpha": 16,
24
+ "lora_bias": false,
25
+ "lora_dropout": 0,
26
+ "lora_ga_config": null,
27
+ "megatron_config": null,
28
+ "megatron_core": "megatron.core",
29
+ "modules_to_save": null,
30
+ "peft_type": "LORA",
31
+ "peft_version": "0.19.1",
32
+ "qalora_group_size": 16,
33
+ "r": 16,
34
+ "rank_pattern": {},
35
+ "revision": null,
36
+ "target_modules": "(?:.*?(?:language|text).*?(?:self_attn|attention|attn|mixer|mlp|feed_forward|ffn|dense|mixer).*?(?:q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj))|(?:\\bmodel\\.layers\\.[\\d]{1,}\\.(?:self_attn|attention|attn|mixer|mlp|feed_forward|ffn|dense|mixer)\\.(?:(?:q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)))",
37
+ "target_parameters": null,
38
+ "task_type": "CAUSAL_LM",
39
+ "trainable_token_indices": null,
40
+ "use_bdlora": null,
41
+ "use_dora": false,
42
+ "use_qalora": false,
43
+ "use_rslora": true
44
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35215dda568989b6532c790659a0426affaba5529ca99b5b75a88894eda81dc3
3
+ size 120981200
checkpoint-471/README.md ADDED
@@ -0,0 +1,210 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/SmolLM3-3B-Base
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:unsloth/SmolLM3-3B-Base
7
+ - lora
8
+ - sft
9
+ - transformers
10
+ - trl
11
+ - unsloth
12
+ ---
13
+
14
+ # Model Card for Model ID
15
+
16
+ <!-- Provide a quick summary of what the model is/does. -->
17
+
18
+
19
+
20
+ ## Model Details
21
+
22
+ ### Model Description
23
+
24
+ <!-- Provide a longer summary of what this model is. -->
25
+
26
+
27
+
28
+ - **Developed by:** [More Information Needed]
29
+ - **Funded by [optional]:** [More Information Needed]
30
+ - **Shared by [optional]:** [More Information Needed]
31
+ - **Model type:** [More Information Needed]
32
+ - **Language(s) (NLP):** [More Information Needed]
33
+ - **License:** [More Information Needed]
34
+ - **Finetuned from model [optional]:** [More Information Needed]
35
+
36
+ ### Model Sources [optional]
37
+
38
+ <!-- Provide the basic links for the model. -->
39
+
40
+ - **Repository:** [More Information Needed]
41
+ - **Paper [optional]:** [More Information Needed]
42
+ - **Demo [optional]:** [More Information Needed]
43
+
44
+ ## Uses
45
+
46
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
47
+
48
+ ### Direct Use
49
+
50
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
51
+
52
+ [More Information Needed]
53
+
54
+ ### Downstream Use [optional]
55
+
56
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
57
+
58
+ [More Information Needed]
59
+
60
+ ### Out-of-Scope Use
61
+
62
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
63
+
64
+ [More Information Needed]
65
+
66
+ ## Bias, Risks, and Limitations
67
+
68
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
69
+
70
+ [More Information Needed]
71
+
72
+ ### Recommendations
73
+
74
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
75
+
76
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
77
+
78
+ ## How to Get Started with the Model
79
+
80
+ Use the code below to get started with the model.
81
+
82
+ [More Information Needed]
83
+
84
+ ## Training Details
85
+
86
+ ### Training Data
87
+
88
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
89
+
90
+ [More Information Needed]
91
+
92
+ ### Training Procedure
93
+
94
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
95
+
96
+ #### Preprocessing [optional]
97
+
98
+ [More Information Needed]
99
+
100
+
101
+ #### Training Hyperparameters
102
+
103
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
104
+
105
+ #### Speeds, Sizes, Times [optional]
106
+
107
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
108
+
109
+ [More Information Needed]
110
+
111
+ ## Evaluation
112
+
113
+ <!-- This section describes the evaluation protocols and provides the results. -->
114
+
115
+ ### Testing Data, Factors & Metrics
116
+
117
+ #### Testing Data
118
+
119
+ <!-- This should link to a Dataset Card if possible. -->
120
+
121
+ [More Information Needed]
122
+
123
+ #### Factors
124
+
125
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
126
+
127
+ [More Information Needed]
128
+
129
+ #### Metrics
130
+
131
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
132
+
133
+ [More Information Needed]
134
+
135
+ ### Results
136
+
137
+ [More Information Needed]
138
+
139
+ #### Summary
140
+
141
+
142
+
143
+ ## Model Examination [optional]
144
+
145
+ <!-- Relevant interpretability work for the model goes here -->
146
+
147
+ [More Information Needed]
148
+
149
+ ## Environmental Impact
150
+
151
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
152
+
153
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
154
+
155
+ - **Hardware Type:** [More Information Needed]
156
+ - **Hours used:** [More Information Needed]
157
+ - **Cloud Provider:** [More Information Needed]
158
+ - **Compute Region:** [More Information Needed]
159
+ - **Carbon Emitted:** [More Information Needed]
160
+
161
+ ## Technical Specifications [optional]
162
+
163
+ ### Model Architecture and Objective
164
+
165
+ [More Information Needed]
166
+
167
+ ### Compute Infrastructure
168
+
169
+ [More Information Needed]
170
+
171
+ #### Hardware
172
+
173
+ [More Information Needed]
174
+
175
+ #### Software
176
+
177
+ [More Information Needed]
178
+
179
+ ## Citation [optional]
180
+
181
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
182
+
183
+ **BibTeX:**
184
+
185
+ [More Information Needed]
186
+
187
+ **APA:**
188
+
189
+ [More Information Needed]
190
+
191
+ ## Glossary [optional]
192
+
193
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
194
+
195
+ [More Information Needed]
196
+
197
+ ## More Information [optional]
198
+
199
+ [More Information Needed]
200
+
201
+ ## Model Card Authors [optional]
202
+
203
+ [More Information Needed]
204
+
205
+ ## Model Card Contact
206
+
207
+ [More Information Needed]
208
+ ### Framework versions
209
+
210
+ - PEFT 0.19.1
checkpoint-471/adapter_config.json ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alora_invocation_tokens": null,
3
+ "alpha_pattern": {},
4
+ "arrow_config": null,
5
+ "auto_mapping": {
6
+ "base_model_class": "SmolLM3ForCausalLM",
7
+ "parent_library": "transformers.models.smollm3.modeling_smollm3",
8
+ "unsloth_fixed": true
9
+ },
10
+ "base_model_name_or_path": "unsloth/SmolLM3-3B-Base",
11
+ "bias": "none",
12
+ "corda_config": null,
13
+ "ensure_weight_tying": false,
14
+ "eva_config": null,
15
+ "exclude_modules": null,
16
+ "fan_in_fan_out": false,
17
+ "inference_mode": true,
18
+ "init_lora_weights": true,
19
+ "layer_replication": null,
20
+ "layers_pattern": null,
21
+ "layers_to_transform": null,
22
+ "loftq_config": {},
23
+ "lora_alpha": 16,
24
+ "lora_bias": false,
25
+ "lora_dropout": 0,
26
+ "lora_ga_config": null,
27
+ "megatron_config": null,
28
+ "megatron_core": "megatron.core",
29
+ "modules_to_save": null,
30
+ "peft_type": "LORA",
31
+ "peft_version": "0.19.1",
32
+ "qalora_group_size": 16,
33
+ "r": 16,
34
+ "rank_pattern": {},
35
+ "revision": null,
36
+ "target_modules": "(?:.*?(?:language|text).*?(?:self_attn|attention|attn|mixer|mlp|feed_forward|ffn|dense|mixer).*?(?:q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj))|(?:\\bmodel\\.layers\\.[\\d]{1,}\\.(?:self_attn|attention|attn|mixer|mlp|feed_forward|ffn|dense|mixer)\\.(?:(?:q_proj|k_proj|v_proj|o_proj|gate_proj|up_proj|down_proj)))",
37
+ "target_parameters": null,
38
+ "task_type": "CAUSAL_LM",
39
+ "trainable_token_indices": null,
40
+ "use_bdlora": null,
41
+ "use_dora": false,
42
+ "use_qalora": false,
43
+ "use_rslora": true
44
+ }
checkpoint-471/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35215dda568989b6532c790659a0426affaba5529ca99b5b75a88894eda81dc3
3
+ size 120981200
checkpoint-471/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6979414ed7e36b7276bf0993041af1bc18c0545643f2417779c75e3f5d958e1f
3
+ size 61997189
checkpoint-471/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:716d83e48b4ef0ecc739db256420344d8764b568cd2fec53ea128d8653e43804
3
+ size 14645
checkpoint-471/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15a9b62fb1cda2568183e395dda57f85eaee0265c753680218d349b9d299248e
3
+ size 1465
checkpoint-471/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab4da6b2aa68247e9c0fa9b97fc7fcc796505038d01f7e144522a65ce0dbd2e5
3
+ size 17208861
checkpoint-471/tokenizer_config.json ADDED
@@ -0,0 +1,2067 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "backend": "tokenizers",
3
+ "bos_token": null,
4
+ "clean_up_tokenization_spaces": true,
5
+ "eos_token": "<|end_of_text|>",
6
+ "fast": false,
7
+ "is_local": false,
8
+ "model_input_names": [
9
+ "input_ids",
10
+ "attention_mask"
11
+ ],
12
+ "model_max_length": 65536,
13
+ "pad_token": "<|finetune_right_pad_id|>",
14
+ "padding_side": "right",
15
+ "tokenizer_class": "TokenizersBackend",
16
+ "unk_token": null,
17
+ "added_tokens_decoder": {
18
+ "128000": {
19
+ "content": "<|begin_of_text|>",
20
+ "single_word": false,
21
+ "lstrip": false,
22
+ "rstrip": false,
23
+ "normalized": false,
24
+ "special": true
25
+ },
26
+ "128001": {
27
+ "content": "<|end_of_text|>",
28
+ "single_word": false,
29
+ "lstrip": false,
30
+ "rstrip": false,
31
+ "normalized": false,
32
+ "special": true
33
+ },
34
+ "128002": {
35
+ "content": "<think>",
36
+ "single_word": false,
37
+ "lstrip": false,
38
+ "rstrip": false,
39
+ "normalized": false,
40
+ "special": false
41
+ },
42
+ "128003": {
43
+ "content": "</think>",
44
+ "single_word": false,
45
+ "lstrip": false,
46
+ "rstrip": false,
47
+ "normalized": false,
48
+ "special": false
49
+ },
50
+ "128004": {
51
+ "content": "<|finetune_right_pad_id|>",
52
+ "single_word": false,
53
+ "lstrip": false,
54
+ "rstrip": false,
55
+ "normalized": false,
56
+ "special": true
57
+ },
58
+ "128005": {
59
+ "content": "<|reserved_special_token_2|>",
60
+ "single_word": false,
61
+ "lstrip": false,
62
+ "rstrip": false,
63
+ "normalized": false,
64
+ "special": true
65
+ },
66
+ "128006": {
67
+ "content": "<|start_header_id|>",
68
+ "single_word": false,
69
+ "lstrip": false,
70
+ "rstrip": false,
71
+ "normalized": false,
72
+ "special": true
73
+ },
74
+ "128007": {
75
+ "content": "<|end_header_id|>",
76
+ "single_word": false,
77
+ "lstrip": false,
78
+ "rstrip": false,
79
+ "normalized": false,
80
+ "special": true
81
+ },
82
+ "128008": {
83
+ "content": "<|eom_id|>",
84
+ "single_word": false,
85
+ "lstrip": false,
86
+ "rstrip": false,
87
+ "normalized": false,
88
+ "special": true
89
+ },
90
+ "128009": {
91
+ "content": "<|eot_id|>",
92
+ "single_word": false,
93
+ "lstrip": false,
94
+ "rstrip": false,
95
+ "normalized": false,
96
+ "special": true
97
+ },
98
+ "128010": {
99
+ "content": "<|python_tag|>",
100
+ "single_word": false,
101
+ "lstrip": false,
102
+ "rstrip": false,
103
+ "normalized": false,
104
+ "special": true
105
+ },
106
+ "128011": {
107
+ "content": "<|im_start|>",
108
+ "single_word": false,
109
+ "lstrip": false,
110
+ "rstrip": false,
111
+ "normalized": false,
112
+ "special": true
113
+ },
114
+ "128012": {
115
+ "content": "<|im_end|>",
116
+ "single_word": false,
117
+ "lstrip": false,
118
+ "rstrip": false,
119
+ "normalized": false,
120
+ "special": true
121
+ },
122
+ "128013": {
123
+ "content": "<tool_response>",
124
+ "single_word": false,
125
+ "lstrip": false,
126
+ "rstrip": false,
127
+ "normalized": false,
128
+ "special": false
129
+ },
130
+ "128014": {
131
+ "content": "</tool_response>",
132
+ "single_word": false,
133
+ "lstrip": false,
134
+ "rstrip": false,
135
+ "normalized": false,
136
+ "special": false
137
+ },
138
+ "128015": {
139
+ "content": "<tool_call>",
140
+ "single_word": false,
141
+ "lstrip": false,
142
+ "rstrip": false,
143
+ "normalized": false,
144
+ "special": false
145
+ },
146
+ "128016": {
147
+ "content": "</tool_call>",
148
+ "single_word": false,
149
+ "lstrip": false,
150
+ "rstrip": false,
151
+ "normalized": false,
152
+ "special": false
153
+ },
154
+ "128017": {
155
+ "content": "<|reserved_special_token_9|>",
156
+ "single_word": false,
157
+ "lstrip": false,
158
+ "rstrip": false,
159
+ "normalized": false,
160
+ "special": true
161
+ },
162
+ "128018": {
163
+ "content": "<|reserved_special_token_10|>",
164
+ "single_word": false,
165
+ "lstrip": false,
166
+ "rstrip": false,
167
+ "normalized": false,
168
+ "special": true
169
+ },
170
+ "128019": {
171
+ "content": "<|reserved_special_token_11|>",
172
+ "single_word": false,
173
+ "lstrip": false,
174
+ "rstrip": false,
175
+ "normalized": false,
176
+ "special": true
177
+ },
178
+ "128020": {
179
+ "content": "<|reserved_special_token_12|>",
180
+ "single_word": false,
181
+ "lstrip": false,
182
+ "rstrip": false,
183
+ "normalized": false,
184
+ "special": true
185
+ },
186
+ "128021": {
187
+ "content": "<|reserved_special_token_13|>",
188
+ "single_word": false,
189
+ "lstrip": false,
190
+ "rstrip": false,
191
+ "normalized": false,
192
+ "special": true
193
+ },
194
+ "128022": {
195
+ "content": "<|reserved_special_token_14|>",
196
+ "single_word": false,
197
+ "lstrip": false,
198
+ "rstrip": false,
199
+ "normalized": false,
200
+ "special": true
201
+ },
202
+ "128023": {
203
+ "content": "<|reserved_special_token_15|>",
204
+ "single_word": false,
205
+ "lstrip": false,
206
+ "rstrip": false,
207
+ "normalized": false,
208
+ "special": true
209
+ },
210
+ "128024": {
211
+ "content": "<|reserved_special_token_16|>",
212
+ "single_word": false,
213
+ "lstrip": false,
214
+ "rstrip": false,
215
+ "normalized": false,
216
+ "special": true
217
+ },
218
+ "128025": {
219
+ "content": "<|reserved_special_token_17|>",
220
+ "single_word": false,
221
+ "lstrip": false,
222
+ "rstrip": false,
223
+ "normalized": false,
224
+ "special": true
225
+ },
226
+ "128026": {
227
+ "content": "<|reserved_special_token_18|>",
228
+ "single_word": false,
229
+ "lstrip": false,
230
+ "rstrip": false,
231
+ "normalized": false,
232
+ "special": true
233
+ },
234
+ "128027": {
235
+ "content": "<|reserved_special_token_19|>",
236
+ "single_word": false,
237
+ "lstrip": false,
238
+ "rstrip": false,
239
+ "normalized": false,
240
+ "special": true
241
+ },
242
+ "128028": {
243
+ "content": "<|reserved_special_token_20|>",
244
+ "single_word": false,
245
+ "lstrip": false,
246
+ "rstrip": false,
247
+ "normalized": false,
248
+ "special": true
249
+ },
250
+ "128029": {
251
+ "content": "<|reserved_special_token_21|>",
252
+ "single_word": false,
253
+ "lstrip": false,
254
+ "rstrip": false,
255
+ "normalized": false,
256
+ "special": true
257
+ },
258
+ "128030": {
259
+ "content": "<|reserved_special_token_22|>",
260
+ "single_word": false,
261
+ "lstrip": false,
262
+ "rstrip": false,
263
+ "normalized": false,
264
+ "special": true
265
+ },
266
+ "128031": {
267
+ "content": "<|reserved_special_token_23|>",
268
+ "single_word": false,
269
+ "lstrip": false,
270
+ "rstrip": false,
271
+ "normalized": false,
272
+ "special": true
273
+ },
274
+ "128032": {
275
+ "content": "<|reserved_special_token_24|>",
276
+ "single_word": false,
277
+ "lstrip": false,
278
+ "rstrip": false,
279
+ "normalized": false,
280
+ "special": true
281
+ },
282
+ "128033": {
283
+ "content": "<|reserved_special_token_25|>",
284
+ "single_word": false,
285
+ "lstrip": false,
286
+ "rstrip": false,
287
+ "normalized": false,
288
+ "special": true
289
+ },
290
+ "128034": {
291
+ "content": "<|reserved_special_token_26|>",
292
+ "single_word": false,
293
+ "lstrip": false,
294
+ "rstrip": false,
295
+ "normalized": false,
296
+ "special": true
297
+ },
298
+ "128035": {
299
+ "content": "<|reserved_special_token_27|>",
300
+ "single_word": false,
301
+ "lstrip": false,
302
+ "rstrip": false,
303
+ "normalized": false,
304
+ "special": true
305
+ },
306
+ "128036": {
307
+ "content": "<|reserved_special_token_28|>",
308
+ "single_word": false,
309
+ "lstrip": false,
310
+ "rstrip": false,
311
+ "normalized": false,
312
+ "special": true
313
+ },
314
+ "128037": {
315
+ "content": "<|reserved_special_token_29|>",
316
+ "single_word": false,
317
+ "lstrip": false,
318
+ "rstrip": false,
319
+ "normalized": false,
320
+ "special": true
321
+ },
322
+ "128038": {
323
+ "content": "<|reserved_special_token_30|>",
324
+ "single_word": false,
325
+ "lstrip": false,
326
+ "rstrip": false,
327
+ "normalized": false,
328
+ "special": true
329
+ },
330
+ "128039": {
331
+ "content": "<|reserved_special_token_31|>",
332
+ "single_word": false,
333
+ "lstrip": false,
334
+ "rstrip": false,
335
+ "normalized": false,
336
+ "special": true
337
+ },
338
+ "128040": {
339
+ "content": "<|reserved_special_token_32|>",
340
+ "single_word": false,
341
+ "lstrip": false,
342
+ "rstrip": false,
343
+ "normalized": false,
344
+ "special": true
345
+ },
346
+ "128041": {
347
+ "content": "<|reserved_special_token_33|>",
348
+ "single_word": false,
349
+ "lstrip": false,
350
+ "rstrip": false,
351
+ "normalized": false,
352
+ "special": true
353
+ },
354
+ "128042": {
355
+ "content": "<|reserved_special_token_34|>",
356
+ "single_word": false,
357
+ "lstrip": false,
358
+ "rstrip": false,
359
+ "normalized": false,
360
+ "special": true
361
+ },
362
+ "128043": {
363
+ "content": "<|reserved_special_token_35|>",
364
+ "single_word": false,
365
+ "lstrip": false,
366
+ "rstrip": false,
367
+ "normalized": false,
368
+ "special": true
369
+ },
370
+ "128044": {
371
+ "content": "<|reserved_special_token_36|>",
372
+ "single_word": false,
373
+ "lstrip": false,
374
+ "rstrip": false,
375
+ "normalized": false,
376
+ "special": true
377
+ },
378
+ "128045": {
379
+ "content": "<|reserved_special_token_37|>",
380
+ "single_word": false,
381
+ "lstrip": false,
382
+ "rstrip": false,
383
+ "normalized": false,
384
+ "special": true
385
+ },
386
+ "128046": {
387
+ "content": "<|reserved_special_token_38|>",
388
+ "single_word": false,
389
+ "lstrip": false,
390
+ "rstrip": false,
391
+ "normalized": false,
392
+ "special": true
393
+ },
394
+ "128047": {
395
+ "content": "<|reserved_special_token_39|>",
396
+ "single_word": false,
397
+ "lstrip": false,
398
+ "rstrip": false,
399
+ "normalized": false,
400
+ "special": true
401
+ },
402
+ "128048": {
403
+ "content": "<|reserved_special_token_40|>",
404
+ "single_word": false,
405
+ "lstrip": false,
406
+ "rstrip": false,
407
+ "normalized": false,
408
+ "special": true
409
+ },
410
+ "128049": {
411
+ "content": "<|reserved_special_token_41|>",
412
+ "single_word": false,
413
+ "lstrip": false,
414
+ "rstrip": false,
415
+ "normalized": false,
416
+ "special": true
417
+ },
418
+ "128050": {
419
+ "content": "<|reserved_special_token_42|>",
420
+ "single_word": false,
421
+ "lstrip": false,
422
+ "rstrip": false,
423
+ "normalized": false,
424
+ "special": true
425
+ },
426
+ "128051": {
427
+ "content": "<|reserved_special_token_43|>",
428
+ "single_word": false,
429
+ "lstrip": false,
430
+ "rstrip": false,
431
+ "normalized": false,
432
+ "special": true
433
+ },
434
+ "128052": {
435
+ "content": "<|reserved_special_token_44|>",
436
+ "single_word": false,
437
+ "lstrip": false,
438
+ "rstrip": false,
439
+ "normalized": false,
440
+ "special": true
441
+ },
442
+ "128053": {
443
+ "content": "<|reserved_special_token_45|>",
444
+ "single_word": false,
445
+ "lstrip": false,
446
+ "rstrip": false,
447
+ "normalized": false,
448
+ "special": true
449
+ },
450
+ "128054": {
451
+ "content": "<|reserved_special_token_46|>",
452
+ "single_word": false,
453
+ "lstrip": false,
454
+ "rstrip": false,
455
+ "normalized": false,
456
+ "special": true
457
+ },
458
+ "128055": {
459
+ "content": "<|reserved_special_token_47|>",
460
+ "single_word": false,
461
+ "lstrip": false,
462
+ "rstrip": false,
463
+ "normalized": false,
464
+ "special": true
465
+ },
466
+ "128056": {
467
+ "content": "<|reserved_special_token_48|>",
468
+ "single_word": false,
469
+ "lstrip": false,
470
+ "rstrip": false,
471
+ "normalized": false,
472
+ "special": true
473
+ },
474
+ "128057": {
475
+ "content": "<|reserved_special_token_49|>",
476
+ "single_word": false,
477
+ "lstrip": false,
478
+ "rstrip": false,
479
+ "normalized": false,
480
+ "special": true
481
+ },
482
+ "128058": {
483
+ "content": "<|reserved_special_token_50|>",
484
+ "single_word": false,
485
+ "lstrip": false,
486
+ "rstrip": false,
487
+ "normalized": false,
488
+ "special": true
489
+ },
490
+ "128059": {
491
+ "content": "<|reserved_special_token_51|>",
492
+ "single_word": false,
493
+ "lstrip": false,
494
+ "rstrip": false,
495
+ "normalized": false,
496
+ "special": true
497
+ },
498
+ "128060": {
499
+ "content": "<|reserved_special_token_52|>",
500
+ "single_word": false,
501
+ "lstrip": false,
502
+ "rstrip": false,
503
+ "normalized": false,
504
+ "special": true
505
+ },
506
+ "128061": {
507
+ "content": "<|reserved_special_token_53|>",
508
+ "single_word": false,
509
+ "lstrip": false,
510
+ "rstrip": false,
511
+ "normalized": false,
512
+ "special": true
513
+ },
514
+ "128062": {
515
+ "content": "<|reserved_special_token_54|>",
516
+ "single_word": false,
517
+ "lstrip": false,
518
+ "rstrip": false,
519
+ "normalized": false,
520
+ "special": true
521
+ },
522
+ "128063": {
523
+ "content": "<|reserved_special_token_55|>",
524
+ "single_word": false,
525
+ "lstrip": false,
526
+ "rstrip": false,
527
+ "normalized": false,
528
+ "special": true
529
+ },
530
+ "128064": {
531
+ "content": "<|reserved_special_token_56|>",
532
+ "single_word": false,
533
+ "lstrip": false,
534
+ "rstrip": false,
535
+ "normalized": false,
536
+ "special": true
537
+ },
538
+ "128065": {
539
+ "content": "<|reserved_special_token_57|>",
540
+ "single_word": false,
541
+ "lstrip": false,
542
+ "rstrip": false,
543
+ "normalized": false,
544
+ "special": true
545
+ },
546
+ "128066": {
547
+ "content": "<|reserved_special_token_58|>",
548
+ "single_word": false,
549
+ "lstrip": false,
550
+ "rstrip": false,
551
+ "normalized": false,
552
+ "special": true
553
+ },
554
+ "128067": {
555
+ "content": "<|reserved_special_token_59|>",
556
+ "single_word": false,
557
+ "lstrip": false,
558
+ "rstrip": false,
559
+ "normalized": false,
560
+ "special": true
561
+ },
562
+ "128068": {
563
+ "content": "<|reserved_special_token_60|>",
564
+ "single_word": false,
565
+ "lstrip": false,
566
+ "rstrip": false,
567
+ "normalized": false,
568
+ "special": true
569
+ },
570
+ "128069": {
571
+ "content": "<|reserved_special_token_61|>",
572
+ "single_word": false,
573
+ "lstrip": false,
574
+ "rstrip": false,
575
+ "normalized": false,
576
+ "special": true
577
+ },
578
+ "128070": {
579
+ "content": "<|reserved_special_token_62|>",
580
+ "single_word": false,
581
+ "lstrip": false,
582
+ "rstrip": false,
583
+ "normalized": false,
584
+ "special": true
585
+ },
586
+ "128071": {
587
+ "content": "<|reserved_special_token_63|>",
588
+ "single_word": false,
589
+ "lstrip": false,
590
+ "rstrip": false,
591
+ "normalized": false,
592
+ "special": true
593
+ },
594
+ "128072": {
595
+ "content": "<|reserved_special_token_64|>",
596
+ "single_word": false,
597
+ "lstrip": false,
598
+ "rstrip": false,
599
+ "normalized": false,
600
+ "special": true
601
+ },
602
+ "128073": {
603
+ "content": "<|reserved_special_token_65|>",
604
+ "single_word": false,
605
+ "lstrip": false,
606
+ "rstrip": false,
607
+ "normalized": false,
608
+ "special": true
609
+ },
610
+ "128074": {
611
+ "content": "<|reserved_special_token_66|>",
612
+ "single_word": false,
613
+ "lstrip": false,
614
+ "rstrip": false,
615
+ "normalized": false,
616
+ "special": true
617
+ },
618
+ "128075": {
619
+ "content": "<|reserved_special_token_67|>",
620
+ "single_word": false,
621
+ "lstrip": false,
622
+ "rstrip": false,
623
+ "normalized": false,
624
+ "special": true
625
+ },
626
+ "128076": {
627
+ "content": "<|reserved_special_token_68|>",
628
+ "single_word": false,
629
+ "lstrip": false,
630
+ "rstrip": false,
631
+ "normalized": false,
632
+ "special": true
633
+ },
634
+ "128077": {
635
+ "content": "<|reserved_special_token_69|>",
636
+ "single_word": false,
637
+ "lstrip": false,
638
+ "rstrip": false,
639
+ "normalized": false,
640
+ "special": true
641
+ },
642
+ "128078": {
643
+ "content": "<|reserved_special_token_70|>",
644
+ "single_word": false,
645
+ "lstrip": false,
646
+ "rstrip": false,
647
+ "normalized": false,
648
+ "special": true
649
+ },
650
+ "128079": {
651
+ "content": "<|reserved_special_token_71|>",
652
+ "single_word": false,
653
+ "lstrip": false,
654
+ "rstrip": false,
655
+ "normalized": false,
656
+ "special": true
657
+ },
658
+ "128080": {
659
+ "content": "<|reserved_special_token_72|>",
660
+ "single_word": false,
661
+ "lstrip": false,
662
+ "rstrip": false,
663
+ "normalized": false,
664
+ "special": true
665
+ },
666
+ "128081": {
667
+ "content": "<|reserved_special_token_73|>",
668
+ "single_word": false,
669
+ "lstrip": false,
670
+ "rstrip": false,
671
+ "normalized": false,
672
+ "special": true
673
+ },
674
+ "128082": {
675
+ "content": "<|reserved_special_token_74|>",
676
+ "single_word": false,
677
+ "lstrip": false,
678
+ "rstrip": false,
679
+ "normalized": false,
680
+ "special": true
681
+ },
682
+ "128083": {
683
+ "content": "<|reserved_special_token_75|>",
684
+ "single_word": false,
685
+ "lstrip": false,
686
+ "rstrip": false,
687
+ "normalized": false,
688
+ "special": true
689
+ },
690
+ "128084": {
691
+ "content": "<|reserved_special_token_76|>",
692
+ "single_word": false,
693
+ "lstrip": false,
694
+ "rstrip": false,
695
+ "normalized": false,
696
+ "special": true
697
+ },
698
+ "128085": {
699
+ "content": "<|reserved_special_token_77|>",
700
+ "single_word": false,
701
+ "lstrip": false,
702
+ "rstrip": false,
703
+ "normalized": false,
704
+ "special": true
705
+ },
706
+ "128086": {
707
+ "content": "<|reserved_special_token_78|>",
708
+ "single_word": false,
709
+ "lstrip": false,
710
+ "rstrip": false,
711
+ "normalized": false,
712
+ "special": true
713
+ },
714
+ "128087": {
715
+ "content": "<|reserved_special_token_79|>",
716
+ "single_word": false,
717
+ "lstrip": false,
718
+ "rstrip": false,
719
+ "normalized": false,
720
+ "special": true
721
+ },
722
+ "128088": {
723
+ "content": "<|reserved_special_token_80|>",
724
+ "single_word": false,
725
+ "lstrip": false,
726
+ "rstrip": false,
727
+ "normalized": false,
728
+ "special": true
729
+ },
730
+ "128089": {
731
+ "content": "<|reserved_special_token_81|>",
732
+ "single_word": false,
733
+ "lstrip": false,
734
+ "rstrip": false,
735
+ "normalized": false,
736
+ "special": true
737
+ },
738
+ "128090": {
739
+ "content": "<|reserved_special_token_82|>",
740
+ "single_word": false,
741
+ "lstrip": false,
742
+ "rstrip": false,
743
+ "normalized": false,
744
+ "special": true
745
+ },
746
+ "128091": {
747
+ "content": "<|reserved_special_token_83|>",
748
+ "single_word": false,
749
+ "lstrip": false,
750
+ "rstrip": false,
751
+ "normalized": false,
752
+ "special": true
753
+ },
754
+ "128092": {
755
+ "content": "<|reserved_special_token_84|>",
756
+ "single_word": false,
757
+ "lstrip": false,
758
+ "rstrip": false,
759
+ "normalized": false,
760
+ "special": true
761
+ },
762
+ "128093": {
763
+ "content": "<|reserved_special_token_85|>",
764
+ "single_word": false,
765
+ "lstrip": false,
766
+ "rstrip": false,
767
+ "normalized": false,
768
+ "special": true
769
+ },
770
+ "128094": {
771
+ "content": "<|reserved_special_token_86|>",
772
+ "single_word": false,
773
+ "lstrip": false,
774
+ "rstrip": false,
775
+ "normalized": false,
776
+ "special": true
777
+ },
778
+ "128095": {
779
+ "content": "<|reserved_special_token_87|>",
780
+ "single_word": false,
781
+ "lstrip": false,
782
+ "rstrip": false,
783
+ "normalized": false,
784
+ "special": true
785
+ },
786
+ "128096": {
787
+ "content": "<|reserved_special_token_88|>",
788
+ "single_word": false,
789
+ "lstrip": false,
790
+ "rstrip": false,
791
+ "normalized": false,
792
+ "special": true
793
+ },
794
+ "128097": {
795
+ "content": "<|reserved_special_token_89|>",
796
+ "single_word": false,
797
+ "lstrip": false,
798
+ "rstrip": false,
799
+ "normalized": false,
800
+ "special": true
801
+ },
802
+ "128098": {
803
+ "content": "<|reserved_special_token_90|>",
804
+ "single_word": false,
805
+ "lstrip": false,
806
+ "rstrip": false,
807
+ "normalized": false,
808
+ "special": true
809
+ },
810
+ "128099": {
811
+ "content": "<|reserved_special_token_91|>",
812
+ "single_word": false,
813
+ "lstrip": false,
814
+ "rstrip": false,
815
+ "normalized": false,
816
+ "special": true
817
+ },
818
+ "128100": {
819
+ "content": "<|reserved_special_token_92|>",
820
+ "single_word": false,
821
+ "lstrip": false,
822
+ "rstrip": false,
823
+ "normalized": false,
824
+ "special": true
825
+ },
826
+ "128101": {
827
+ "content": "<|reserved_special_token_93|>",
828
+ "single_word": false,
829
+ "lstrip": false,
830
+ "rstrip": false,
831
+ "normalized": false,
832
+ "special": true
833
+ },
834
+ "128102": {
835
+ "content": "<|reserved_special_token_94|>",
836
+ "single_word": false,
837
+ "lstrip": false,
838
+ "rstrip": false,
839
+ "normalized": false,
840
+ "special": true
841
+ },
842
+ "128103": {
843
+ "content": "<|reserved_special_token_95|>",
844
+ "single_word": false,
845
+ "lstrip": false,
846
+ "rstrip": false,
847
+ "normalized": false,
848
+ "special": true
849
+ },
850
+ "128104": {
851
+ "content": "<|reserved_special_token_96|>",
852
+ "single_word": false,
853
+ "lstrip": false,
854
+ "rstrip": false,
855
+ "normalized": false,
856
+ "special": true
857
+ },
858
+ "128105": {
859
+ "content": "<|reserved_special_token_97|>",
860
+ "single_word": false,
861
+ "lstrip": false,
862
+ "rstrip": false,
863
+ "normalized": false,
864
+ "special": true
865
+ },
866
+ "128106": {
867
+ "content": "<|reserved_special_token_98|>",
868
+ "single_word": false,
869
+ "lstrip": false,
870
+ "rstrip": false,
871
+ "normalized": false,
872
+ "special": true
873
+ },
874
+ "128107": {
875
+ "content": "<|reserved_special_token_99|>",
876
+ "single_word": false,
877
+ "lstrip": false,
878
+ "rstrip": false,
879
+ "normalized": false,
880
+ "special": true
881
+ },
882
+ "128108": {
883
+ "content": "<|reserved_special_token_100|>",
884
+ "single_word": false,
885
+ "lstrip": false,
886
+ "rstrip": false,
887
+ "normalized": false,
888
+ "special": true
889
+ },
890
+ "128109": {
891
+ "content": "<|reserved_special_token_101|>",
892
+ "single_word": false,
893
+ "lstrip": false,
894
+ "rstrip": false,
895
+ "normalized": false,
896
+ "special": true
897
+ },
898
+ "128110": {
899
+ "content": "<|reserved_special_token_102|>",
900
+ "single_word": false,
901
+ "lstrip": false,
902
+ "rstrip": false,
903
+ "normalized": false,
904
+ "special": true
905
+ },
906
+ "128111": {
907
+ "content": "<|reserved_special_token_103|>",
908
+ "single_word": false,
909
+ "lstrip": false,
910
+ "rstrip": false,
911
+ "normalized": false,
912
+ "special": true
913
+ },
914
+ "128112": {
915
+ "content": "<|reserved_special_token_104|>",
916
+ "single_word": false,
917
+ "lstrip": false,
918
+ "rstrip": false,
919
+ "normalized": false,
920
+ "special": true
921
+ },
922
+ "128113": {
923
+ "content": "<|reserved_special_token_105|>",
924
+ "single_word": false,
925
+ "lstrip": false,
926
+ "rstrip": false,
927
+ "normalized": false,
928
+ "special": true
929
+ },
930
+ "128114": {
931
+ "content": "<|reserved_special_token_106|>",
932
+ "single_word": false,
933
+ "lstrip": false,
934
+ "rstrip": false,
935
+ "normalized": false,
936
+ "special": true
937
+ },
938
+ "128115": {
939
+ "content": "<|reserved_special_token_107|>",
940
+ "single_word": false,
941
+ "lstrip": false,
942
+ "rstrip": false,
943
+ "normalized": false,
944
+ "special": true
945
+ },
946
+ "128116": {
947
+ "content": "<|reserved_special_token_108|>",
948
+ "single_word": false,
949
+ "lstrip": false,
950
+ "rstrip": false,
951
+ "normalized": false,
952
+ "special": true
953
+ },
954
+ "128117": {
955
+ "content": "<|reserved_special_token_109|>",
956
+ "single_word": false,
957
+ "lstrip": false,
958
+ "rstrip": false,
959
+ "normalized": false,
960
+ "special": true
961
+ },
962
+ "128118": {
963
+ "content": "<|reserved_special_token_110|>",
964
+ "single_word": false,
965
+ "lstrip": false,
966
+ "rstrip": false,
967
+ "normalized": false,
968
+ "special": true
969
+ },
970
+ "128119": {
971
+ "content": "<|reserved_special_token_111|>",
972
+ "single_word": false,
973
+ "lstrip": false,
974
+ "rstrip": false,
975
+ "normalized": false,
976
+ "special": true
977
+ },
978
+ "128120": {
979
+ "content": "<|reserved_special_token_112|>",
980
+ "single_word": false,
981
+ "lstrip": false,
982
+ "rstrip": false,
983
+ "normalized": false,
984
+ "special": true
985
+ },
986
+ "128121": {
987
+ "content": "<|reserved_special_token_113|>",
988
+ "single_word": false,
989
+ "lstrip": false,
990
+ "rstrip": false,
991
+ "normalized": false,
992
+ "special": true
993
+ },
994
+ "128122": {
995
+ "content": "<|reserved_special_token_114|>",
996
+ "single_word": false,
997
+ "lstrip": false,
998
+ "rstrip": false,
999
+ "normalized": false,
1000
+ "special": true
1001
+ },
1002
+ "128123": {
1003
+ "content": "<|reserved_special_token_115|>",
1004
+ "single_word": false,
1005
+ "lstrip": false,
1006
+ "rstrip": false,
1007
+ "normalized": false,
1008
+ "special": true
1009
+ },
1010
+ "128124": {
1011
+ "content": "<|reserved_special_token_116|>",
1012
+ "single_word": false,
1013
+ "lstrip": false,
1014
+ "rstrip": false,
1015
+ "normalized": false,
1016
+ "special": true
1017
+ },
1018
+ "128125": {
1019
+ "content": "<|reserved_special_token_117|>",
1020
+ "single_word": false,
1021
+ "lstrip": false,
1022
+ "rstrip": false,
1023
+ "normalized": false,
1024
+ "special": true
1025
+ },
1026
+ "128126": {
1027
+ "content": "<|reserved_special_token_118|>",
1028
+ "single_word": false,
1029
+ "lstrip": false,
1030
+ "rstrip": false,
1031
+ "normalized": false,
1032
+ "special": true
1033
+ },
1034
+ "128127": {
1035
+ "content": "<|reserved_special_token_119|>",
1036
+ "single_word": false,
1037
+ "lstrip": false,
1038
+ "rstrip": false,
1039
+ "normalized": false,
1040
+ "special": true
1041
+ },
1042
+ "128128": {
1043
+ "content": "<|reserved_special_token_120|>",
1044
+ "single_word": false,
1045
+ "lstrip": false,
1046
+ "rstrip": false,
1047
+ "normalized": false,
1048
+ "special": true
1049
+ },
1050
+ "128129": {
1051
+ "content": "<|reserved_special_token_121|>",
1052
+ "single_word": false,
1053
+ "lstrip": false,
1054
+ "rstrip": false,
1055
+ "normalized": false,
1056
+ "special": true
1057
+ },
1058
+ "128130": {
1059
+ "content": "<|reserved_special_token_122|>",
1060
+ "single_word": false,
1061
+ "lstrip": false,
1062
+ "rstrip": false,
1063
+ "normalized": false,
1064
+ "special": true
1065
+ },
1066
+ "128131": {
1067
+ "content": "<|reserved_special_token_123|>",
1068
+ "single_word": false,
1069
+ "lstrip": false,
1070
+ "rstrip": false,
1071
+ "normalized": false,
1072
+ "special": true
1073
+ },
1074
+ "128132": {
1075
+ "content": "<|reserved_special_token_124|>",
1076
+ "single_word": false,
1077
+ "lstrip": false,
1078
+ "rstrip": false,
1079
+ "normalized": false,
1080
+ "special": true
1081
+ },
1082
+ "128133": {
1083
+ "content": "<|reserved_special_token_125|>",
1084
+ "single_word": false,
1085
+ "lstrip": false,
1086
+ "rstrip": false,
1087
+ "normalized": false,
1088
+ "special": true
1089
+ },
1090
+ "128134": {
1091
+ "content": "<|reserved_special_token_126|>",
1092
+ "single_word": false,
1093
+ "lstrip": false,
1094
+ "rstrip": false,
1095
+ "normalized": false,
1096
+ "special": true
1097
+ },
1098
+ "128135": {
1099
+ "content": "<|reserved_special_token_127|>",
1100
+ "single_word": false,
1101
+ "lstrip": false,
1102
+ "rstrip": false,
1103
+ "normalized": false,
1104
+ "special": true
1105
+ },
1106
+ "128136": {
1107
+ "content": "<|reserved_special_token_128|>",
1108
+ "single_word": false,
1109
+ "lstrip": false,
1110
+ "rstrip": false,
1111
+ "normalized": false,
1112
+ "special": true
1113
+ },
1114
+ "128137": {
1115
+ "content": "<|reserved_special_token_129|>",
1116
+ "single_word": false,
1117
+ "lstrip": false,
1118
+ "rstrip": false,
1119
+ "normalized": false,
1120
+ "special": true
1121
+ },
1122
+ "128138": {
1123
+ "content": "<|reserved_special_token_130|>",
1124
+ "single_word": false,
1125
+ "lstrip": false,
1126
+ "rstrip": false,
1127
+ "normalized": false,
1128
+ "special": true
1129
+ },
1130
+ "128139": {
1131
+ "content": "<|reserved_special_token_131|>",
1132
+ "single_word": false,
1133
+ "lstrip": false,
1134
+ "rstrip": false,
1135
+ "normalized": false,
1136
+ "special": true
1137
+ },
1138
+ "128140": {
1139
+ "content": "<|reserved_special_token_132|>",
1140
+ "single_word": false,
1141
+ "lstrip": false,
1142
+ "rstrip": false,
1143
+ "normalized": false,
1144
+ "special": true
1145
+ },
1146
+ "128141": {
1147
+ "content": "<|reserved_special_token_133|>",
1148
+ "single_word": false,
1149
+ "lstrip": false,
1150
+ "rstrip": false,
1151
+ "normalized": false,
1152
+ "special": true
1153
+ },
1154
+ "128142": {
1155
+ "content": "<|reserved_special_token_134|>",
1156
+ "single_word": false,
1157
+ "lstrip": false,
1158
+ "rstrip": false,
1159
+ "normalized": false,
1160
+ "special": true
1161
+ },
1162
+ "128143": {
1163
+ "content": "<|reserved_special_token_135|>",
1164
+ "single_word": false,
1165
+ "lstrip": false,
1166
+ "rstrip": false,
1167
+ "normalized": false,
1168
+ "special": true
1169
+ },
1170
+ "128144": {
1171
+ "content": "<|reserved_special_token_136|>",
1172
+ "single_word": false,
1173
+ "lstrip": false,
1174
+ "rstrip": false,
1175
+ "normalized": false,
1176
+ "special": true
1177
+ },
1178
+ "128145": {
1179
+ "content": "<|reserved_special_token_137|>",
1180
+ "single_word": false,
1181
+ "lstrip": false,
1182
+ "rstrip": false,
1183
+ "normalized": false,
1184
+ "special": true
1185
+ },
1186
+ "128146": {
1187
+ "content": "<|reserved_special_token_138|>",
1188
+ "single_word": false,
1189
+ "lstrip": false,
1190
+ "rstrip": false,
1191
+ "normalized": false,
1192
+ "special": true
1193
+ },
1194
+ "128147": {
1195
+ "content": "<|reserved_special_token_139|>",
1196
+ "single_word": false,
1197
+ "lstrip": false,
1198
+ "rstrip": false,
1199
+ "normalized": false,
1200
+ "special": true
1201
+ },
1202
+ "128148": {
1203
+ "content": "<|reserved_special_token_140|>",
1204
+ "single_word": false,
1205
+ "lstrip": false,
1206
+ "rstrip": false,
1207
+ "normalized": false,
1208
+ "special": true
1209
+ },
1210
+ "128149": {
1211
+ "content": "<|reserved_special_token_141|>",
1212
+ "single_word": false,
1213
+ "lstrip": false,
1214
+ "rstrip": false,
1215
+ "normalized": false,
1216
+ "special": true
1217
+ },
1218
+ "128150": {
1219
+ "content": "<|reserved_special_token_142|>",
1220
+ "single_word": false,
1221
+ "lstrip": false,
1222
+ "rstrip": false,
1223
+ "normalized": false,
1224
+ "special": true
1225
+ },
1226
+ "128151": {
1227
+ "content": "<|reserved_special_token_143|>",
1228
+ "single_word": false,
1229
+ "lstrip": false,
1230
+ "rstrip": false,
1231
+ "normalized": false,
1232
+ "special": true
1233
+ },
1234
+ "128152": {
1235
+ "content": "<|reserved_special_token_144|>",
1236
+ "single_word": false,
1237
+ "lstrip": false,
1238
+ "rstrip": false,
1239
+ "normalized": false,
1240
+ "special": true
1241
+ },
1242
+ "128153": {
1243
+ "content": "<|reserved_special_token_145|>",
1244
+ "single_word": false,
1245
+ "lstrip": false,
1246
+ "rstrip": false,
1247
+ "normalized": false,
1248
+ "special": true
1249
+ },
1250
+ "128154": {
1251
+ "content": "<|reserved_special_token_146|>",
1252
+ "single_word": false,
1253
+ "lstrip": false,
1254
+ "rstrip": false,
1255
+ "normalized": false,
1256
+ "special": true
1257
+ },
1258
+ "128155": {
1259
+ "content": "<|reserved_special_token_147|>",
1260
+ "single_word": false,
1261
+ "lstrip": false,
1262
+ "rstrip": false,
1263
+ "normalized": false,
1264
+ "special": true
1265
+ },
1266
+ "128156": {
1267
+ "content": "<|reserved_special_token_148|>",
1268
+ "single_word": false,
1269
+ "lstrip": false,
1270
+ "rstrip": false,
1271
+ "normalized": false,
1272
+ "special": true
1273
+ },
1274
+ "128157": {
1275
+ "content": "<|reserved_special_token_149|>",
1276
+ "single_word": false,
1277
+ "lstrip": false,
1278
+ "rstrip": false,
1279
+ "normalized": false,
1280
+ "special": true
1281
+ },
1282
+ "128158": {
1283
+ "content": "<|reserved_special_token_150|>",
1284
+ "single_word": false,
1285
+ "lstrip": false,
1286
+ "rstrip": false,
1287
+ "normalized": false,
1288
+ "special": true
1289
+ },
1290
+ "128159": {
1291
+ "content": "<|reserved_special_token_151|>",
1292
+ "single_word": false,
1293
+ "lstrip": false,
1294
+ "rstrip": false,
1295
+ "normalized": false,
1296
+ "special": true
1297
+ },
1298
+ "128160": {
1299
+ "content": "<|reserved_special_token_152|>",
1300
+ "single_word": false,
1301
+ "lstrip": false,
1302
+ "rstrip": false,
1303
+ "normalized": false,
1304
+ "special": true
1305
+ },
1306
+ "128161": {
1307
+ "content": "<|reserved_special_token_153|>",
1308
+ "single_word": false,
1309
+ "lstrip": false,
1310
+ "rstrip": false,
1311
+ "normalized": false,
1312
+ "special": true
1313
+ },
1314
+ "128162": {
1315
+ "content": "<|reserved_special_token_154|>",
1316
+ "single_word": false,
1317
+ "lstrip": false,
1318
+ "rstrip": false,
1319
+ "normalized": false,
1320
+ "special": true
1321
+ },
1322
+ "128163": {
1323
+ "content": "<|reserved_special_token_155|>",
1324
+ "single_word": false,
1325
+ "lstrip": false,
1326
+ "rstrip": false,
1327
+ "normalized": false,
1328
+ "special": true
1329
+ },
1330
+ "128164": {
1331
+ "content": "<|reserved_special_token_156|>",
1332
+ "single_word": false,
1333
+ "lstrip": false,
1334
+ "rstrip": false,
1335
+ "normalized": false,
1336
+ "special": true
1337
+ },
1338
+ "128165": {
1339
+ "content": "<|reserved_special_token_157|>",
1340
+ "single_word": false,
1341
+ "lstrip": false,
1342
+ "rstrip": false,
1343
+ "normalized": false,
1344
+ "special": true
1345
+ },
1346
+ "128166": {
1347
+ "content": "<|reserved_special_token_158|>",
1348
+ "single_word": false,
1349
+ "lstrip": false,
1350
+ "rstrip": false,
1351
+ "normalized": false,
1352
+ "special": true
1353
+ },
1354
+ "128167": {
1355
+ "content": "<|reserved_special_token_159|>",
1356
+ "single_word": false,
1357
+ "lstrip": false,
1358
+ "rstrip": false,
1359
+ "normalized": false,
1360
+ "special": true
1361
+ },
1362
+ "128168": {
1363
+ "content": "<|reserved_special_token_160|>",
1364
+ "single_word": false,
1365
+ "lstrip": false,
1366
+ "rstrip": false,
1367
+ "normalized": false,
1368
+ "special": true
1369
+ },
1370
+ "128169": {
1371
+ "content": "<|reserved_special_token_161|>",
1372
+ "single_word": false,
1373
+ "lstrip": false,
1374
+ "rstrip": false,
1375
+ "normalized": false,
1376
+ "special": true
1377
+ },
1378
+ "128170": {
1379
+ "content": "<|reserved_special_token_162|>",
1380
+ "single_word": false,
1381
+ "lstrip": false,
1382
+ "rstrip": false,
1383
+ "normalized": false,
1384
+ "special": true
1385
+ },
1386
+ "128171": {
1387
+ "content": "<|reserved_special_token_163|>",
1388
+ "single_word": false,
1389
+ "lstrip": false,
1390
+ "rstrip": false,
1391
+ "normalized": false,
1392
+ "special": true
1393
+ },
1394
+ "128172": {
1395
+ "content": "<|reserved_special_token_164|>",
1396
+ "single_word": false,
1397
+ "lstrip": false,
1398
+ "rstrip": false,
1399
+ "normalized": false,
1400
+ "special": true
1401
+ },
1402
+ "128173": {
1403
+ "content": "<|reserved_special_token_165|>",
1404
+ "single_word": false,
1405
+ "lstrip": false,
1406
+ "rstrip": false,
1407
+ "normalized": false,
1408
+ "special": true
1409
+ },
1410
+ "128174": {
1411
+ "content": "<|reserved_special_token_166|>",
1412
+ "single_word": false,
1413
+ "lstrip": false,
1414
+ "rstrip": false,
1415
+ "normalized": false,
1416
+ "special": true
1417
+ },
1418
+ "128175": {
1419
+ "content": "<|reserved_special_token_167|>",
1420
+ "single_word": false,
1421
+ "lstrip": false,
1422
+ "rstrip": false,
1423
+ "normalized": false,
1424
+ "special": true
1425
+ },
1426
+ "128176": {
1427
+ "content": "<|reserved_special_token_168|>",
1428
+ "single_word": false,
1429
+ "lstrip": false,
1430
+ "rstrip": false,
1431
+ "normalized": false,
1432
+ "special": true
1433
+ },
1434
+ "128177": {
1435
+ "content": "<|reserved_special_token_169|>",
1436
+ "single_word": false,
1437
+ "lstrip": false,
1438
+ "rstrip": false,
1439
+ "normalized": false,
1440
+ "special": true
1441
+ },
1442
+ "128178": {
1443
+ "content": "<|reserved_special_token_170|>",
1444
+ "single_word": false,
1445
+ "lstrip": false,
1446
+ "rstrip": false,
1447
+ "normalized": false,
1448
+ "special": true
1449
+ },
1450
+ "128179": {
1451
+ "content": "<|reserved_special_token_171|>",
1452
+ "single_word": false,
1453
+ "lstrip": false,
1454
+ "rstrip": false,
1455
+ "normalized": false,
1456
+ "special": true
1457
+ },
1458
+ "128180": {
1459
+ "content": "<|reserved_special_token_172|>",
1460
+ "single_word": false,
1461
+ "lstrip": false,
1462
+ "rstrip": false,
1463
+ "normalized": false,
1464
+ "special": true
1465
+ },
1466
+ "128181": {
1467
+ "content": "<|reserved_special_token_173|>",
1468
+ "single_word": false,
1469
+ "lstrip": false,
1470
+ "rstrip": false,
1471
+ "normalized": false,
1472
+ "special": true
1473
+ },
1474
+ "128182": {
1475
+ "content": "<|reserved_special_token_174|>",
1476
+ "single_word": false,
1477
+ "lstrip": false,
1478
+ "rstrip": false,
1479
+ "normalized": false,
1480
+ "special": true
1481
+ },
1482
+ "128183": {
1483
+ "content": "<|reserved_special_token_175|>",
1484
+ "single_word": false,
1485
+ "lstrip": false,
1486
+ "rstrip": false,
1487
+ "normalized": false,
1488
+ "special": true
1489
+ },
1490
+ "128184": {
1491
+ "content": "<|reserved_special_token_176|>",
1492
+ "single_word": false,
1493
+ "lstrip": false,
1494
+ "rstrip": false,
1495
+ "normalized": false,
1496
+ "special": true
1497
+ },
1498
+ "128185": {
1499
+ "content": "<|reserved_special_token_177|>",
1500
+ "single_word": false,
1501
+ "lstrip": false,
1502
+ "rstrip": false,
1503
+ "normalized": false,
1504
+ "special": true
1505
+ },
1506
+ "128186": {
1507
+ "content": "<|reserved_special_token_178|>",
1508
+ "single_word": false,
1509
+ "lstrip": false,
1510
+ "rstrip": false,
1511
+ "normalized": false,
1512
+ "special": true
1513
+ },
1514
+ "128187": {
1515
+ "content": "<|reserved_special_token_179|>",
1516
+ "single_word": false,
1517
+ "lstrip": false,
1518
+ "rstrip": false,
1519
+ "normalized": false,
1520
+ "special": true
1521
+ },
1522
+ "128188": {
1523
+ "content": "<|reserved_special_token_180|>",
1524
+ "single_word": false,
1525
+ "lstrip": false,
1526
+ "rstrip": false,
1527
+ "normalized": false,
1528
+ "special": true
1529
+ },
1530
+ "128189": {
1531
+ "content": "<|reserved_special_token_181|>",
1532
+ "single_word": false,
1533
+ "lstrip": false,
1534
+ "rstrip": false,
1535
+ "normalized": false,
1536
+ "special": true
1537
+ },
1538
+ "128190": {
1539
+ "content": "<|reserved_special_token_182|>",
1540
+ "single_word": false,
1541
+ "lstrip": false,
1542
+ "rstrip": false,
1543
+ "normalized": false,
1544
+ "special": true
1545
+ },
1546
+ "128191": {
1547
+ "content": "<|reserved_special_token_183|>",
1548
+ "single_word": false,
1549
+ "lstrip": false,
1550
+ "rstrip": false,
1551
+ "normalized": false,
1552
+ "special": true
1553
+ },
1554
+ "128192": {
1555
+ "content": "<|reserved_special_token_184|>",
1556
+ "single_word": false,
1557
+ "lstrip": false,
1558
+ "rstrip": false,
1559
+ "normalized": false,
1560
+ "special": true
1561
+ },
1562
+ "128193": {
1563
+ "content": "<|reserved_special_token_185|>",
1564
+ "single_word": false,
1565
+ "lstrip": false,
1566
+ "rstrip": false,
1567
+ "normalized": false,
1568
+ "special": true
1569
+ },
1570
+ "128194": {
1571
+ "content": "<|reserved_special_token_186|>",
1572
+ "single_word": false,
1573
+ "lstrip": false,
1574
+ "rstrip": false,
1575
+ "normalized": false,
1576
+ "special": true
1577
+ },
1578
+ "128195": {
1579
+ "content": "<|reserved_special_token_187|>",
1580
+ "single_word": false,
1581
+ "lstrip": false,
1582
+ "rstrip": false,
1583
+ "normalized": false,
1584
+ "special": true
1585
+ },
1586
+ "128196": {
1587
+ "content": "<|reserved_special_token_188|>",
1588
+ "single_word": false,
1589
+ "lstrip": false,
1590
+ "rstrip": false,
1591
+ "normalized": false,
1592
+ "special": true
1593
+ },
1594
+ "128197": {
1595
+ "content": "<|reserved_special_token_189|>",
1596
+ "single_word": false,
1597
+ "lstrip": false,
1598
+ "rstrip": false,
1599
+ "normalized": false,
1600
+ "special": true
1601
+ },
1602
+ "128198": {
1603
+ "content": "<|reserved_special_token_190|>",
1604
+ "single_word": false,
1605
+ "lstrip": false,
1606
+ "rstrip": false,
1607
+ "normalized": false,
1608
+ "special": true
1609
+ },
1610
+ "128199": {
1611
+ "content": "<|reserved_special_token_191|>",
1612
+ "single_word": false,
1613
+ "lstrip": false,
1614
+ "rstrip": false,
1615
+ "normalized": false,
1616
+ "special": true
1617
+ },
1618
+ "128200": {
1619
+ "content": "<|reserved_special_token_192|>",
1620
+ "single_word": false,
1621
+ "lstrip": false,
1622
+ "rstrip": false,
1623
+ "normalized": false,
1624
+ "special": true
1625
+ },
1626
+ "128201": {
1627
+ "content": "<|reserved_special_token_193|>",
1628
+ "single_word": false,
1629
+ "lstrip": false,
1630
+ "rstrip": false,
1631
+ "normalized": false,
1632
+ "special": true
1633
+ },
1634
+ "128202": {
1635
+ "content": "<|reserved_special_token_194|>",
1636
+ "single_word": false,
1637
+ "lstrip": false,
1638
+ "rstrip": false,
1639
+ "normalized": false,
1640
+ "special": true
1641
+ },
1642
+ "128203": {
1643
+ "content": "<|reserved_special_token_195|>",
1644
+ "single_word": false,
1645
+ "lstrip": false,
1646
+ "rstrip": false,
1647
+ "normalized": false,
1648
+ "special": true
1649
+ },
1650
+ "128204": {
1651
+ "content": "<|reserved_special_token_196|>",
1652
+ "single_word": false,
1653
+ "lstrip": false,
1654
+ "rstrip": false,
1655
+ "normalized": false,
1656
+ "special": true
1657
+ },
1658
+ "128205": {
1659
+ "content": "<|reserved_special_token_197|>",
1660
+ "single_word": false,
1661
+ "lstrip": false,
1662
+ "rstrip": false,
1663
+ "normalized": false,
1664
+ "special": true
1665
+ },
1666
+ "128206": {
1667
+ "content": "<|reserved_special_token_198|>",
1668
+ "single_word": false,
1669
+ "lstrip": false,
1670
+ "rstrip": false,
1671
+ "normalized": false,
1672
+ "special": true
1673
+ },
1674
+ "128207": {
1675
+ "content": "<|reserved_special_token_199|>",
1676
+ "single_word": false,
1677
+ "lstrip": false,
1678
+ "rstrip": false,
1679
+ "normalized": false,
1680
+ "special": true
1681
+ },
1682
+ "128208": {
1683
+ "content": "<|reserved_special_token_200|>",
1684
+ "single_word": false,
1685
+ "lstrip": false,
1686
+ "rstrip": false,
1687
+ "normalized": false,
1688
+ "special": true
1689
+ },
1690
+ "128209": {
1691
+ "content": "<|reserved_special_token_201|>",
1692
+ "single_word": false,
1693
+ "lstrip": false,
1694
+ "rstrip": false,
1695
+ "normalized": false,
1696
+ "special": true
1697
+ },
1698
+ "128210": {
1699
+ "content": "<|reserved_special_token_202|>",
1700
+ "single_word": false,
1701
+ "lstrip": false,
1702
+ "rstrip": false,
1703
+ "normalized": false,
1704
+ "special": true
1705
+ },
1706
+ "128211": {
1707
+ "content": "<|reserved_special_token_203|>",
1708
+ "single_word": false,
1709
+ "lstrip": false,
1710
+ "rstrip": false,
1711
+ "normalized": false,
1712
+ "special": true
1713
+ },
1714
+ "128212": {
1715
+ "content": "<|reserved_special_token_204|>",
1716
+ "single_word": false,
1717
+ "lstrip": false,
1718
+ "rstrip": false,
1719
+ "normalized": false,
1720
+ "special": true
1721
+ },
1722
+ "128213": {
1723
+ "content": "<|reserved_special_token_205|>",
1724
+ "single_word": false,
1725
+ "lstrip": false,
1726
+ "rstrip": false,
1727
+ "normalized": false,
1728
+ "special": true
1729
+ },
1730
+ "128214": {
1731
+ "content": "<|reserved_special_token_206|>",
1732
+ "single_word": false,
1733
+ "lstrip": false,
1734
+ "rstrip": false,
1735
+ "normalized": false,
1736
+ "special": true
1737
+ },
1738
+ "128215": {
1739
+ "content": "<|reserved_special_token_207|>",
1740
+ "single_word": false,
1741
+ "lstrip": false,
1742
+ "rstrip": false,
1743
+ "normalized": false,
1744
+ "special": true
1745
+ },
1746
+ "128216": {
1747
+ "content": "<|reserved_special_token_208|>",
1748
+ "single_word": false,
1749
+ "lstrip": false,
1750
+ "rstrip": false,
1751
+ "normalized": false,
1752
+ "special": true
1753
+ },
1754
+ "128217": {
1755
+ "content": "<|reserved_special_token_209|>",
1756
+ "single_word": false,
1757
+ "lstrip": false,
1758
+ "rstrip": false,
1759
+ "normalized": false,
1760
+ "special": true
1761
+ },
1762
+ "128218": {
1763
+ "content": "<|reserved_special_token_210|>",
1764
+ "single_word": false,
1765
+ "lstrip": false,
1766
+ "rstrip": false,
1767
+ "normalized": false,
1768
+ "special": true
1769
+ },
1770
+ "128219": {
1771
+ "content": "<|reserved_special_token_211|>",
1772
+ "single_word": false,
1773
+ "lstrip": false,
1774
+ "rstrip": false,
1775
+ "normalized": false,
1776
+ "special": true
1777
+ },
1778
+ "128220": {
1779
+ "content": "<|reserved_special_token_212|>",
1780
+ "single_word": false,
1781
+ "lstrip": false,
1782
+ "rstrip": false,
1783
+ "normalized": false,
1784
+ "special": true
1785
+ },
1786
+ "128221": {
1787
+ "content": "<|reserved_special_token_213|>",
1788
+ "single_word": false,
1789
+ "lstrip": false,
1790
+ "rstrip": false,
1791
+ "normalized": false,
1792
+ "special": true
1793
+ },
1794
+ "128222": {
1795
+ "content": "<|reserved_special_token_214|>",
1796
+ "single_word": false,
1797
+ "lstrip": false,
1798
+ "rstrip": false,
1799
+ "normalized": false,
1800
+ "special": true
1801
+ },
1802
+ "128223": {
1803
+ "content": "<|reserved_special_token_215|>",
1804
+ "single_word": false,
1805
+ "lstrip": false,
1806
+ "rstrip": false,
1807
+ "normalized": false,
1808
+ "special": true
1809
+ },
1810
+ "128224": {
1811
+ "content": "<|reserved_special_token_216|>",
1812
+ "single_word": false,
1813
+ "lstrip": false,
1814
+ "rstrip": false,
1815
+ "normalized": false,
1816
+ "special": true
1817
+ },
1818
+ "128225": {
1819
+ "content": "<|reserved_special_token_217|>",
1820
+ "single_word": false,
1821
+ "lstrip": false,
1822
+ "rstrip": false,
1823
+ "normalized": false,
1824
+ "special": true
1825
+ },
1826
+ "128226": {
1827
+ "content": "<|reserved_special_token_218|>",
1828
+ "single_word": false,
1829
+ "lstrip": false,
1830
+ "rstrip": false,
1831
+ "normalized": false,
1832
+ "special": true
1833
+ },
1834
+ "128227": {
1835
+ "content": "<|reserved_special_token_219|>",
1836
+ "single_word": false,
1837
+ "lstrip": false,
1838
+ "rstrip": false,
1839
+ "normalized": false,
1840
+ "special": true
1841
+ },
1842
+ "128228": {
1843
+ "content": "<|reserved_special_token_220|>",
1844
+ "single_word": false,
1845
+ "lstrip": false,
1846
+ "rstrip": false,
1847
+ "normalized": false,
1848
+ "special": true
1849
+ },
1850
+ "128229": {
1851
+ "content": "<|reserved_special_token_221|>",
1852
+ "single_word": false,
1853
+ "lstrip": false,
1854
+ "rstrip": false,
1855
+ "normalized": false,
1856
+ "special": true
1857
+ },
1858
+ "128230": {
1859
+ "content": "<|reserved_special_token_222|>",
1860
+ "single_word": false,
1861
+ "lstrip": false,
1862
+ "rstrip": false,
1863
+ "normalized": false,
1864
+ "special": true
1865
+ },
1866
+ "128231": {
1867
+ "content": "<|reserved_special_token_223|>",
1868
+ "single_word": false,
1869
+ "lstrip": false,
1870
+ "rstrip": false,
1871
+ "normalized": false,
1872
+ "special": true
1873
+ },
1874
+ "128232": {
1875
+ "content": "<|reserved_special_token_224|>",
1876
+ "single_word": false,
1877
+ "lstrip": false,
1878
+ "rstrip": false,
1879
+ "normalized": false,
1880
+ "special": true
1881
+ },
1882
+ "128233": {
1883
+ "content": "<|reserved_special_token_225|>",
1884
+ "single_word": false,
1885
+ "lstrip": false,
1886
+ "rstrip": false,
1887
+ "normalized": false,
1888
+ "special": true
1889
+ },
1890
+ "128234": {
1891
+ "content": "<|reserved_special_token_226|>",
1892
+ "single_word": false,
1893
+ "lstrip": false,
1894
+ "rstrip": false,
1895
+ "normalized": false,
1896
+ "special": true
1897
+ },
1898
+ "128235": {
1899
+ "content": "<|reserved_special_token_227|>",
1900
+ "single_word": false,
1901
+ "lstrip": false,
1902
+ "rstrip": false,
1903
+ "normalized": false,
1904
+ "special": true
1905
+ },
1906
+ "128236": {
1907
+ "content": "<|reserved_special_token_228|>",
1908
+ "single_word": false,
1909
+ "lstrip": false,
1910
+ "rstrip": false,
1911
+ "normalized": false,
1912
+ "special": true
1913
+ },
1914
+ "128237": {
1915
+ "content": "<|reserved_special_token_229|>",
1916
+ "single_word": false,
1917
+ "lstrip": false,
1918
+ "rstrip": false,
1919
+ "normalized": false,
1920
+ "special": true
1921
+ },
1922
+ "128238": {
1923
+ "content": "<|reserved_special_token_230|>",
1924
+ "single_word": false,
1925
+ "lstrip": false,
1926
+ "rstrip": false,
1927
+ "normalized": false,
1928
+ "special": true
1929
+ },
1930
+ "128239": {
1931
+ "content": "<|reserved_special_token_231|>",
1932
+ "single_word": false,
1933
+ "lstrip": false,
1934
+ "rstrip": false,
1935
+ "normalized": false,
1936
+ "special": true
1937
+ },
1938
+ "128240": {
1939
+ "content": "<|reserved_special_token_232|>",
1940
+ "single_word": false,
1941
+ "lstrip": false,
1942
+ "rstrip": false,
1943
+ "normalized": false,
1944
+ "special": true
1945
+ },
1946
+ "128241": {
1947
+ "content": "<|reserved_special_token_233|>",
1948
+ "single_word": false,
1949
+ "lstrip": false,
1950
+ "rstrip": false,
1951
+ "normalized": false,
1952
+ "special": true
1953
+ },
1954
+ "128242": {
1955
+ "content": "<|reserved_special_token_234|>",
1956
+ "single_word": false,
1957
+ "lstrip": false,
1958
+ "rstrip": false,
1959
+ "normalized": false,
1960
+ "special": true
1961
+ },
1962
+ "128243": {
1963
+ "content": "<|reserved_special_token_235|>",
1964
+ "single_word": false,
1965
+ "lstrip": false,
1966
+ "rstrip": false,
1967
+ "normalized": false,
1968
+ "special": true
1969
+ },
1970
+ "128244": {
1971
+ "content": "<|reserved_special_token_236|>",
1972
+ "single_word": false,
1973
+ "lstrip": false,
1974
+ "rstrip": false,
1975
+ "normalized": false,
1976
+ "special": true
1977
+ },
1978
+ "128245": {
1979
+ "content": "<|reserved_special_token_237|>",
1980
+ "single_word": false,
1981
+ "lstrip": false,
1982
+ "rstrip": false,
1983
+ "normalized": false,
1984
+ "special": true
1985
+ },
1986
+ "128246": {
1987
+ "content": "<|reserved_special_token_238|>",
1988
+ "single_word": false,
1989
+ "lstrip": false,
1990
+ "rstrip": false,
1991
+ "normalized": false,
1992
+ "special": true
1993
+ },
1994
+ "128247": {
1995
+ "content": "<|reserved_special_token_239|>",
1996
+ "single_word": false,
1997
+ "lstrip": false,
1998
+ "rstrip": false,
1999
+ "normalized": false,
2000
+ "special": true
2001
+ },
2002
+ "128248": {
2003
+ "content": "<|reserved_special_token_240|>",
2004
+ "single_word": false,
2005
+ "lstrip": false,
2006
+ "rstrip": false,
2007
+ "normalized": false,
2008
+ "special": true
2009
+ },
2010
+ "128249": {
2011
+ "content": "<|reserved_special_token_241|>",
2012
+ "single_word": false,
2013
+ "lstrip": false,
2014
+ "rstrip": false,
2015
+ "normalized": false,
2016
+ "special": true
2017
+ },
2018
+ "128250": {
2019
+ "content": "<|reserved_special_token_242|>",
2020
+ "single_word": false,
2021
+ "lstrip": false,
2022
+ "rstrip": false,
2023
+ "normalized": false,
2024
+ "special": true
2025
+ },
2026
+ "128251": {
2027
+ "content": "<|reserved_special_token_243|>",
2028
+ "single_word": false,
2029
+ "lstrip": false,
2030
+ "rstrip": false,
2031
+ "normalized": false,
2032
+ "special": true
2033
+ },
2034
+ "128252": {
2035
+ "content": "<|reserved_special_token_244|>",
2036
+ "single_word": false,
2037
+ "lstrip": false,
2038
+ "rstrip": false,
2039
+ "normalized": false,
2040
+ "special": true
2041
+ },
2042
+ "128253": {
2043
+ "content": "<|reserved_special_token_245|>",
2044
+ "single_word": false,
2045
+ "lstrip": false,
2046
+ "rstrip": false,
2047
+ "normalized": false,
2048
+ "special": true
2049
+ },
2050
+ "128254": {
2051
+ "content": "<|reserved_special_token_246|>",
2052
+ "single_word": false,
2053
+ "lstrip": false,
2054
+ "rstrip": false,
2055
+ "normalized": false,
2056
+ "special": true
2057
+ },
2058
+ "128255": {
2059
+ "content": "<|reserved_special_token_247|>",
2060
+ "single_word": false,
2061
+ "lstrip": false,
2062
+ "rstrip": false,
2063
+ "normalized": false,
2064
+ "special": true
2065
+ }
2066
+ }
2067
+ }
checkpoint-471/trainer_state.json ADDED
@@ -0,0 +1,363 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": null,
3
+ "best_metric": null,
4
+ "best_model_checkpoint": null,
5
+ "epoch": 1.0,
6
+ "eval_steps": 500,
7
+ "global_step": 471,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.02126528442317916,
14
+ "grad_norm": 0.3503319323062897,
15
+ "learning_rate": 1.8750000000000002e-05,
16
+ "loss": 0.6595343112945556,
17
+ "step": 10
18
+ },
19
+ {
20
+ "epoch": 0.04253056884635832,
21
+ "grad_norm": 0.33585068583488464,
22
+ "learning_rate": 3.958333333333333e-05,
23
+ "loss": 0.6289706707000733,
24
+ "step": 20
25
+ },
26
+ {
27
+ "epoch": 0.06379585326953748,
28
+ "grad_norm": 0.31047311425209045,
29
+ "learning_rate": 4.944071588366891e-05,
30
+ "loss": 0.5790252208709716,
31
+ "step": 30
32
+ },
33
+ {
34
+ "epoch": 0.08506113769271664,
35
+ "grad_norm": 0.4907252788543701,
36
+ "learning_rate": 4.832214765100672e-05,
37
+ "loss": 0.6072010040283203,
38
+ "step": 40
39
+ },
40
+ {
41
+ "epoch": 0.1063264221158958,
42
+ "grad_norm": 0.28008484840393066,
43
+ "learning_rate": 4.720357941834452e-05,
44
+ "loss": 0.6055714130401612,
45
+ "step": 50
46
+ },
47
+ {
48
+ "epoch": 0.12759170653907495,
49
+ "grad_norm": 0.3259820342063904,
50
+ "learning_rate": 4.608501118568233e-05,
51
+ "loss": 0.6223897933959961,
52
+ "step": 60
53
+ },
54
+ {
55
+ "epoch": 0.14885699096225413,
56
+ "grad_norm": 0.22271080315113068,
57
+ "learning_rate": 4.496644295302014e-05,
58
+ "loss": 0.5353362560272217,
59
+ "step": 70
60
+ },
61
+ {
62
+ "epoch": 0.17012227538543329,
63
+ "grad_norm": 0.27668145298957825,
64
+ "learning_rate": 4.384787472035794e-05,
65
+ "loss": 0.5315048694610596,
66
+ "step": 80
67
+ },
68
+ {
69
+ "epoch": 0.19138755980861244,
70
+ "grad_norm": 0.3596806526184082,
71
+ "learning_rate": 4.2729306487695754e-05,
72
+ "loss": 0.5415709018707275,
73
+ "step": 90
74
+ },
75
+ {
76
+ "epoch": 0.2126528442317916,
77
+ "grad_norm": 0.593047559261322,
78
+ "learning_rate": 4.161073825503356e-05,
79
+ "loss": 0.5533593654632568,
80
+ "step": 100
81
+ },
82
+ {
83
+ "epoch": 0.23391812865497075,
84
+ "grad_norm": 0.570087730884552,
85
+ "learning_rate": 4.049217002237137e-05,
86
+ "loss": 0.6009152889251709,
87
+ "step": 110
88
+ },
89
+ {
90
+ "epoch": 0.2551834130781499,
91
+ "grad_norm": 0.29204121232032776,
92
+ "learning_rate": 3.9373601789709174e-05,
93
+ "loss": 0.5379396438598633,
94
+ "step": 120
95
+ },
96
+ {
97
+ "epoch": 0.27644869750132905,
98
+ "grad_norm": 0.36378124356269836,
99
+ "learning_rate": 3.8255033557046985e-05,
100
+ "loss": 0.5647854804992676,
101
+ "step": 130
102
+ },
103
+ {
104
+ "epoch": 0.29771398192450826,
105
+ "grad_norm": 0.6516240835189819,
106
+ "learning_rate": 3.713646532438479e-05,
107
+ "loss": 0.5727553844451905,
108
+ "step": 140
109
+ },
110
+ {
111
+ "epoch": 0.3189792663476874,
112
+ "grad_norm": 0.27032342553138733,
113
+ "learning_rate": 3.6017897091722594e-05,
114
+ "loss": 0.5039033412933349,
115
+ "step": 150
116
+ },
117
+ {
118
+ "epoch": 0.34024455077086657,
119
+ "grad_norm": 0.37407493591308594,
120
+ "learning_rate": 3.4899328859060405e-05,
121
+ "loss": 0.5741183280944824,
122
+ "step": 160
123
+ },
124
+ {
125
+ "epoch": 0.3615098351940457,
126
+ "grad_norm": 0.4646298885345459,
127
+ "learning_rate": 3.378076062639821e-05,
128
+ "loss": 0.544231653213501,
129
+ "step": 170
130
+ },
131
+ {
132
+ "epoch": 0.3827751196172249,
133
+ "grad_norm": 0.36206507682800293,
134
+ "learning_rate": 3.266219239373602e-05,
135
+ "loss": 0.5334268569946289,
136
+ "step": 180
137
+ },
138
+ {
139
+ "epoch": 0.40404040404040403,
140
+ "grad_norm": 0.5438163876533508,
141
+ "learning_rate": 3.1543624161073825e-05,
142
+ "loss": 0.5427745819091797,
143
+ "step": 190
144
+ },
145
+ {
146
+ "epoch": 0.4253056884635832,
147
+ "grad_norm": 0.5274127125740051,
148
+ "learning_rate": 3.0425055928411632e-05,
149
+ "loss": 0.530413818359375,
150
+ "step": 200
151
+ },
152
+ {
153
+ "epoch": 0.44657097288676234,
154
+ "grad_norm": 0.41516807675361633,
155
+ "learning_rate": 2.930648769574944e-05,
156
+ "loss": 0.4985743522644043,
157
+ "step": 210
158
+ },
159
+ {
160
+ "epoch": 0.4678362573099415,
161
+ "grad_norm": 0.30840158462524414,
162
+ "learning_rate": 2.8187919463087248e-05,
163
+ "loss": 0.5373085498809814,
164
+ "step": 220
165
+ },
166
+ {
167
+ "epoch": 0.4891015417331207,
168
+ "grad_norm": 0.26996830105781555,
169
+ "learning_rate": 2.7069351230425055e-05,
170
+ "loss": 0.4709618091583252,
171
+ "step": 230
172
+ },
173
+ {
174
+ "epoch": 0.5103668261562998,
175
+ "grad_norm": 0.4134744703769684,
176
+ "learning_rate": 2.5950782997762863e-05,
177
+ "loss": 0.5192549228668213,
178
+ "step": 240
179
+ },
180
+ {
181
+ "epoch": 0.531632110579479,
182
+ "grad_norm": 0.355313777923584,
183
+ "learning_rate": 2.4832214765100674e-05,
184
+ "loss": 0.42253613471984863,
185
+ "step": 250
186
+ },
187
+ {
188
+ "epoch": 0.5528973950026581,
189
+ "grad_norm": 0.23188523948192596,
190
+ "learning_rate": 2.371364653243848e-05,
191
+ "loss": 0.506589126586914,
192
+ "step": 260
193
+ },
194
+ {
195
+ "epoch": 0.5741626794258373,
196
+ "grad_norm": 0.37884292006492615,
197
+ "learning_rate": 2.2595078299776286e-05,
198
+ "loss": 0.4979988098144531,
199
+ "step": 270
200
+ },
201
+ {
202
+ "epoch": 0.5954279638490165,
203
+ "grad_norm": 0.4436698853969574,
204
+ "learning_rate": 2.1476510067114094e-05,
205
+ "loss": 0.44595751762390134,
206
+ "step": 280
207
+ },
208
+ {
209
+ "epoch": 0.6166932482721956,
210
+ "grad_norm": 0.3720977306365967,
211
+ "learning_rate": 2.03579418344519e-05,
212
+ "loss": 0.5281799793243408,
213
+ "step": 290
214
+ },
215
+ {
216
+ "epoch": 0.6379585326953748,
217
+ "grad_norm": 0.44736310839653015,
218
+ "learning_rate": 1.923937360178971e-05,
219
+ "loss": 0.5041176319122315,
220
+ "step": 300
221
+ },
222
+ {
223
+ "epoch": 0.6592238171185539,
224
+ "grad_norm": 0.3366965353488922,
225
+ "learning_rate": 1.8120805369127517e-05,
226
+ "loss": 0.4909733772277832,
227
+ "step": 310
228
+ },
229
+ {
230
+ "epoch": 0.6804891015417331,
231
+ "grad_norm": 0.5076707005500793,
232
+ "learning_rate": 1.7002237136465328e-05,
233
+ "loss": 0.4846998691558838,
234
+ "step": 320
235
+ },
236
+ {
237
+ "epoch": 0.7017543859649122,
238
+ "grad_norm": 0.5368161797523499,
239
+ "learning_rate": 1.5883668903803133e-05,
240
+ "loss": 0.5018360614776611,
241
+ "step": 330
242
+ },
243
+ {
244
+ "epoch": 0.7230196703880915,
245
+ "grad_norm": 0.4139963984489441,
246
+ "learning_rate": 1.4765100671140942e-05,
247
+ "loss": 0.4681858062744141,
248
+ "step": 340
249
+ },
250
+ {
251
+ "epoch": 0.7442849548112705,
252
+ "grad_norm": 0.46035096049308777,
253
+ "learning_rate": 1.3646532438478748e-05,
254
+ "loss": 0.4936246395111084,
255
+ "step": 350
256
+ },
257
+ {
258
+ "epoch": 0.7655502392344498,
259
+ "grad_norm": 0.40648603439331055,
260
+ "learning_rate": 1.2527964205816556e-05,
261
+ "loss": 0.44501557350158694,
262
+ "step": 360
263
+ },
264
+ {
265
+ "epoch": 0.786815523657629,
266
+ "grad_norm": 0.3277314305305481,
267
+ "learning_rate": 1.1409395973154363e-05,
268
+ "loss": 0.5463457107543945,
269
+ "step": 370
270
+ },
271
+ {
272
+ "epoch": 0.8080808080808081,
273
+ "grad_norm": 0.34489724040031433,
274
+ "learning_rate": 1.0290827740492171e-05,
275
+ "loss": 0.47779436111450196,
276
+ "step": 380
277
+ },
278
+ {
279
+ "epoch": 0.8293460925039873,
280
+ "grad_norm": 0.5268451571464539,
281
+ "learning_rate": 9.172259507829977e-06,
282
+ "loss": 0.504526948928833,
283
+ "step": 390
284
+ },
285
+ {
286
+ "epoch": 0.8506113769271664,
287
+ "grad_norm": 0.3994840383529663,
288
+ "learning_rate": 8.053691275167785e-06,
289
+ "loss": 0.4639009952545166,
290
+ "step": 400
291
+ },
292
+ {
293
+ "epoch": 0.8718766613503456,
294
+ "grad_norm": 0.4887167811393738,
295
+ "learning_rate": 6.935123042505594e-06,
296
+ "loss": 0.5100517749786377,
297
+ "step": 410
298
+ },
299
+ {
300
+ "epoch": 0.8931419457735247,
301
+ "grad_norm": 0.5764585137367249,
302
+ "learning_rate": 5.8165548098434e-06,
303
+ "loss": 0.47527222633361815,
304
+ "step": 420
305
+ },
306
+ {
307
+ "epoch": 0.9144072301967039,
308
+ "grad_norm": 0.41552090644836426,
309
+ "learning_rate": 4.697986577181209e-06,
310
+ "loss": 0.5652190685272217,
311
+ "step": 430
312
+ },
313
+ {
314
+ "epoch": 0.935672514619883,
315
+ "grad_norm": 0.4586558938026428,
316
+ "learning_rate": 3.5794183445190157e-06,
317
+ "loss": 0.5257540225982666,
318
+ "step": 440
319
+ },
320
+ {
321
+ "epoch": 0.9569377990430622,
322
+ "grad_norm": 0.4028780460357666,
323
+ "learning_rate": 2.4608501118568234e-06,
324
+ "loss": 0.438538122177124,
325
+ "step": 450
326
+ },
327
+ {
328
+ "epoch": 0.9782030834662414,
329
+ "grad_norm": 0.4289374053478241,
330
+ "learning_rate": 1.3422818791946309e-06,
331
+ "loss": 0.45324149131774905,
332
+ "step": 460
333
+ },
334
+ {
335
+ "epoch": 0.9994683678894205,
336
+ "grad_norm": 0.5781024694442749,
337
+ "learning_rate": 2.2371364653243848e-07,
338
+ "loss": 0.3867696762084961,
339
+ "step": 470
340
+ }
341
+ ],
342
+ "logging_steps": 10,
343
+ "max_steps": 471,
344
+ "num_input_tokens_seen": 0,
345
+ "num_train_epochs": 1,
346
+ "save_steps": 500,
347
+ "stateful_callbacks": {
348
+ "TrainerControl": {
349
+ "args": {
350
+ "should_epoch_stop": false,
351
+ "should_evaluate": false,
352
+ "should_log": false,
353
+ "should_save": true,
354
+ "should_training_stop": true
355
+ },
356
+ "attributes": {}
357
+ }
358
+ },
359
+ "total_flos": 1.0594833023092531e+18,
360
+ "train_batch_size": 1,
361
+ "trial_name": null,
362
+ "trial_params": null
363
+ }
checkpoint-471/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:490c9f2d364265efaf4ac009c18b7debb1b6c52020fa2283c8aa0c912712d7c2
3
+ size 5841
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab4da6b2aa68247e9c0fa9b97fc7fcc796505038d01f7e144522a65ce0dbd2e5
3
+ size 17208861
tokenizer_config.json ADDED
@@ -0,0 +1,2067 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "backend": "tokenizers",
3
+ "bos_token": null,
4
+ "clean_up_tokenization_spaces": true,
5
+ "eos_token": "<|end_of_text|>",
6
+ "fast": false,
7
+ "is_local": false,
8
+ "model_input_names": [
9
+ "input_ids",
10
+ "attention_mask"
11
+ ],
12
+ "model_max_length": 65536,
13
+ "pad_token": "<|finetune_right_pad_id|>",
14
+ "padding_side": "left",
15
+ "tokenizer_class": "TokenizersBackend",
16
+ "unk_token": null,
17
+ "added_tokens_decoder": {
18
+ "128000": {
19
+ "content": "<|begin_of_text|>",
20
+ "single_word": false,
21
+ "lstrip": false,
22
+ "rstrip": false,
23
+ "normalized": false,
24
+ "special": true
25
+ },
26
+ "128001": {
27
+ "content": "<|end_of_text|>",
28
+ "single_word": false,
29
+ "lstrip": false,
30
+ "rstrip": false,
31
+ "normalized": false,
32
+ "special": true
33
+ },
34
+ "128002": {
35
+ "content": "<think>",
36
+ "single_word": false,
37
+ "lstrip": false,
38
+ "rstrip": false,
39
+ "normalized": false,
40
+ "special": false
41
+ },
42
+ "128003": {
43
+ "content": "</think>",
44
+ "single_word": false,
45
+ "lstrip": false,
46
+ "rstrip": false,
47
+ "normalized": false,
48
+ "special": false
49
+ },
50
+ "128004": {
51
+ "content": "<|finetune_right_pad_id|>",
52
+ "single_word": false,
53
+ "lstrip": false,
54
+ "rstrip": false,
55
+ "normalized": false,
56
+ "special": true
57
+ },
58
+ "128005": {
59
+ "content": "<|reserved_special_token_2|>",
60
+ "single_word": false,
61
+ "lstrip": false,
62
+ "rstrip": false,
63
+ "normalized": false,
64
+ "special": true
65
+ },
66
+ "128006": {
67
+ "content": "<|start_header_id|>",
68
+ "single_word": false,
69
+ "lstrip": false,
70
+ "rstrip": false,
71
+ "normalized": false,
72
+ "special": true
73
+ },
74
+ "128007": {
75
+ "content": "<|end_header_id|>",
76
+ "single_word": false,
77
+ "lstrip": false,
78
+ "rstrip": false,
79
+ "normalized": false,
80
+ "special": true
81
+ },
82
+ "128008": {
83
+ "content": "<|eom_id|>",
84
+ "single_word": false,
85
+ "lstrip": false,
86
+ "rstrip": false,
87
+ "normalized": false,
88
+ "special": true
89
+ },
90
+ "128009": {
91
+ "content": "<|eot_id|>",
92
+ "single_word": false,
93
+ "lstrip": false,
94
+ "rstrip": false,
95
+ "normalized": false,
96
+ "special": true
97
+ },
98
+ "128010": {
99
+ "content": "<|python_tag|>",
100
+ "single_word": false,
101
+ "lstrip": false,
102
+ "rstrip": false,
103
+ "normalized": false,
104
+ "special": true
105
+ },
106
+ "128011": {
107
+ "content": "<|im_start|>",
108
+ "single_word": false,
109
+ "lstrip": false,
110
+ "rstrip": false,
111
+ "normalized": false,
112
+ "special": true
113
+ },
114
+ "128012": {
115
+ "content": "<|im_end|>",
116
+ "single_word": false,
117
+ "lstrip": false,
118
+ "rstrip": false,
119
+ "normalized": false,
120
+ "special": true
121
+ },
122
+ "128013": {
123
+ "content": "<tool_response>",
124
+ "single_word": false,
125
+ "lstrip": false,
126
+ "rstrip": false,
127
+ "normalized": false,
128
+ "special": false
129
+ },
130
+ "128014": {
131
+ "content": "</tool_response>",
132
+ "single_word": false,
133
+ "lstrip": false,
134
+ "rstrip": false,
135
+ "normalized": false,
136
+ "special": false
137
+ },
138
+ "128015": {
139
+ "content": "<tool_call>",
140
+ "single_word": false,
141
+ "lstrip": false,
142
+ "rstrip": false,
143
+ "normalized": false,
144
+ "special": false
145
+ },
146
+ "128016": {
147
+ "content": "</tool_call>",
148
+ "single_word": false,
149
+ "lstrip": false,
150
+ "rstrip": false,
151
+ "normalized": false,
152
+ "special": false
153
+ },
154
+ "128017": {
155
+ "content": "<|reserved_special_token_9|>",
156
+ "single_word": false,
157
+ "lstrip": false,
158
+ "rstrip": false,
159
+ "normalized": false,
160
+ "special": true
161
+ },
162
+ "128018": {
163
+ "content": "<|reserved_special_token_10|>",
164
+ "single_word": false,
165
+ "lstrip": false,
166
+ "rstrip": false,
167
+ "normalized": false,
168
+ "special": true
169
+ },
170
+ "128019": {
171
+ "content": "<|reserved_special_token_11|>",
172
+ "single_word": false,
173
+ "lstrip": false,
174
+ "rstrip": false,
175
+ "normalized": false,
176
+ "special": true
177
+ },
178
+ "128020": {
179
+ "content": "<|reserved_special_token_12|>",
180
+ "single_word": false,
181
+ "lstrip": false,
182
+ "rstrip": false,
183
+ "normalized": false,
184
+ "special": true
185
+ },
186
+ "128021": {
187
+ "content": "<|reserved_special_token_13|>",
188
+ "single_word": false,
189
+ "lstrip": false,
190
+ "rstrip": false,
191
+ "normalized": false,
192
+ "special": true
193
+ },
194
+ "128022": {
195
+ "content": "<|reserved_special_token_14|>",
196
+ "single_word": false,
197
+ "lstrip": false,
198
+ "rstrip": false,
199
+ "normalized": false,
200
+ "special": true
201
+ },
202
+ "128023": {
203
+ "content": "<|reserved_special_token_15|>",
204
+ "single_word": false,
205
+ "lstrip": false,
206
+ "rstrip": false,
207
+ "normalized": false,
208
+ "special": true
209
+ },
210
+ "128024": {
211
+ "content": "<|reserved_special_token_16|>",
212
+ "single_word": false,
213
+ "lstrip": false,
214
+ "rstrip": false,
215
+ "normalized": false,
216
+ "special": true
217
+ },
218
+ "128025": {
219
+ "content": "<|reserved_special_token_17|>",
220
+ "single_word": false,
221
+ "lstrip": false,
222
+ "rstrip": false,
223
+ "normalized": false,
224
+ "special": true
225
+ },
226
+ "128026": {
227
+ "content": "<|reserved_special_token_18|>",
228
+ "single_word": false,
229
+ "lstrip": false,
230
+ "rstrip": false,
231
+ "normalized": false,
232
+ "special": true
233
+ },
234
+ "128027": {
235
+ "content": "<|reserved_special_token_19|>",
236
+ "single_word": false,
237
+ "lstrip": false,
238
+ "rstrip": false,
239
+ "normalized": false,
240
+ "special": true
241
+ },
242
+ "128028": {
243
+ "content": "<|reserved_special_token_20|>",
244
+ "single_word": false,
245
+ "lstrip": false,
246
+ "rstrip": false,
247
+ "normalized": false,
248
+ "special": true
249
+ },
250
+ "128029": {
251
+ "content": "<|reserved_special_token_21|>",
252
+ "single_word": false,
253
+ "lstrip": false,
254
+ "rstrip": false,
255
+ "normalized": false,
256
+ "special": true
257
+ },
258
+ "128030": {
259
+ "content": "<|reserved_special_token_22|>",
260
+ "single_word": false,
261
+ "lstrip": false,
262
+ "rstrip": false,
263
+ "normalized": false,
264
+ "special": true
265
+ },
266
+ "128031": {
267
+ "content": "<|reserved_special_token_23|>",
268
+ "single_word": false,
269
+ "lstrip": false,
270
+ "rstrip": false,
271
+ "normalized": false,
272
+ "special": true
273
+ },
274
+ "128032": {
275
+ "content": "<|reserved_special_token_24|>",
276
+ "single_word": false,
277
+ "lstrip": false,
278
+ "rstrip": false,
279
+ "normalized": false,
280
+ "special": true
281
+ },
282
+ "128033": {
283
+ "content": "<|reserved_special_token_25|>",
284
+ "single_word": false,
285
+ "lstrip": false,
286
+ "rstrip": false,
287
+ "normalized": false,
288
+ "special": true
289
+ },
290
+ "128034": {
291
+ "content": "<|reserved_special_token_26|>",
292
+ "single_word": false,
293
+ "lstrip": false,
294
+ "rstrip": false,
295
+ "normalized": false,
296
+ "special": true
297
+ },
298
+ "128035": {
299
+ "content": "<|reserved_special_token_27|>",
300
+ "single_word": false,
301
+ "lstrip": false,
302
+ "rstrip": false,
303
+ "normalized": false,
304
+ "special": true
305
+ },
306
+ "128036": {
307
+ "content": "<|reserved_special_token_28|>",
308
+ "single_word": false,
309
+ "lstrip": false,
310
+ "rstrip": false,
311
+ "normalized": false,
312
+ "special": true
313
+ },
314
+ "128037": {
315
+ "content": "<|reserved_special_token_29|>",
316
+ "single_word": false,
317
+ "lstrip": false,
318
+ "rstrip": false,
319
+ "normalized": false,
320
+ "special": true
321
+ },
322
+ "128038": {
323
+ "content": "<|reserved_special_token_30|>",
324
+ "single_word": false,
325
+ "lstrip": false,
326
+ "rstrip": false,
327
+ "normalized": false,
328
+ "special": true
329
+ },
330
+ "128039": {
331
+ "content": "<|reserved_special_token_31|>",
332
+ "single_word": false,
333
+ "lstrip": false,
334
+ "rstrip": false,
335
+ "normalized": false,
336
+ "special": true
337
+ },
338
+ "128040": {
339
+ "content": "<|reserved_special_token_32|>",
340
+ "single_word": false,
341
+ "lstrip": false,
342
+ "rstrip": false,
343
+ "normalized": false,
344
+ "special": true
345
+ },
346
+ "128041": {
347
+ "content": "<|reserved_special_token_33|>",
348
+ "single_word": false,
349
+ "lstrip": false,
350
+ "rstrip": false,
351
+ "normalized": false,
352
+ "special": true
353
+ },
354
+ "128042": {
355
+ "content": "<|reserved_special_token_34|>",
356
+ "single_word": false,
357
+ "lstrip": false,
358
+ "rstrip": false,
359
+ "normalized": false,
360
+ "special": true
361
+ },
362
+ "128043": {
363
+ "content": "<|reserved_special_token_35|>",
364
+ "single_word": false,
365
+ "lstrip": false,
366
+ "rstrip": false,
367
+ "normalized": false,
368
+ "special": true
369
+ },
370
+ "128044": {
371
+ "content": "<|reserved_special_token_36|>",
372
+ "single_word": false,
373
+ "lstrip": false,
374
+ "rstrip": false,
375
+ "normalized": false,
376
+ "special": true
377
+ },
378
+ "128045": {
379
+ "content": "<|reserved_special_token_37|>",
380
+ "single_word": false,
381
+ "lstrip": false,
382
+ "rstrip": false,
383
+ "normalized": false,
384
+ "special": true
385
+ },
386
+ "128046": {
387
+ "content": "<|reserved_special_token_38|>",
388
+ "single_word": false,
389
+ "lstrip": false,
390
+ "rstrip": false,
391
+ "normalized": false,
392
+ "special": true
393
+ },
394
+ "128047": {
395
+ "content": "<|reserved_special_token_39|>",
396
+ "single_word": false,
397
+ "lstrip": false,
398
+ "rstrip": false,
399
+ "normalized": false,
400
+ "special": true
401
+ },
402
+ "128048": {
403
+ "content": "<|reserved_special_token_40|>",
404
+ "single_word": false,
405
+ "lstrip": false,
406
+ "rstrip": false,
407
+ "normalized": false,
408
+ "special": true
409
+ },
410
+ "128049": {
411
+ "content": "<|reserved_special_token_41|>",
412
+ "single_word": false,
413
+ "lstrip": false,
414
+ "rstrip": false,
415
+ "normalized": false,
416
+ "special": true
417
+ },
418
+ "128050": {
419
+ "content": "<|reserved_special_token_42|>",
420
+ "single_word": false,
421
+ "lstrip": false,
422
+ "rstrip": false,
423
+ "normalized": false,
424
+ "special": true
425
+ },
426
+ "128051": {
427
+ "content": "<|reserved_special_token_43|>",
428
+ "single_word": false,
429
+ "lstrip": false,
430
+ "rstrip": false,
431
+ "normalized": false,
432
+ "special": true
433
+ },
434
+ "128052": {
435
+ "content": "<|reserved_special_token_44|>",
436
+ "single_word": false,
437
+ "lstrip": false,
438
+ "rstrip": false,
439
+ "normalized": false,
440
+ "special": true
441
+ },
442
+ "128053": {
443
+ "content": "<|reserved_special_token_45|>",
444
+ "single_word": false,
445
+ "lstrip": false,
446
+ "rstrip": false,
447
+ "normalized": false,
448
+ "special": true
449
+ },
450
+ "128054": {
451
+ "content": "<|reserved_special_token_46|>",
452
+ "single_word": false,
453
+ "lstrip": false,
454
+ "rstrip": false,
455
+ "normalized": false,
456
+ "special": true
457
+ },
458
+ "128055": {
459
+ "content": "<|reserved_special_token_47|>",
460
+ "single_word": false,
461
+ "lstrip": false,
462
+ "rstrip": false,
463
+ "normalized": false,
464
+ "special": true
465
+ },
466
+ "128056": {
467
+ "content": "<|reserved_special_token_48|>",
468
+ "single_word": false,
469
+ "lstrip": false,
470
+ "rstrip": false,
471
+ "normalized": false,
472
+ "special": true
473
+ },
474
+ "128057": {
475
+ "content": "<|reserved_special_token_49|>",
476
+ "single_word": false,
477
+ "lstrip": false,
478
+ "rstrip": false,
479
+ "normalized": false,
480
+ "special": true
481
+ },
482
+ "128058": {
483
+ "content": "<|reserved_special_token_50|>",
484
+ "single_word": false,
485
+ "lstrip": false,
486
+ "rstrip": false,
487
+ "normalized": false,
488
+ "special": true
489
+ },
490
+ "128059": {
491
+ "content": "<|reserved_special_token_51|>",
492
+ "single_word": false,
493
+ "lstrip": false,
494
+ "rstrip": false,
495
+ "normalized": false,
496
+ "special": true
497
+ },
498
+ "128060": {
499
+ "content": "<|reserved_special_token_52|>",
500
+ "single_word": false,
501
+ "lstrip": false,
502
+ "rstrip": false,
503
+ "normalized": false,
504
+ "special": true
505
+ },
506
+ "128061": {
507
+ "content": "<|reserved_special_token_53|>",
508
+ "single_word": false,
509
+ "lstrip": false,
510
+ "rstrip": false,
511
+ "normalized": false,
512
+ "special": true
513
+ },
514
+ "128062": {
515
+ "content": "<|reserved_special_token_54|>",
516
+ "single_word": false,
517
+ "lstrip": false,
518
+ "rstrip": false,
519
+ "normalized": false,
520
+ "special": true
521
+ },
522
+ "128063": {
523
+ "content": "<|reserved_special_token_55|>",
524
+ "single_word": false,
525
+ "lstrip": false,
526
+ "rstrip": false,
527
+ "normalized": false,
528
+ "special": true
529
+ },
530
+ "128064": {
531
+ "content": "<|reserved_special_token_56|>",
532
+ "single_word": false,
533
+ "lstrip": false,
534
+ "rstrip": false,
535
+ "normalized": false,
536
+ "special": true
537
+ },
538
+ "128065": {
539
+ "content": "<|reserved_special_token_57|>",
540
+ "single_word": false,
541
+ "lstrip": false,
542
+ "rstrip": false,
543
+ "normalized": false,
544
+ "special": true
545
+ },
546
+ "128066": {
547
+ "content": "<|reserved_special_token_58|>",
548
+ "single_word": false,
549
+ "lstrip": false,
550
+ "rstrip": false,
551
+ "normalized": false,
552
+ "special": true
553
+ },
554
+ "128067": {
555
+ "content": "<|reserved_special_token_59|>",
556
+ "single_word": false,
557
+ "lstrip": false,
558
+ "rstrip": false,
559
+ "normalized": false,
560
+ "special": true
561
+ },
562
+ "128068": {
563
+ "content": "<|reserved_special_token_60|>",
564
+ "single_word": false,
565
+ "lstrip": false,
566
+ "rstrip": false,
567
+ "normalized": false,
568
+ "special": true
569
+ },
570
+ "128069": {
571
+ "content": "<|reserved_special_token_61|>",
572
+ "single_word": false,
573
+ "lstrip": false,
574
+ "rstrip": false,
575
+ "normalized": false,
576
+ "special": true
577
+ },
578
+ "128070": {
579
+ "content": "<|reserved_special_token_62|>",
580
+ "single_word": false,
581
+ "lstrip": false,
582
+ "rstrip": false,
583
+ "normalized": false,
584
+ "special": true
585
+ },
586
+ "128071": {
587
+ "content": "<|reserved_special_token_63|>",
588
+ "single_word": false,
589
+ "lstrip": false,
590
+ "rstrip": false,
591
+ "normalized": false,
592
+ "special": true
593
+ },
594
+ "128072": {
595
+ "content": "<|reserved_special_token_64|>",
596
+ "single_word": false,
597
+ "lstrip": false,
598
+ "rstrip": false,
599
+ "normalized": false,
600
+ "special": true
601
+ },
602
+ "128073": {
603
+ "content": "<|reserved_special_token_65|>",
604
+ "single_word": false,
605
+ "lstrip": false,
606
+ "rstrip": false,
607
+ "normalized": false,
608
+ "special": true
609
+ },
610
+ "128074": {
611
+ "content": "<|reserved_special_token_66|>",
612
+ "single_word": false,
613
+ "lstrip": false,
614
+ "rstrip": false,
615
+ "normalized": false,
616
+ "special": true
617
+ },
618
+ "128075": {
619
+ "content": "<|reserved_special_token_67|>",
620
+ "single_word": false,
621
+ "lstrip": false,
622
+ "rstrip": false,
623
+ "normalized": false,
624
+ "special": true
625
+ },
626
+ "128076": {
627
+ "content": "<|reserved_special_token_68|>",
628
+ "single_word": false,
629
+ "lstrip": false,
630
+ "rstrip": false,
631
+ "normalized": false,
632
+ "special": true
633
+ },
634
+ "128077": {
635
+ "content": "<|reserved_special_token_69|>",
636
+ "single_word": false,
637
+ "lstrip": false,
638
+ "rstrip": false,
639
+ "normalized": false,
640
+ "special": true
641
+ },
642
+ "128078": {
643
+ "content": "<|reserved_special_token_70|>",
644
+ "single_word": false,
645
+ "lstrip": false,
646
+ "rstrip": false,
647
+ "normalized": false,
648
+ "special": true
649
+ },
650
+ "128079": {
651
+ "content": "<|reserved_special_token_71|>",
652
+ "single_word": false,
653
+ "lstrip": false,
654
+ "rstrip": false,
655
+ "normalized": false,
656
+ "special": true
657
+ },
658
+ "128080": {
659
+ "content": "<|reserved_special_token_72|>",
660
+ "single_word": false,
661
+ "lstrip": false,
662
+ "rstrip": false,
663
+ "normalized": false,
664
+ "special": true
665
+ },
666
+ "128081": {
667
+ "content": "<|reserved_special_token_73|>",
668
+ "single_word": false,
669
+ "lstrip": false,
670
+ "rstrip": false,
671
+ "normalized": false,
672
+ "special": true
673
+ },
674
+ "128082": {
675
+ "content": "<|reserved_special_token_74|>",
676
+ "single_word": false,
677
+ "lstrip": false,
678
+ "rstrip": false,
679
+ "normalized": false,
680
+ "special": true
681
+ },
682
+ "128083": {
683
+ "content": "<|reserved_special_token_75|>",
684
+ "single_word": false,
685
+ "lstrip": false,
686
+ "rstrip": false,
687
+ "normalized": false,
688
+ "special": true
689
+ },
690
+ "128084": {
691
+ "content": "<|reserved_special_token_76|>",
692
+ "single_word": false,
693
+ "lstrip": false,
694
+ "rstrip": false,
695
+ "normalized": false,
696
+ "special": true
697
+ },
698
+ "128085": {
699
+ "content": "<|reserved_special_token_77|>",
700
+ "single_word": false,
701
+ "lstrip": false,
702
+ "rstrip": false,
703
+ "normalized": false,
704
+ "special": true
705
+ },
706
+ "128086": {
707
+ "content": "<|reserved_special_token_78|>",
708
+ "single_word": false,
709
+ "lstrip": false,
710
+ "rstrip": false,
711
+ "normalized": false,
712
+ "special": true
713
+ },
714
+ "128087": {
715
+ "content": "<|reserved_special_token_79|>",
716
+ "single_word": false,
717
+ "lstrip": false,
718
+ "rstrip": false,
719
+ "normalized": false,
720
+ "special": true
721
+ },
722
+ "128088": {
723
+ "content": "<|reserved_special_token_80|>",
724
+ "single_word": false,
725
+ "lstrip": false,
726
+ "rstrip": false,
727
+ "normalized": false,
728
+ "special": true
729
+ },
730
+ "128089": {
731
+ "content": "<|reserved_special_token_81|>",
732
+ "single_word": false,
733
+ "lstrip": false,
734
+ "rstrip": false,
735
+ "normalized": false,
736
+ "special": true
737
+ },
738
+ "128090": {
739
+ "content": "<|reserved_special_token_82|>",
740
+ "single_word": false,
741
+ "lstrip": false,
742
+ "rstrip": false,
743
+ "normalized": false,
744
+ "special": true
745
+ },
746
+ "128091": {
747
+ "content": "<|reserved_special_token_83|>",
748
+ "single_word": false,
749
+ "lstrip": false,
750
+ "rstrip": false,
751
+ "normalized": false,
752
+ "special": true
753
+ },
754
+ "128092": {
755
+ "content": "<|reserved_special_token_84|>",
756
+ "single_word": false,
757
+ "lstrip": false,
758
+ "rstrip": false,
759
+ "normalized": false,
760
+ "special": true
761
+ },
762
+ "128093": {
763
+ "content": "<|reserved_special_token_85|>",
764
+ "single_word": false,
765
+ "lstrip": false,
766
+ "rstrip": false,
767
+ "normalized": false,
768
+ "special": true
769
+ },
770
+ "128094": {
771
+ "content": "<|reserved_special_token_86|>",
772
+ "single_word": false,
773
+ "lstrip": false,
774
+ "rstrip": false,
775
+ "normalized": false,
776
+ "special": true
777
+ },
778
+ "128095": {
779
+ "content": "<|reserved_special_token_87|>",
780
+ "single_word": false,
781
+ "lstrip": false,
782
+ "rstrip": false,
783
+ "normalized": false,
784
+ "special": true
785
+ },
786
+ "128096": {
787
+ "content": "<|reserved_special_token_88|>",
788
+ "single_word": false,
789
+ "lstrip": false,
790
+ "rstrip": false,
791
+ "normalized": false,
792
+ "special": true
793
+ },
794
+ "128097": {
795
+ "content": "<|reserved_special_token_89|>",
796
+ "single_word": false,
797
+ "lstrip": false,
798
+ "rstrip": false,
799
+ "normalized": false,
800
+ "special": true
801
+ },
802
+ "128098": {
803
+ "content": "<|reserved_special_token_90|>",
804
+ "single_word": false,
805
+ "lstrip": false,
806
+ "rstrip": false,
807
+ "normalized": false,
808
+ "special": true
809
+ },
810
+ "128099": {
811
+ "content": "<|reserved_special_token_91|>",
812
+ "single_word": false,
813
+ "lstrip": false,
814
+ "rstrip": false,
815
+ "normalized": false,
816
+ "special": true
817
+ },
818
+ "128100": {
819
+ "content": "<|reserved_special_token_92|>",
820
+ "single_word": false,
821
+ "lstrip": false,
822
+ "rstrip": false,
823
+ "normalized": false,
824
+ "special": true
825
+ },
826
+ "128101": {
827
+ "content": "<|reserved_special_token_93|>",
828
+ "single_word": false,
829
+ "lstrip": false,
830
+ "rstrip": false,
831
+ "normalized": false,
832
+ "special": true
833
+ },
834
+ "128102": {
835
+ "content": "<|reserved_special_token_94|>",
836
+ "single_word": false,
837
+ "lstrip": false,
838
+ "rstrip": false,
839
+ "normalized": false,
840
+ "special": true
841
+ },
842
+ "128103": {
843
+ "content": "<|reserved_special_token_95|>",
844
+ "single_word": false,
845
+ "lstrip": false,
846
+ "rstrip": false,
847
+ "normalized": false,
848
+ "special": true
849
+ },
850
+ "128104": {
851
+ "content": "<|reserved_special_token_96|>",
852
+ "single_word": false,
853
+ "lstrip": false,
854
+ "rstrip": false,
855
+ "normalized": false,
856
+ "special": true
857
+ },
858
+ "128105": {
859
+ "content": "<|reserved_special_token_97|>",
860
+ "single_word": false,
861
+ "lstrip": false,
862
+ "rstrip": false,
863
+ "normalized": false,
864
+ "special": true
865
+ },
866
+ "128106": {
867
+ "content": "<|reserved_special_token_98|>",
868
+ "single_word": false,
869
+ "lstrip": false,
870
+ "rstrip": false,
871
+ "normalized": false,
872
+ "special": true
873
+ },
874
+ "128107": {
875
+ "content": "<|reserved_special_token_99|>",
876
+ "single_word": false,
877
+ "lstrip": false,
878
+ "rstrip": false,
879
+ "normalized": false,
880
+ "special": true
881
+ },
882
+ "128108": {
883
+ "content": "<|reserved_special_token_100|>",
884
+ "single_word": false,
885
+ "lstrip": false,
886
+ "rstrip": false,
887
+ "normalized": false,
888
+ "special": true
889
+ },
890
+ "128109": {
891
+ "content": "<|reserved_special_token_101|>",
892
+ "single_word": false,
893
+ "lstrip": false,
894
+ "rstrip": false,
895
+ "normalized": false,
896
+ "special": true
897
+ },
898
+ "128110": {
899
+ "content": "<|reserved_special_token_102|>",
900
+ "single_word": false,
901
+ "lstrip": false,
902
+ "rstrip": false,
903
+ "normalized": false,
904
+ "special": true
905
+ },
906
+ "128111": {
907
+ "content": "<|reserved_special_token_103|>",
908
+ "single_word": false,
909
+ "lstrip": false,
910
+ "rstrip": false,
911
+ "normalized": false,
912
+ "special": true
913
+ },
914
+ "128112": {
915
+ "content": "<|reserved_special_token_104|>",
916
+ "single_word": false,
917
+ "lstrip": false,
918
+ "rstrip": false,
919
+ "normalized": false,
920
+ "special": true
921
+ },
922
+ "128113": {
923
+ "content": "<|reserved_special_token_105|>",
924
+ "single_word": false,
925
+ "lstrip": false,
926
+ "rstrip": false,
927
+ "normalized": false,
928
+ "special": true
929
+ },
930
+ "128114": {
931
+ "content": "<|reserved_special_token_106|>",
932
+ "single_word": false,
933
+ "lstrip": false,
934
+ "rstrip": false,
935
+ "normalized": false,
936
+ "special": true
937
+ },
938
+ "128115": {
939
+ "content": "<|reserved_special_token_107|>",
940
+ "single_word": false,
941
+ "lstrip": false,
942
+ "rstrip": false,
943
+ "normalized": false,
944
+ "special": true
945
+ },
946
+ "128116": {
947
+ "content": "<|reserved_special_token_108|>",
948
+ "single_word": false,
949
+ "lstrip": false,
950
+ "rstrip": false,
951
+ "normalized": false,
952
+ "special": true
953
+ },
954
+ "128117": {
955
+ "content": "<|reserved_special_token_109|>",
956
+ "single_word": false,
957
+ "lstrip": false,
958
+ "rstrip": false,
959
+ "normalized": false,
960
+ "special": true
961
+ },
962
+ "128118": {
963
+ "content": "<|reserved_special_token_110|>",
964
+ "single_word": false,
965
+ "lstrip": false,
966
+ "rstrip": false,
967
+ "normalized": false,
968
+ "special": true
969
+ },
970
+ "128119": {
971
+ "content": "<|reserved_special_token_111|>",
972
+ "single_word": false,
973
+ "lstrip": false,
974
+ "rstrip": false,
975
+ "normalized": false,
976
+ "special": true
977
+ },
978
+ "128120": {
979
+ "content": "<|reserved_special_token_112|>",
980
+ "single_word": false,
981
+ "lstrip": false,
982
+ "rstrip": false,
983
+ "normalized": false,
984
+ "special": true
985
+ },
986
+ "128121": {
987
+ "content": "<|reserved_special_token_113|>",
988
+ "single_word": false,
989
+ "lstrip": false,
990
+ "rstrip": false,
991
+ "normalized": false,
992
+ "special": true
993
+ },
994
+ "128122": {
995
+ "content": "<|reserved_special_token_114|>",
996
+ "single_word": false,
997
+ "lstrip": false,
998
+ "rstrip": false,
999
+ "normalized": false,
1000
+ "special": true
1001
+ },
1002
+ "128123": {
1003
+ "content": "<|reserved_special_token_115|>",
1004
+ "single_word": false,
1005
+ "lstrip": false,
1006
+ "rstrip": false,
1007
+ "normalized": false,
1008
+ "special": true
1009
+ },
1010
+ "128124": {
1011
+ "content": "<|reserved_special_token_116|>",
1012
+ "single_word": false,
1013
+ "lstrip": false,
1014
+ "rstrip": false,
1015
+ "normalized": false,
1016
+ "special": true
1017
+ },
1018
+ "128125": {
1019
+ "content": "<|reserved_special_token_117|>",
1020
+ "single_word": false,
1021
+ "lstrip": false,
1022
+ "rstrip": false,
1023
+ "normalized": false,
1024
+ "special": true
1025
+ },
1026
+ "128126": {
1027
+ "content": "<|reserved_special_token_118|>",
1028
+ "single_word": false,
1029
+ "lstrip": false,
1030
+ "rstrip": false,
1031
+ "normalized": false,
1032
+ "special": true
1033
+ },
1034
+ "128127": {
1035
+ "content": "<|reserved_special_token_119|>",
1036
+ "single_word": false,
1037
+ "lstrip": false,
1038
+ "rstrip": false,
1039
+ "normalized": false,
1040
+ "special": true
1041
+ },
1042
+ "128128": {
1043
+ "content": "<|reserved_special_token_120|>",
1044
+ "single_word": false,
1045
+ "lstrip": false,
1046
+ "rstrip": false,
1047
+ "normalized": false,
1048
+ "special": true
1049
+ },
1050
+ "128129": {
1051
+ "content": "<|reserved_special_token_121|>",
1052
+ "single_word": false,
1053
+ "lstrip": false,
1054
+ "rstrip": false,
1055
+ "normalized": false,
1056
+ "special": true
1057
+ },
1058
+ "128130": {
1059
+ "content": "<|reserved_special_token_122|>",
1060
+ "single_word": false,
1061
+ "lstrip": false,
1062
+ "rstrip": false,
1063
+ "normalized": false,
1064
+ "special": true
1065
+ },
1066
+ "128131": {
1067
+ "content": "<|reserved_special_token_123|>",
1068
+ "single_word": false,
1069
+ "lstrip": false,
1070
+ "rstrip": false,
1071
+ "normalized": false,
1072
+ "special": true
1073
+ },
1074
+ "128132": {
1075
+ "content": "<|reserved_special_token_124|>",
1076
+ "single_word": false,
1077
+ "lstrip": false,
1078
+ "rstrip": false,
1079
+ "normalized": false,
1080
+ "special": true
1081
+ },
1082
+ "128133": {
1083
+ "content": "<|reserved_special_token_125|>",
1084
+ "single_word": false,
1085
+ "lstrip": false,
1086
+ "rstrip": false,
1087
+ "normalized": false,
1088
+ "special": true
1089
+ },
1090
+ "128134": {
1091
+ "content": "<|reserved_special_token_126|>",
1092
+ "single_word": false,
1093
+ "lstrip": false,
1094
+ "rstrip": false,
1095
+ "normalized": false,
1096
+ "special": true
1097
+ },
1098
+ "128135": {
1099
+ "content": "<|reserved_special_token_127|>",
1100
+ "single_word": false,
1101
+ "lstrip": false,
1102
+ "rstrip": false,
1103
+ "normalized": false,
1104
+ "special": true
1105
+ },
1106
+ "128136": {
1107
+ "content": "<|reserved_special_token_128|>",
1108
+ "single_word": false,
1109
+ "lstrip": false,
1110
+ "rstrip": false,
1111
+ "normalized": false,
1112
+ "special": true
1113
+ },
1114
+ "128137": {
1115
+ "content": "<|reserved_special_token_129|>",
1116
+ "single_word": false,
1117
+ "lstrip": false,
1118
+ "rstrip": false,
1119
+ "normalized": false,
1120
+ "special": true
1121
+ },
1122
+ "128138": {
1123
+ "content": "<|reserved_special_token_130|>",
1124
+ "single_word": false,
1125
+ "lstrip": false,
1126
+ "rstrip": false,
1127
+ "normalized": false,
1128
+ "special": true
1129
+ },
1130
+ "128139": {
1131
+ "content": "<|reserved_special_token_131|>",
1132
+ "single_word": false,
1133
+ "lstrip": false,
1134
+ "rstrip": false,
1135
+ "normalized": false,
1136
+ "special": true
1137
+ },
1138
+ "128140": {
1139
+ "content": "<|reserved_special_token_132|>",
1140
+ "single_word": false,
1141
+ "lstrip": false,
1142
+ "rstrip": false,
1143
+ "normalized": false,
1144
+ "special": true
1145
+ },
1146
+ "128141": {
1147
+ "content": "<|reserved_special_token_133|>",
1148
+ "single_word": false,
1149
+ "lstrip": false,
1150
+ "rstrip": false,
1151
+ "normalized": false,
1152
+ "special": true
1153
+ },
1154
+ "128142": {
1155
+ "content": "<|reserved_special_token_134|>",
1156
+ "single_word": false,
1157
+ "lstrip": false,
1158
+ "rstrip": false,
1159
+ "normalized": false,
1160
+ "special": true
1161
+ },
1162
+ "128143": {
1163
+ "content": "<|reserved_special_token_135|>",
1164
+ "single_word": false,
1165
+ "lstrip": false,
1166
+ "rstrip": false,
1167
+ "normalized": false,
1168
+ "special": true
1169
+ },
1170
+ "128144": {
1171
+ "content": "<|reserved_special_token_136|>",
1172
+ "single_word": false,
1173
+ "lstrip": false,
1174
+ "rstrip": false,
1175
+ "normalized": false,
1176
+ "special": true
1177
+ },
1178
+ "128145": {
1179
+ "content": "<|reserved_special_token_137|>",
1180
+ "single_word": false,
1181
+ "lstrip": false,
1182
+ "rstrip": false,
1183
+ "normalized": false,
1184
+ "special": true
1185
+ },
1186
+ "128146": {
1187
+ "content": "<|reserved_special_token_138|>",
1188
+ "single_word": false,
1189
+ "lstrip": false,
1190
+ "rstrip": false,
1191
+ "normalized": false,
1192
+ "special": true
1193
+ },
1194
+ "128147": {
1195
+ "content": "<|reserved_special_token_139|>",
1196
+ "single_word": false,
1197
+ "lstrip": false,
1198
+ "rstrip": false,
1199
+ "normalized": false,
1200
+ "special": true
1201
+ },
1202
+ "128148": {
1203
+ "content": "<|reserved_special_token_140|>",
1204
+ "single_word": false,
1205
+ "lstrip": false,
1206
+ "rstrip": false,
1207
+ "normalized": false,
1208
+ "special": true
1209
+ },
1210
+ "128149": {
1211
+ "content": "<|reserved_special_token_141|>",
1212
+ "single_word": false,
1213
+ "lstrip": false,
1214
+ "rstrip": false,
1215
+ "normalized": false,
1216
+ "special": true
1217
+ },
1218
+ "128150": {
1219
+ "content": "<|reserved_special_token_142|>",
1220
+ "single_word": false,
1221
+ "lstrip": false,
1222
+ "rstrip": false,
1223
+ "normalized": false,
1224
+ "special": true
1225
+ },
1226
+ "128151": {
1227
+ "content": "<|reserved_special_token_143|>",
1228
+ "single_word": false,
1229
+ "lstrip": false,
1230
+ "rstrip": false,
1231
+ "normalized": false,
1232
+ "special": true
1233
+ },
1234
+ "128152": {
1235
+ "content": "<|reserved_special_token_144|>",
1236
+ "single_word": false,
1237
+ "lstrip": false,
1238
+ "rstrip": false,
1239
+ "normalized": false,
1240
+ "special": true
1241
+ },
1242
+ "128153": {
1243
+ "content": "<|reserved_special_token_145|>",
1244
+ "single_word": false,
1245
+ "lstrip": false,
1246
+ "rstrip": false,
1247
+ "normalized": false,
1248
+ "special": true
1249
+ },
1250
+ "128154": {
1251
+ "content": "<|reserved_special_token_146|>",
1252
+ "single_word": false,
1253
+ "lstrip": false,
1254
+ "rstrip": false,
1255
+ "normalized": false,
1256
+ "special": true
1257
+ },
1258
+ "128155": {
1259
+ "content": "<|reserved_special_token_147|>",
1260
+ "single_word": false,
1261
+ "lstrip": false,
1262
+ "rstrip": false,
1263
+ "normalized": false,
1264
+ "special": true
1265
+ },
1266
+ "128156": {
1267
+ "content": "<|reserved_special_token_148|>",
1268
+ "single_word": false,
1269
+ "lstrip": false,
1270
+ "rstrip": false,
1271
+ "normalized": false,
1272
+ "special": true
1273
+ },
1274
+ "128157": {
1275
+ "content": "<|reserved_special_token_149|>",
1276
+ "single_word": false,
1277
+ "lstrip": false,
1278
+ "rstrip": false,
1279
+ "normalized": false,
1280
+ "special": true
1281
+ },
1282
+ "128158": {
1283
+ "content": "<|reserved_special_token_150|>",
1284
+ "single_word": false,
1285
+ "lstrip": false,
1286
+ "rstrip": false,
1287
+ "normalized": false,
1288
+ "special": true
1289
+ },
1290
+ "128159": {
1291
+ "content": "<|reserved_special_token_151|>",
1292
+ "single_word": false,
1293
+ "lstrip": false,
1294
+ "rstrip": false,
1295
+ "normalized": false,
1296
+ "special": true
1297
+ },
1298
+ "128160": {
1299
+ "content": "<|reserved_special_token_152|>",
1300
+ "single_word": false,
1301
+ "lstrip": false,
1302
+ "rstrip": false,
1303
+ "normalized": false,
1304
+ "special": true
1305
+ },
1306
+ "128161": {
1307
+ "content": "<|reserved_special_token_153|>",
1308
+ "single_word": false,
1309
+ "lstrip": false,
1310
+ "rstrip": false,
1311
+ "normalized": false,
1312
+ "special": true
1313
+ },
1314
+ "128162": {
1315
+ "content": "<|reserved_special_token_154|>",
1316
+ "single_word": false,
1317
+ "lstrip": false,
1318
+ "rstrip": false,
1319
+ "normalized": false,
1320
+ "special": true
1321
+ },
1322
+ "128163": {
1323
+ "content": "<|reserved_special_token_155|>",
1324
+ "single_word": false,
1325
+ "lstrip": false,
1326
+ "rstrip": false,
1327
+ "normalized": false,
1328
+ "special": true
1329
+ },
1330
+ "128164": {
1331
+ "content": "<|reserved_special_token_156|>",
1332
+ "single_word": false,
1333
+ "lstrip": false,
1334
+ "rstrip": false,
1335
+ "normalized": false,
1336
+ "special": true
1337
+ },
1338
+ "128165": {
1339
+ "content": "<|reserved_special_token_157|>",
1340
+ "single_word": false,
1341
+ "lstrip": false,
1342
+ "rstrip": false,
1343
+ "normalized": false,
1344
+ "special": true
1345
+ },
1346
+ "128166": {
1347
+ "content": "<|reserved_special_token_158|>",
1348
+ "single_word": false,
1349
+ "lstrip": false,
1350
+ "rstrip": false,
1351
+ "normalized": false,
1352
+ "special": true
1353
+ },
1354
+ "128167": {
1355
+ "content": "<|reserved_special_token_159|>",
1356
+ "single_word": false,
1357
+ "lstrip": false,
1358
+ "rstrip": false,
1359
+ "normalized": false,
1360
+ "special": true
1361
+ },
1362
+ "128168": {
1363
+ "content": "<|reserved_special_token_160|>",
1364
+ "single_word": false,
1365
+ "lstrip": false,
1366
+ "rstrip": false,
1367
+ "normalized": false,
1368
+ "special": true
1369
+ },
1370
+ "128169": {
1371
+ "content": "<|reserved_special_token_161|>",
1372
+ "single_word": false,
1373
+ "lstrip": false,
1374
+ "rstrip": false,
1375
+ "normalized": false,
1376
+ "special": true
1377
+ },
1378
+ "128170": {
1379
+ "content": "<|reserved_special_token_162|>",
1380
+ "single_word": false,
1381
+ "lstrip": false,
1382
+ "rstrip": false,
1383
+ "normalized": false,
1384
+ "special": true
1385
+ },
1386
+ "128171": {
1387
+ "content": "<|reserved_special_token_163|>",
1388
+ "single_word": false,
1389
+ "lstrip": false,
1390
+ "rstrip": false,
1391
+ "normalized": false,
1392
+ "special": true
1393
+ },
1394
+ "128172": {
1395
+ "content": "<|reserved_special_token_164|>",
1396
+ "single_word": false,
1397
+ "lstrip": false,
1398
+ "rstrip": false,
1399
+ "normalized": false,
1400
+ "special": true
1401
+ },
1402
+ "128173": {
1403
+ "content": "<|reserved_special_token_165|>",
1404
+ "single_word": false,
1405
+ "lstrip": false,
1406
+ "rstrip": false,
1407
+ "normalized": false,
1408
+ "special": true
1409
+ },
1410
+ "128174": {
1411
+ "content": "<|reserved_special_token_166|>",
1412
+ "single_word": false,
1413
+ "lstrip": false,
1414
+ "rstrip": false,
1415
+ "normalized": false,
1416
+ "special": true
1417
+ },
1418
+ "128175": {
1419
+ "content": "<|reserved_special_token_167|>",
1420
+ "single_word": false,
1421
+ "lstrip": false,
1422
+ "rstrip": false,
1423
+ "normalized": false,
1424
+ "special": true
1425
+ },
1426
+ "128176": {
1427
+ "content": "<|reserved_special_token_168|>",
1428
+ "single_word": false,
1429
+ "lstrip": false,
1430
+ "rstrip": false,
1431
+ "normalized": false,
1432
+ "special": true
1433
+ },
1434
+ "128177": {
1435
+ "content": "<|reserved_special_token_169|>",
1436
+ "single_word": false,
1437
+ "lstrip": false,
1438
+ "rstrip": false,
1439
+ "normalized": false,
1440
+ "special": true
1441
+ },
1442
+ "128178": {
1443
+ "content": "<|reserved_special_token_170|>",
1444
+ "single_word": false,
1445
+ "lstrip": false,
1446
+ "rstrip": false,
1447
+ "normalized": false,
1448
+ "special": true
1449
+ },
1450
+ "128179": {
1451
+ "content": "<|reserved_special_token_171|>",
1452
+ "single_word": false,
1453
+ "lstrip": false,
1454
+ "rstrip": false,
1455
+ "normalized": false,
1456
+ "special": true
1457
+ },
1458
+ "128180": {
1459
+ "content": "<|reserved_special_token_172|>",
1460
+ "single_word": false,
1461
+ "lstrip": false,
1462
+ "rstrip": false,
1463
+ "normalized": false,
1464
+ "special": true
1465
+ },
1466
+ "128181": {
1467
+ "content": "<|reserved_special_token_173|>",
1468
+ "single_word": false,
1469
+ "lstrip": false,
1470
+ "rstrip": false,
1471
+ "normalized": false,
1472
+ "special": true
1473
+ },
1474
+ "128182": {
1475
+ "content": "<|reserved_special_token_174|>",
1476
+ "single_word": false,
1477
+ "lstrip": false,
1478
+ "rstrip": false,
1479
+ "normalized": false,
1480
+ "special": true
1481
+ },
1482
+ "128183": {
1483
+ "content": "<|reserved_special_token_175|>",
1484
+ "single_word": false,
1485
+ "lstrip": false,
1486
+ "rstrip": false,
1487
+ "normalized": false,
1488
+ "special": true
1489
+ },
1490
+ "128184": {
1491
+ "content": "<|reserved_special_token_176|>",
1492
+ "single_word": false,
1493
+ "lstrip": false,
1494
+ "rstrip": false,
1495
+ "normalized": false,
1496
+ "special": true
1497
+ },
1498
+ "128185": {
1499
+ "content": "<|reserved_special_token_177|>",
1500
+ "single_word": false,
1501
+ "lstrip": false,
1502
+ "rstrip": false,
1503
+ "normalized": false,
1504
+ "special": true
1505
+ },
1506
+ "128186": {
1507
+ "content": "<|reserved_special_token_178|>",
1508
+ "single_word": false,
1509
+ "lstrip": false,
1510
+ "rstrip": false,
1511
+ "normalized": false,
1512
+ "special": true
1513
+ },
1514
+ "128187": {
1515
+ "content": "<|reserved_special_token_179|>",
1516
+ "single_word": false,
1517
+ "lstrip": false,
1518
+ "rstrip": false,
1519
+ "normalized": false,
1520
+ "special": true
1521
+ },
1522
+ "128188": {
1523
+ "content": "<|reserved_special_token_180|>",
1524
+ "single_word": false,
1525
+ "lstrip": false,
1526
+ "rstrip": false,
1527
+ "normalized": false,
1528
+ "special": true
1529
+ },
1530
+ "128189": {
1531
+ "content": "<|reserved_special_token_181|>",
1532
+ "single_word": false,
1533
+ "lstrip": false,
1534
+ "rstrip": false,
1535
+ "normalized": false,
1536
+ "special": true
1537
+ },
1538
+ "128190": {
1539
+ "content": "<|reserved_special_token_182|>",
1540
+ "single_word": false,
1541
+ "lstrip": false,
1542
+ "rstrip": false,
1543
+ "normalized": false,
1544
+ "special": true
1545
+ },
1546
+ "128191": {
1547
+ "content": "<|reserved_special_token_183|>",
1548
+ "single_word": false,
1549
+ "lstrip": false,
1550
+ "rstrip": false,
1551
+ "normalized": false,
1552
+ "special": true
1553
+ },
1554
+ "128192": {
1555
+ "content": "<|reserved_special_token_184|>",
1556
+ "single_word": false,
1557
+ "lstrip": false,
1558
+ "rstrip": false,
1559
+ "normalized": false,
1560
+ "special": true
1561
+ },
1562
+ "128193": {
1563
+ "content": "<|reserved_special_token_185|>",
1564
+ "single_word": false,
1565
+ "lstrip": false,
1566
+ "rstrip": false,
1567
+ "normalized": false,
1568
+ "special": true
1569
+ },
1570
+ "128194": {
1571
+ "content": "<|reserved_special_token_186|>",
1572
+ "single_word": false,
1573
+ "lstrip": false,
1574
+ "rstrip": false,
1575
+ "normalized": false,
1576
+ "special": true
1577
+ },
1578
+ "128195": {
1579
+ "content": "<|reserved_special_token_187|>",
1580
+ "single_word": false,
1581
+ "lstrip": false,
1582
+ "rstrip": false,
1583
+ "normalized": false,
1584
+ "special": true
1585
+ },
1586
+ "128196": {
1587
+ "content": "<|reserved_special_token_188|>",
1588
+ "single_word": false,
1589
+ "lstrip": false,
1590
+ "rstrip": false,
1591
+ "normalized": false,
1592
+ "special": true
1593
+ },
1594
+ "128197": {
1595
+ "content": "<|reserved_special_token_189|>",
1596
+ "single_word": false,
1597
+ "lstrip": false,
1598
+ "rstrip": false,
1599
+ "normalized": false,
1600
+ "special": true
1601
+ },
1602
+ "128198": {
1603
+ "content": "<|reserved_special_token_190|>",
1604
+ "single_word": false,
1605
+ "lstrip": false,
1606
+ "rstrip": false,
1607
+ "normalized": false,
1608
+ "special": true
1609
+ },
1610
+ "128199": {
1611
+ "content": "<|reserved_special_token_191|>",
1612
+ "single_word": false,
1613
+ "lstrip": false,
1614
+ "rstrip": false,
1615
+ "normalized": false,
1616
+ "special": true
1617
+ },
1618
+ "128200": {
1619
+ "content": "<|reserved_special_token_192|>",
1620
+ "single_word": false,
1621
+ "lstrip": false,
1622
+ "rstrip": false,
1623
+ "normalized": false,
1624
+ "special": true
1625
+ },
1626
+ "128201": {
1627
+ "content": "<|reserved_special_token_193|>",
1628
+ "single_word": false,
1629
+ "lstrip": false,
1630
+ "rstrip": false,
1631
+ "normalized": false,
1632
+ "special": true
1633
+ },
1634
+ "128202": {
1635
+ "content": "<|reserved_special_token_194|>",
1636
+ "single_word": false,
1637
+ "lstrip": false,
1638
+ "rstrip": false,
1639
+ "normalized": false,
1640
+ "special": true
1641
+ },
1642
+ "128203": {
1643
+ "content": "<|reserved_special_token_195|>",
1644
+ "single_word": false,
1645
+ "lstrip": false,
1646
+ "rstrip": false,
1647
+ "normalized": false,
1648
+ "special": true
1649
+ },
1650
+ "128204": {
1651
+ "content": "<|reserved_special_token_196|>",
1652
+ "single_word": false,
1653
+ "lstrip": false,
1654
+ "rstrip": false,
1655
+ "normalized": false,
1656
+ "special": true
1657
+ },
1658
+ "128205": {
1659
+ "content": "<|reserved_special_token_197|>",
1660
+ "single_word": false,
1661
+ "lstrip": false,
1662
+ "rstrip": false,
1663
+ "normalized": false,
1664
+ "special": true
1665
+ },
1666
+ "128206": {
1667
+ "content": "<|reserved_special_token_198|>",
1668
+ "single_word": false,
1669
+ "lstrip": false,
1670
+ "rstrip": false,
1671
+ "normalized": false,
1672
+ "special": true
1673
+ },
1674
+ "128207": {
1675
+ "content": "<|reserved_special_token_199|>",
1676
+ "single_word": false,
1677
+ "lstrip": false,
1678
+ "rstrip": false,
1679
+ "normalized": false,
1680
+ "special": true
1681
+ },
1682
+ "128208": {
1683
+ "content": "<|reserved_special_token_200|>",
1684
+ "single_word": false,
1685
+ "lstrip": false,
1686
+ "rstrip": false,
1687
+ "normalized": false,
1688
+ "special": true
1689
+ },
1690
+ "128209": {
1691
+ "content": "<|reserved_special_token_201|>",
1692
+ "single_word": false,
1693
+ "lstrip": false,
1694
+ "rstrip": false,
1695
+ "normalized": false,
1696
+ "special": true
1697
+ },
1698
+ "128210": {
1699
+ "content": "<|reserved_special_token_202|>",
1700
+ "single_word": false,
1701
+ "lstrip": false,
1702
+ "rstrip": false,
1703
+ "normalized": false,
1704
+ "special": true
1705
+ },
1706
+ "128211": {
1707
+ "content": "<|reserved_special_token_203|>",
1708
+ "single_word": false,
1709
+ "lstrip": false,
1710
+ "rstrip": false,
1711
+ "normalized": false,
1712
+ "special": true
1713
+ },
1714
+ "128212": {
1715
+ "content": "<|reserved_special_token_204|>",
1716
+ "single_word": false,
1717
+ "lstrip": false,
1718
+ "rstrip": false,
1719
+ "normalized": false,
1720
+ "special": true
1721
+ },
1722
+ "128213": {
1723
+ "content": "<|reserved_special_token_205|>",
1724
+ "single_word": false,
1725
+ "lstrip": false,
1726
+ "rstrip": false,
1727
+ "normalized": false,
1728
+ "special": true
1729
+ },
1730
+ "128214": {
1731
+ "content": "<|reserved_special_token_206|>",
1732
+ "single_word": false,
1733
+ "lstrip": false,
1734
+ "rstrip": false,
1735
+ "normalized": false,
1736
+ "special": true
1737
+ },
1738
+ "128215": {
1739
+ "content": "<|reserved_special_token_207|>",
1740
+ "single_word": false,
1741
+ "lstrip": false,
1742
+ "rstrip": false,
1743
+ "normalized": false,
1744
+ "special": true
1745
+ },
1746
+ "128216": {
1747
+ "content": "<|reserved_special_token_208|>",
1748
+ "single_word": false,
1749
+ "lstrip": false,
1750
+ "rstrip": false,
1751
+ "normalized": false,
1752
+ "special": true
1753
+ },
1754
+ "128217": {
1755
+ "content": "<|reserved_special_token_209|>",
1756
+ "single_word": false,
1757
+ "lstrip": false,
1758
+ "rstrip": false,
1759
+ "normalized": false,
1760
+ "special": true
1761
+ },
1762
+ "128218": {
1763
+ "content": "<|reserved_special_token_210|>",
1764
+ "single_word": false,
1765
+ "lstrip": false,
1766
+ "rstrip": false,
1767
+ "normalized": false,
1768
+ "special": true
1769
+ },
1770
+ "128219": {
1771
+ "content": "<|reserved_special_token_211|>",
1772
+ "single_word": false,
1773
+ "lstrip": false,
1774
+ "rstrip": false,
1775
+ "normalized": false,
1776
+ "special": true
1777
+ },
1778
+ "128220": {
1779
+ "content": "<|reserved_special_token_212|>",
1780
+ "single_word": false,
1781
+ "lstrip": false,
1782
+ "rstrip": false,
1783
+ "normalized": false,
1784
+ "special": true
1785
+ },
1786
+ "128221": {
1787
+ "content": "<|reserved_special_token_213|>",
1788
+ "single_word": false,
1789
+ "lstrip": false,
1790
+ "rstrip": false,
1791
+ "normalized": false,
1792
+ "special": true
1793
+ },
1794
+ "128222": {
1795
+ "content": "<|reserved_special_token_214|>",
1796
+ "single_word": false,
1797
+ "lstrip": false,
1798
+ "rstrip": false,
1799
+ "normalized": false,
1800
+ "special": true
1801
+ },
1802
+ "128223": {
1803
+ "content": "<|reserved_special_token_215|>",
1804
+ "single_word": false,
1805
+ "lstrip": false,
1806
+ "rstrip": false,
1807
+ "normalized": false,
1808
+ "special": true
1809
+ },
1810
+ "128224": {
1811
+ "content": "<|reserved_special_token_216|>",
1812
+ "single_word": false,
1813
+ "lstrip": false,
1814
+ "rstrip": false,
1815
+ "normalized": false,
1816
+ "special": true
1817
+ },
1818
+ "128225": {
1819
+ "content": "<|reserved_special_token_217|>",
1820
+ "single_word": false,
1821
+ "lstrip": false,
1822
+ "rstrip": false,
1823
+ "normalized": false,
1824
+ "special": true
1825
+ },
1826
+ "128226": {
1827
+ "content": "<|reserved_special_token_218|>",
1828
+ "single_word": false,
1829
+ "lstrip": false,
1830
+ "rstrip": false,
1831
+ "normalized": false,
1832
+ "special": true
1833
+ },
1834
+ "128227": {
1835
+ "content": "<|reserved_special_token_219|>",
1836
+ "single_word": false,
1837
+ "lstrip": false,
1838
+ "rstrip": false,
1839
+ "normalized": false,
1840
+ "special": true
1841
+ },
1842
+ "128228": {
1843
+ "content": "<|reserved_special_token_220|>",
1844
+ "single_word": false,
1845
+ "lstrip": false,
1846
+ "rstrip": false,
1847
+ "normalized": false,
1848
+ "special": true
1849
+ },
1850
+ "128229": {
1851
+ "content": "<|reserved_special_token_221|>",
1852
+ "single_word": false,
1853
+ "lstrip": false,
1854
+ "rstrip": false,
1855
+ "normalized": false,
1856
+ "special": true
1857
+ },
1858
+ "128230": {
1859
+ "content": "<|reserved_special_token_222|>",
1860
+ "single_word": false,
1861
+ "lstrip": false,
1862
+ "rstrip": false,
1863
+ "normalized": false,
1864
+ "special": true
1865
+ },
1866
+ "128231": {
1867
+ "content": "<|reserved_special_token_223|>",
1868
+ "single_word": false,
1869
+ "lstrip": false,
1870
+ "rstrip": false,
1871
+ "normalized": false,
1872
+ "special": true
1873
+ },
1874
+ "128232": {
1875
+ "content": "<|reserved_special_token_224|>",
1876
+ "single_word": false,
1877
+ "lstrip": false,
1878
+ "rstrip": false,
1879
+ "normalized": false,
1880
+ "special": true
1881
+ },
1882
+ "128233": {
1883
+ "content": "<|reserved_special_token_225|>",
1884
+ "single_word": false,
1885
+ "lstrip": false,
1886
+ "rstrip": false,
1887
+ "normalized": false,
1888
+ "special": true
1889
+ },
1890
+ "128234": {
1891
+ "content": "<|reserved_special_token_226|>",
1892
+ "single_word": false,
1893
+ "lstrip": false,
1894
+ "rstrip": false,
1895
+ "normalized": false,
1896
+ "special": true
1897
+ },
1898
+ "128235": {
1899
+ "content": "<|reserved_special_token_227|>",
1900
+ "single_word": false,
1901
+ "lstrip": false,
1902
+ "rstrip": false,
1903
+ "normalized": false,
1904
+ "special": true
1905
+ },
1906
+ "128236": {
1907
+ "content": "<|reserved_special_token_228|>",
1908
+ "single_word": false,
1909
+ "lstrip": false,
1910
+ "rstrip": false,
1911
+ "normalized": false,
1912
+ "special": true
1913
+ },
1914
+ "128237": {
1915
+ "content": "<|reserved_special_token_229|>",
1916
+ "single_word": false,
1917
+ "lstrip": false,
1918
+ "rstrip": false,
1919
+ "normalized": false,
1920
+ "special": true
1921
+ },
1922
+ "128238": {
1923
+ "content": "<|reserved_special_token_230|>",
1924
+ "single_word": false,
1925
+ "lstrip": false,
1926
+ "rstrip": false,
1927
+ "normalized": false,
1928
+ "special": true
1929
+ },
1930
+ "128239": {
1931
+ "content": "<|reserved_special_token_231|>",
1932
+ "single_word": false,
1933
+ "lstrip": false,
1934
+ "rstrip": false,
1935
+ "normalized": false,
1936
+ "special": true
1937
+ },
1938
+ "128240": {
1939
+ "content": "<|reserved_special_token_232|>",
1940
+ "single_word": false,
1941
+ "lstrip": false,
1942
+ "rstrip": false,
1943
+ "normalized": false,
1944
+ "special": true
1945
+ },
1946
+ "128241": {
1947
+ "content": "<|reserved_special_token_233|>",
1948
+ "single_word": false,
1949
+ "lstrip": false,
1950
+ "rstrip": false,
1951
+ "normalized": false,
1952
+ "special": true
1953
+ },
1954
+ "128242": {
1955
+ "content": "<|reserved_special_token_234|>",
1956
+ "single_word": false,
1957
+ "lstrip": false,
1958
+ "rstrip": false,
1959
+ "normalized": false,
1960
+ "special": true
1961
+ },
1962
+ "128243": {
1963
+ "content": "<|reserved_special_token_235|>",
1964
+ "single_word": false,
1965
+ "lstrip": false,
1966
+ "rstrip": false,
1967
+ "normalized": false,
1968
+ "special": true
1969
+ },
1970
+ "128244": {
1971
+ "content": "<|reserved_special_token_236|>",
1972
+ "single_word": false,
1973
+ "lstrip": false,
1974
+ "rstrip": false,
1975
+ "normalized": false,
1976
+ "special": true
1977
+ },
1978
+ "128245": {
1979
+ "content": "<|reserved_special_token_237|>",
1980
+ "single_word": false,
1981
+ "lstrip": false,
1982
+ "rstrip": false,
1983
+ "normalized": false,
1984
+ "special": true
1985
+ },
1986
+ "128246": {
1987
+ "content": "<|reserved_special_token_238|>",
1988
+ "single_word": false,
1989
+ "lstrip": false,
1990
+ "rstrip": false,
1991
+ "normalized": false,
1992
+ "special": true
1993
+ },
1994
+ "128247": {
1995
+ "content": "<|reserved_special_token_239|>",
1996
+ "single_word": false,
1997
+ "lstrip": false,
1998
+ "rstrip": false,
1999
+ "normalized": false,
2000
+ "special": true
2001
+ },
2002
+ "128248": {
2003
+ "content": "<|reserved_special_token_240|>",
2004
+ "single_word": false,
2005
+ "lstrip": false,
2006
+ "rstrip": false,
2007
+ "normalized": false,
2008
+ "special": true
2009
+ },
2010
+ "128249": {
2011
+ "content": "<|reserved_special_token_241|>",
2012
+ "single_word": false,
2013
+ "lstrip": false,
2014
+ "rstrip": false,
2015
+ "normalized": false,
2016
+ "special": true
2017
+ },
2018
+ "128250": {
2019
+ "content": "<|reserved_special_token_242|>",
2020
+ "single_word": false,
2021
+ "lstrip": false,
2022
+ "rstrip": false,
2023
+ "normalized": false,
2024
+ "special": true
2025
+ },
2026
+ "128251": {
2027
+ "content": "<|reserved_special_token_243|>",
2028
+ "single_word": false,
2029
+ "lstrip": false,
2030
+ "rstrip": false,
2031
+ "normalized": false,
2032
+ "special": true
2033
+ },
2034
+ "128252": {
2035
+ "content": "<|reserved_special_token_244|>",
2036
+ "single_word": false,
2037
+ "lstrip": false,
2038
+ "rstrip": false,
2039
+ "normalized": false,
2040
+ "special": true
2041
+ },
2042
+ "128253": {
2043
+ "content": "<|reserved_special_token_245|>",
2044
+ "single_word": false,
2045
+ "lstrip": false,
2046
+ "rstrip": false,
2047
+ "normalized": false,
2048
+ "special": true
2049
+ },
2050
+ "128254": {
2051
+ "content": "<|reserved_special_token_246|>",
2052
+ "single_word": false,
2053
+ "lstrip": false,
2054
+ "rstrip": false,
2055
+ "normalized": false,
2056
+ "special": true
2057
+ },
2058
+ "128255": {
2059
+ "content": "<|reserved_special_token_247|>",
2060
+ "single_word": false,
2061
+ "lstrip": false,
2062
+ "rstrip": false,
2063
+ "normalized": false,
2064
+ "special": true
2065
+ }
2066
+ }
2067
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:490c9f2d364265efaf4ac009c18b7debb1b6c52020fa2283c8aa0c912712d7c2
3
+ size 5841