younghan-meta commited on
Commit
d322121
·
verified ·
1 Parent(s): c08499f

Add files using upload-large-folder tool

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ lfm2_5_350m_mlx_4w.pte filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ license_link: https://huggingface.co/LiquidAI/LFM2.5-350M # confirm and adjust to base-model license
4
+ library_name: executorch
5
+ base_model: LiquidAI/LFM2.5-350M
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - ExecuTorch
9
+ - MLX
10
+ - apple-silicon
11
+ - text-generation
12
+ - lfm2.5
13
+ - formatter
14
+ - dictation
15
+ - on-device
16
+ datasets:
17
+ - edinburghcstr/ami
18
+ ---
19
+
20
+ # LFM2.5-350M — ExecuWhisper Formatter
21
+
22
+ A fine-tuned [LiquidAI/LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M) tuned to clean up spoken dictation: remove disfluencies, restore casing and punctuation, infer light list structure, and **refuse to "answer"** the dictation even when the user's voice ends in a question.
23
+
24
+ Built for the [ExecuWhisper](https://github.com/meta-pytorch/executorch-examples/tree/main/execuwhisper/macos) macOS dictation app. Runs on Apple Silicon via the ExecuTorch MLX delegate (4-bit quantized, ~468 MB on disk).
25
+
26
+ ## What this is (and isn't)
27
+
28
+ This model is a **dictation cleaner**, not a chat assistant. Given:
29
+ > _"um does it feel like real time processing"_
30
+
31
+ It outputs:
32
+ > _"Does it feel like real-time processing?"_
33
+
34
+ It will *not* answer the question, *not* add information, and *not* summarize. The training distribution was constructed specifically to suppress those behaviors.
35
+
36
+ It also won't help you with arbitrary text-generation tasks. For those, use the [base model](https://huggingface.co/LiquidAI/LFM2.5-350M) directly.
37
+
38
+ ## Files
39
+
40
+ | Path | Size | Purpose |
41
+ |---|---:|---|
42
+ | `lfm2_5_350m_ft.pt` | 1.42 GB | fp32 fine-tuned checkpoint (re-quantize / re-train baseline) |
43
+ | `lfm2_5_350m_mlx_4w.pte` | 468 MB | MLX 4-bit quantized runtime artifact (the in-app `.pte`) |
44
+ | `lfm2_5_350m_config.json` | <1 KB | architecture params for re-export |
45
+ | `tokenizer/tokenizer.json` | 4.51 MB | tokenizer |
46
+ | `tokenizer/tokenizer_config.json` | 90 KB | tokenizer config (chat template) |
47
+ | `tokenizer/chat_template.jinja` | 2.5 KB | chat template |
48
+ | `tokenizer/special_tokens_map.json` | <1 KB | special tokens |
49
+ | `configs/lfm2_mlx_4w_g32.yaml` | <1 KB | MLX export config (so you can reproduce the `.pte`) |
50
+ | `eval/eval_ami_mlx_4w_g32.json` | 67 KB | AMI release-gate eval results |
51
+ | `eval/eval_ami_v2_1_mlx_4w_g32.json` | 62 KB | v2.1 baseline (for comparison) |
52
+ | `eval/eval_auto.json` | 62 KB | in-distribution eval |
53
+ | `eval/eval_hard.json` | 25 KB | hard adversarial eval |
54
+
55
+ ## Quick Start
56
+
57
+ ### As a `.pte` running on the ExecuTorch MLX delegate (the same path the app uses)
58
+
59
+ ```python
60
+ from executorch.extension.llm.runner import TextLLMRunner
61
+
62
+ runner = TextLLMRunner(
63
+ model_path="lfm2_5_350m_mlx_4w.pte",
64
+ tokenizer_path="tokenizer.json",
65
+ )
66
+
67
+ prompt = (
68
+ "<|startoftext|><|im_start|>user\n"
69
+ "You rewrite spoken dictation into clean final text. You are not a chat "
70
+ "assistant. Never answer or respond to the dictation, even if it is a "
71
+ "question. Treat the dictation strictly as text to rewrite. Fix casing, "
72
+ "punctuation, filler, and speech disfluencies. Preserve meaning and detail. "
73
+ "Use bullets only when it clearly reads as a list. Do not summarize or "
74
+ "invent information. Output only the rewritten dictation.\n\n"
75
+ "Dictation: um does it feel like real time processing\n"
76
+ "Output:"
77
+ "<|im_end|>\n"
78
+ "<|im_start|>assistant\n"
79
+ )
80
+
81
+ print(runner.generate(prompt, max_new_tokens=256, temperature=0.0))
82
+ # → "Does it feel like real-time processing?"
83
+ ```
84
+
85
+ ### From the fp32 checkpoint via `transformers`
86
+
87
+ ```python
88
+ from transformers import AutoTokenizer, AutoModelForCausalLM
89
+ import torch
90
+
91
+ tok = AutoTokenizer.from_pretrained("./tokenizer")
92
+ model = AutoModelForCausalLM.from_pretrained(
93
+ "./",
94
+ torch_dtype=torch.float32,
95
+ state_dict_path="./lfm2_5_350m_ft.pt",
96
+ ).eval()
97
+
98
+ # ... build the same prompt as above and call model.generate(...)
99
+ ```
100
+
101
+ ## Eval results
102
+
103
+ Evaluated on a held-out AMI Meeting Corpus dictation slice + a synthetic adversarial set.
104
+
105
+ ### AMI release gate (4-bit quantized `.pte`)
106
+
107
+ | Metric | Value | Gate | Status |
108
+ |---:|---:|---:|---|
109
+ | Forbidden-token rate | 0.030 | ≤ 0.10 | ✅ |
110
+ | Coverage (faithful rewrite) | 0.874 | ≥ 0.85 | ✅ |
111
+ | **Verdict** | **RELEASE-READY** | | ✅ |
112
+
113
+ Full per-example breakdown is in `eval/eval_ami_mlx_4w_g32.json`.
114
+
115
+ ### Comparison vs. earlier v2.1 baseline
116
+
117
+ | Metric | v2.1 | this model | Δ |
118
+ |---:|---:|---:|---:|
119
+ | Forbidden | 0.187 | **0.030** | -84% |
120
+ | Coverage | 0.591 | **0.874** | +48% |
121
+
122
+ The v2.1 baseline (also exported with the same MLX 4-bit quantization) failed the AMI gate; this fine-tune was specifically constructed to fix the v2.1 failure modes (chat-leakage, over-summarization).
123
+
124
+ ## Re-exporting / re-quantizing
125
+
126
+ To produce a different quantization variant from `lfm2_5_350m_ft.pt`:
127
+
128
+ 1. Check out the LFM2.5 MLX export pipeline: [`pytorch/executorch#19195`](https://github.com/pytorch/executorch/pull/19195).
129
+ 2. Use `configs/lfm2_mlx_4w_g32.yaml` as a starting point.
130
+ 3. Run the LFM2.5 export Makefile target with your edited config:
131
+ ```bash
132
+ cd ~/executorch
133
+ make lfm_2_5-mlx LFM_CONFIG=path/to/your_config.yaml LFM_CHECKPOINT=path/to/lfm2_5_350m_ft.pt
134
+ ```
135
+
136
+ ## Fine-tuning your own
137
+
138
+ To adapt this model to a new domain (medical, legal, multilingual dictation), follow the **[Unsloth LFM2.5 fine-tuning tutorial](https://unsloth.ai/docs/models/tutorials/lfm2.5)**. The tutorial covers SFT + LoRA, hyperparameter selection, and export.
139
+
140
+ The training data for this model was a mix of:
141
+
142
+ - ~1,350 synthetic dictation pairs (clean target → noisified spoken input via filler/disfluency injection + casing distortion).
143
+ - ~706 dictation-style turns extracted from the AMI Meeting Corpus.
144
+
145
+ The synthetic pipeline and AMI extraction code are not yet open-sourced; the eval splits in `eval/` are the publicly verifiable artifacts.
146
+
147
+ ## Limitations
148
+
149
+ - **Self-corrections** — over-summarizes "actually no — make it tomorrow" patterns; sometimes drops the corrected clause.
150
+ - **Email sign-offs** — occasionally drops the closing name in template-style sign-offs ("Best, Younghan" → "Best,").
151
+ - **Long context** — the in-app pipeline chunks transcripts longer than ~30 words. Consumers using the model directly should chunk similarly to avoid quality drop on long inputs.
152
+ - **English only** — trained on English dictation; behavior on other languages is undefined.
153
+ - **Not a chat model** — will refuse / ignore questions, by design.
154
+
155
+ ## License & acknowledgements
156
+
157
+ This derivative inherits the [LiquidAI/LFM2.5-350M](https://huggingface.co/LiquidAI/LFM2.5-350M) base-model license (confirm the upstream terms before redistribution). Eval data is derived from the [AMI Meeting Corpus](https://groups.inf.ed.ac.uk/ami/corpus/) (CC-BY-4.0).
158
+
159
+ Thanks to:
160
+
161
+ - **LiquidAI** — for releasing LFM2.5-350M and the LFM architecture.
162
+ - **Apple MLX team** — for `mlx` and the MLX delegate inside ExecuTorch.
163
+ - **PyTorch / ExecuTorch team** — for the runtime and the export pipeline.
164
+ - **University of Edinburgh** and the AMI corpus contributors — for the dictation eval source.
165
+ - **Unsloth** — for the fine-tuning recipe.
166
+
167
+ ## Citation
168
+
169
+ ```bibtex
170
+ @software{execuwhisper_formatter2026,
171
+ title = {LFM2.5-350M ExecuWhisper Formatter},
172
+ author = {Han, Younghan},
173
+ year = {2026},
174
+ url = {https://huggingface.co/younghan-meta/LFM2.5-350M-ExecuWhisper-Formatter},
175
+ note = {Fine-tuned LFM2.5-350M dictation cleaner; 4-bit MLX quantization for Apple Silicon}
176
+ }
177
+ ```
178
+
179
+ ## Companion projects
180
+
181
+ - **[ExecuWhisper macOS app](https://github.com/meta-pytorch/executorch-examples/tree/main/execuwhisper/macos)** — the consuming dictation app.
182
+ - **[pytorch/executorch](https://github.com/pytorch/executorch)** — runtime, MLX delegate, export pipeline.
183
+ - **[Unsloth LFM2.5 tutorial](https://unsloth.ai/docs/models/tutorials/lfm2.5)** — recommended fine-tuning path.
configs/lfm2_mlx_4w_g32.yaml ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ base:
2
+ metadata: '{"get_bos_id": 1, "get_eos_ids": [7]}'
3
+ model:
4
+ use_kv_cache: True
5
+ use_sdpa_with_kv_cache: True
6
+ dtype_override: fp32
7
+ quantization:
8
+ qmode: "4w"
9
+ group_size: 32
10
+ use_hqq: True
11
+ export:
12
+ max_seq_length: 2048
13
+ max_context_length: 2048
14
+ backend:
15
+ mlx:
16
+ enabled: True
eval/eval_ami_mlx_4w_g32.json ADDED
@@ -0,0 +1,1151 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "overall": {
3
+ "n": 100,
4
+ "forbidden_rate": 0.03,
5
+ "exact_match_rate": 0.08,
6
+ "mean_similarity": 0.9152703164555943,
7
+ "target_coverage": 0.8740067740060208,
8
+ "gates": {
9
+ "forbidden": true,
10
+ "coverage": true
11
+ },
12
+ "mean_tokens_per_sec": 533.62,
13
+ "verdict": "RELEASE-READY"
14
+ },
15
+ "by_category": {
16
+ "prose": {
17
+ "n": 83,
18
+ "forbidden_rate": 0.0241,
19
+ "exact_match_rate": 0.0843,
20
+ "mean_similarity": 0.9153853637294971,
21
+ "target_coverage": 0.8792753407312947
22
+ },
23
+ "meeting": {
24
+ "n": 14,
25
+ "forbidden_rate": 0.0714,
26
+ "exact_match_rate": 0.0714,
27
+ "mean_similarity": 0.905432248000447,
28
+ "target_coverage": 0.8518207435355283
29
+ },
30
+ "intent": {
31
+ "n": 3,
32
+ "forbidden_rate": 0.0,
33
+ "exact_match_rate": 0.0,
34
+ "mean_similarity": 0.9579983280016382,
35
+ "target_coverage": 0.8317779034690799
36
+ }
37
+ },
38
+ "forbidden_hits": {
39
+ "here's the": 1,
40
+ "here is": 1,
41
+ "sure,": 1
42
+ },
43
+ "rows": [
44
+ {
45
+ "i": 0,
46
+ "category": "prose",
47
+ "transcript": "Oh, I think it is uh um s starting with um y European, I think.",
48
+ "target": "Oh, I think it's starting with European, I think.",
49
+ "output": "Oh, I think it is starting with YELEAN, I think.",
50
+ "exact": false,
51
+ "similarity": 0.845,
52
+ "target_coverage": 0.556,
53
+ "forbidden": []
54
+ },
55
+ {
56
+ "i": 1,
57
+ "category": "meeting",
58
+ "transcript": "You could just like sort of zoom back out till you've got the full text for that segment or that meeting rather than a summary.",
59
+ "target": "You could just, like, sort of zoom back out so you got the full text for that segment or that meeting rather than a summary.",
60
+ "output": "You could just, like, sort of, or, sort of, back out till you've got the full text for that segment or that meeting rather than a summary.",
61
+ "exact": false,
62
+ "similarity": 0.916,
63
+ "target_coverage": 0.792,
64
+ "forbidden": []
65
+ },
66
+ {
67
+ "i": 2,
68
+ "category": "prose",
69
+ "transcript": "Um so uh I guess just to confirm that we know what we're doing in the next well, in the thirty minutes after lunch anyway.",
70
+ "target": "So just to confirm that we know what we're doing in the\u2014well, in the thirty minutes after lunch anyway.",
71
+ "output": "So I guess just to confirm that we know what we're doing in the next\u2014well, in the thirty minutes after lunch, anyway.",
72
+ "exact": false,
73
+ "similarity": 0.936,
74
+ "target_coverage": 0.9,
75
+ "forbidden": []
76
+ },
77
+ {
78
+ "i": 3,
79
+ "category": "intent",
80
+ "transcript": "And you might want to talk to Alex to find out if somebody's already done this turn redwood stuff into tree bank stuff so that they can compare",
81
+ "target": "And you might wanna talk to Alex to find out if somebody's already done this, turn Redwoods stuff into Treebank stuff, so that they can compare.",
82
+ "output": "And you might want to talk to Alex to find out if somebody's already done this turn redwood stuff into tree bank stuff, so that they can compare.",
83
+ "exact": false,
84
+ "similarity": 0.955,
85
+ "target_coverage": 0.769,
86
+ "forbidden": []
87
+ },
88
+ {
89
+ "i": 4,
90
+ "category": "prose",
91
+ "transcript": "Because it's quite easy in Pearl as well. It's just a line of code for counting all the words and Yeah, it's it's by hashes.",
92
+ "target": "Because it's quite easy in Perl as well, it's just a line of code for counting all the words, and yeah, it's by hashes.",
93
+ "output": "Because it's quite easy in Pearl as well, it's just a line of code for counting all the words, and yeah, it's by hashes.",
94
+ "exact": false,
95
+ "similarity": 0.996,
96
+ "target_coverage": 0.923,
97
+ "forbidden": []
98
+ },
99
+ {
100
+ "i": 5,
101
+ "category": "prose",
102
+ "transcript": "If if your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
103
+ "target": "If your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
104
+ "output": "If your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
105
+ "exact": true,
106
+ "similarity": 1.0,
107
+ "target_coverage": 1.0,
108
+ "forbidden": []
109
+ },
110
+ {
111
+ "i": 6,
112
+ "category": "prose",
113
+ "transcript": "Um one thing that would be convenient for all sorts of things and which I haven't found out about it is how to do tool tips in an arbitrary way in in in swing graphic displays.",
114
+ "target": "One thing that would be convenient for all sorts of things, and which I haven't found out about, is how to do tooltips in an arbitrary way in Swing graphic displays.",
115
+ "output": "One thing that would be convenient for all sorts of things, and which I haven't found out about, is how to do tool tips in an arbitrary way in in-swing graphic displays.",
116
+ "exact": false,
117
+ "similarity": 0.982,
118
+ "target_coverage": 0.935,
119
+ "forbidden": []
120
+ },
121
+ {
122
+ "i": 7,
123
+ "category": "prose",
124
+ "transcript": "What we've finally just uh at twelve o'clock today, looks like we've got it sussed, um, is to get one channel one microphone being the left channel and one being the right channel to merge into a stereo single file.",
125
+ "target": "What we've finally just at twelve o'clock today, looks like we've got it sussed, is to get one channel, one microphone being the left channel, and one being the right channel, to merge into a stereo single file.",
126
+ "output": "What we've finally just at twelve o'clock today, looks like we've got it\u2014sussed, is to get one channel one microphone, be the left channel and one being the right channel to merge into a stereo single file.",
127
+ "exact": false,
128
+ "similarity": 0.978,
129
+ "target_coverage": 0.975,
130
+ "forbidden": []
131
+ },
132
+ {
133
+ "i": 8,
134
+ "category": "prose",
135
+ "transcript": "I'm just thinking of you know, ill utterance consisting entirely of laughter and then putting like punctuation in like ha ha ha ha just",
136
+ "target": "I'm just thinking of, you know, an utterance consisting entirely of laughter, and then putting like punctuation in, like...",
137
+ "output": "I'm just thinking of you, know, ill utterance consisting entirely of laughter, then putting, like, punctuation in, like, ha-ha-ha, just...",
138
+ "exact": false,
139
+ "similarity": 0.889,
140
+ "target_coverage": 0.789,
141
+ "forbidden": []
142
+ },
143
+ {
144
+ "i": 9,
145
+ "category": "prose",
146
+ "transcript": "So we could zip we could zip through this and look at all the um all the interactions in which people built subcontracts first, which we expect them to do as a wild hypothesis more when they have verbal communication than when they don't.",
147
+ "target": "So we could zip through this and look at all the interactions in which people build subconstructs first, which we expect them to do, but as a wild hypothesis more when they have verbal communication than when they don't.",
148
+ "output": "So we could zip through this and look at all the interactions in which people built subcontracts first, which we expect them to do as a wild hypothesis, more when they have verbal communication than when they don't.",
149
+ "exact": false,
150
+ "similarity": 0.933,
151
+ "target_coverage": 0.872,
152
+ "forbidden": []
153
+ },
154
+ {
155
+ "i": 10,
156
+ "category": "prose",
157
+ "transcript": "I'm I I'm getting quite lost um at the moment because um what's um our difference between the um s um uh the importance measure and the skimming?",
158
+ "target": "I'm getting quite lost at the moment because what's our difference between the importance measure and the skimming?",
159
+ "output": "I'm getting quite lost at the moment because what's our difference between the importance measure and the skimming.",
160
+ "exact": false,
161
+ "similarity": 0.991,
162
+ "target_coverage": 1.0,
163
+ "forbidden": []
164
+ },
165
+ {
166
+ "i": 11,
167
+ "category": "prose",
168
+ "transcript": "Which if you just said that it's gone Peterson absorption from neutral hydrogen rather than i if it was a if it was hydrogen absorption",
169
+ "target": "Which, if you just said that it's Gunn-Petersen absorption from neutral hydrogen rather than\u2014if it was a\u2014if it was hydrogen absorption.",
170
+ "output": "Which, if you just said that it's gone, Peterson absorption from neutral hydrogen rather than if it was hydrogen absorption?",
171
+ "exact": false,
172
+ "similarity": 0.903,
173
+ "target_coverage": 0.792,
174
+ "forbidden": []
175
+ },
176
+ {
177
+ "i": 12,
178
+ "category": "prose",
179
+ "transcript": "So what I'm having is so we we had a we had a long problem about not finding out why the time syncing up between the relative time in a in a sort of in a in a summarized section and the absolute time didn't correspond and stuff.",
180
+ "target": "So what I'm having is, so we had a long problem about not finding out why the time-syncing up between the relative time in a sort of summarised section and the absolute time didn't correspond and stuff.",
181
+ "output": "So what I'm having is so we had a long problem about not finding out why the time syncing up between the relative time in a sort of in a summary section and the absolute time didn't correspond, and stuff.",
182
+ "exact": false,
183
+ "similarity": 0.936,
184
+ "target_coverage": 0.949,
185
+ "forbidden": []
186
+ },
187
+ {
188
+ "i": 13,
189
+ "category": "meeting",
190
+ "transcript": "So interactivity is a concept is a concept that I'm using to distinguish the two uh uh extremes of uh of interact uh of discourse in meetings.",
191
+ "target": "So 'interactivity' is a concept that I'm using to distinguish the two extremes of discourse in meetings.",
192
+ "output": "Interactivity is a concept that I'm using to distinguish the two extremes of interactivity in meetings.",
193
+ "exact": false,
194
+ "similarity": 0.879,
195
+ "target_coverage": 0.824,
196
+ "forbidden": []
197
+ },
198
+ {
199
+ "i": 14,
200
+ "category": "intent",
201
+ "transcript": "And um so far um I think uh it's uh I think it it's uh still um about the s about the same level of segmentation we are talking here.",
202
+ "target": "And so far I think it's still about the same level of segmentation we're talking here.",
203
+ "output": "And so far, I think, it's still about the same level of segmentation, we are talking here.",
204
+ "exact": false,
205
+ "similarity": 0.966,
206
+ "target_coverage": 0.882,
207
+ "forbidden": []
208
+ },
209
+ {
210
+ "i": 15,
211
+ "category": "prose",
212
+ "transcript": "As long as other people don't for some reason, I don't know, disconnect some bits of the equipment, there's no reason why they should.",
213
+ "target": "That as long as other people don't, for some reason\u2014I don't know, disconnect some bits of the equipment\u2014there's no reason why they should.",
214
+ "output": "As long as other people don't for some reason, I don't know, disconnect some bits of the equipment, there's no reason why they should.",
215
+ "exact": false,
216
+ "similarity": 0.949,
217
+ "target_coverage": 0.963,
218
+ "forbidden": []
219
+ },
220
+ {
221
+ "i": 16,
222
+ "category": "prose",
223
+ "transcript": "It's fairly general. Um and I guess the purpose of this is also not to restrict you in in the way you're thinking, like um, voice recognition.",
224
+ "target": "It's fairly general, and I guess the purpose of this is also not to restrict you in the way you're thinking, like voice recognition.",
225
+ "output": "It's fairly general, and I guess the purpose of this is also not to restrict you in the way you're thinking, like, voice recognition.",
226
+ "exact": false,
227
+ "similarity": 0.996,
228
+ "target_coverage": 1.0,
229
+ "forbidden": []
230
+ },
231
+ {
232
+ "i": 17,
233
+ "category": "prose",
234
+ "transcript": "W within the sentence that you're sort of currently looking at, um feel free to correct it that way that you like it's not only about resolution but sort of like coming up with a corrected version on these on these places.",
235
+ "target": "Within the sentence that you sort of currently looking at, feel free to correct it that way, that you'll do, you know, like, it's not only about resolution but it's sort of like coming up with a corrected version based on these.",
236
+ "output": "W, within the sentence that you're sort of currently looking at, feel free to correct it that way that you like it's not only about resolution but sort of, like, coming up with a corrected version on these places.",
237
+ "exact": false,
238
+ "similarity": 0.109,
239
+ "target_coverage": 0.773,
240
+ "forbidden": []
241
+ },
242
+ {
243
+ "i": 18,
244
+ "category": "prose",
245
+ "transcript": "And there will also be presumably some kind of task hierarchy modeling going on in I mean,'cause the whole browser working group um final um sort of presentation on that second day was about",
246
+ "target": "And there will also be, presumably, some kind of task hierarchy modelling going on, in\u2014I mean, 'cause the whole browser working group final, sort of, presentation on that second day was about...",
247
+ "output": "And there will also be presumably some kind of task hierarchy modelling going on, in\u2014I mean, 'cause the whole browser working group final sort of presentation on that second day was about.",
248
+ "exact": false,
249
+ "similarity": 0.984,
250
+ "target_coverage": 1.0,
251
+ "forbidden": []
252
+ },
253
+ {
254
+ "i": 19,
255
+ "category": "prose",
256
+ "transcript": "Uh right, well basically um high priority for any animal for me is that they be willing to take a lot of physical affection from their family.",
257
+ "target": "Right, well, basically high priority for any animal, for me, is that they be willing to take a lot of physical affection from their family.",
258
+ "output": "Well, basically, high priority for any animal, for me, is that they be willing to take a lot of physical affection from their family.",
259
+ "exact": false,
260
+ "similarity": 0.963,
261
+ "target_coverage": 0.958,
262
+ "forbidden": []
263
+ },
264
+ {
265
+ "i": 20,
266
+ "category": "prose",
267
+ "transcript": "It took like the third time till I thought, Oh, you're saying F five.",
268
+ "target": "It took, like, the third time till I thought, oh, you're saying F-five.",
269
+ "output": "It took, like, the third time, till I thought, you're saying five.",
270
+ "exact": false,
271
+ "similarity": 0.949,
272
+ "target_coverage": 0.714,
273
+ "forbidden": []
274
+ },
275
+ {
276
+ "i": 21,
277
+ "category": "prose",
278
+ "transcript": "Because, you know, algorithmically you're you're already putting together I mean this is essentially already, you know, these fixations with stuff in between.",
279
+ "target": "Because, you know, algorithmically, you're already putting together\u2014I mean, this is essentially already, you know, these fixations with stuff in between.",
280
+ "output": "Because, you know, algorithmically you're already putting together\u2014I mean, this is essentially already, you know, these fixations with stuff in between.",
281
+ "exact": false,
282
+ "similarity": 0.997,
283
+ "target_coverage": 1.0,
284
+ "forbidden": []
285
+ },
286
+ {
287
+ "i": 22,
288
+ "category": "prose",
289
+ "transcript": "Yeah. Uh right, damp life enough. See again, that's uh these are source types. Um I mean it's not a source type.",
290
+ "target": "Right, damped Lyman\u2014see, again, that's\u2014these are source types\u2014the, I mean, it's not a source type.",
291
+ "output": "Yeah, right, damp life enough, see again, that's these are source types, I mean, it's not a source type.",
292
+ "exact": false,
293
+ "similarity": 0.832,
294
+ "target_coverage": 0.737,
295
+ "forbidden": []
296
+ },
297
+ {
298
+ "i": 23,
299
+ "category": "prose",
300
+ "transcript": "So mm so for dialogue, yeah, mm there would be uh some kind of uh interaction structure.",
301
+ "target": "So for dialogue, yeah, there would be some kind of interaction structure.",
302
+ "output": "So, for dialogue, yeah, there would be some kind of interaction structure.",
303
+ "exact": false,
304
+ "similarity": 0.993,
305
+ "target_coverage": 1.0,
306
+ "forbidden": []
307
+ },
308
+ {
309
+ "i": 24,
310
+ "category": "prose",
311
+ "transcript": "Well, I could look'cause I I've got that there's the list, isn't there, of postgraduates that I maintain in in linguistics.",
312
+ "target": "Well, I could look, 'cause I've got\u2014that's the list, isn't there, of postgraduates I maintain in linguistics.",
313
+ "output": "Well, I could look, 'cause I've got that\u2014there's the list, isn't there, of postgraduates that I maintain in linguistics.",
314
+ "exact": false,
315
+ "similarity": 0.943,
316
+ "target_coverage": 0.9,
317
+ "forbidden": [
318
+ "here's the"
319
+ ]
320
+ },
321
+ {
322
+ "i": 25,
323
+ "category": "prose",
324
+ "transcript": "Um but the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel and um make sure that no back channels were lost, for example.",
325
+ "target": "But the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel, and make sure that no back channels were lost, for example.",
326
+ "output": "But the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel, and make sure that no back channels were lost, for example.",
327
+ "exact": true,
328
+ "similarity": 1.0,
329
+ "target_coverage": 1.0,
330
+ "forbidden": []
331
+ },
332
+ {
333
+ "i": 26,
334
+ "category": "meeting",
335
+ "transcript": "Are they doing um uh are are they uh as in the kickoff meeting just exchanging information to get started with the project or are they uh actually addressing some specific design um criterion at the moment?",
336
+ "target": "Are they doing, are they\u2014as in the kick-off meeting just exchanging information to get started with a project, or are they actually addressing some specific design criteria at the moment?",
337
+ "output": "Are they doing\u2014are they doing, as in the kickoff meeting, just exchanging information to get started with the project, or are they actually addressing some specific design criterion at the moment?",
338
+ "exact": false,
339
+ "similarity": 0.914,
340
+ "target_coverage": 0.742,
341
+ "forbidden": []
342
+ },
343
+ {
344
+ "i": 27,
345
+ "category": "prose",
346
+ "transcript": "Would we wanna ask them and put some kind of like proviso in to make it um specific to sort of preemptively",
347
+ "target": "Would we wanna ask them and put some kind of, like, provisor in to make it specific, to sort of preemptively...",
348
+ "output": "Would we wanna ask them and put some kind of, like, proviso, in, to make it specific to sort of preemptively?",
349
+ "exact": false,
350
+ "similarity": 0.964,
351
+ "target_coverage": 0.9,
352
+ "forbidden": []
353
+ },
354
+ {
355
+ "i": 28,
356
+ "category": "prose",
357
+ "transcript": "And there's especially one there that um I think he's Eastern European and I think that's the only reason I can understand what he's saying at all.",
358
+ "target": "And there's especially one there that, I think he's Eastern European, and I think that's the only reason I can understand what he's saying at all.",
359
+ "output": "And there's especially one there that\u2014I think he's Eastern European, and I think that's the only reason I can understand what he's saying at all.",
360
+ "exact": false,
361
+ "similarity": 0.99,
362
+ "target_coverage": 1.0,
363
+ "forbidden": []
364
+ },
365
+ {
366
+ "i": 29,
367
+ "category": "meeting",
368
+ "transcript": "Because um I I think it's actually very similar to what I did for my um speaker um uh extraction and I think I would perhaps have to change two lines of code to get you um for each meeting a file that says fr from um this millisecond to this millisecond there was this sequence of words.",
369
+ "target": "Because I think it's actually very similar to what I did for my speaker extraction, and I think I would perhaps have to change two lines of code to get you, for each meeting, a file that says from this millisecond to this millisecond there was this sequence of words.",
370
+ "output": "Because I think it's actually very similar to what I did for my speaker, extraction, and I would perhaps have to change two lines of code to get you for each meeting a file that says 'from this millisecond to this millisecond' there was this sequence of words.",
371
+ "exact": false,
372
+ "similarity": 0.421,
373
+ "target_coverage": 0.98,
374
+ "forbidden": []
375
+ },
376
+ {
377
+ "i": 30,
378
+ "category": "prose",
379
+ "transcript": "I would just try to keep segments very manageable. Um and but y you use these uh waveforms to help you.",
380
+ "target": "I would just try to keep segments very manageable, but, you know, use these waveforms to help you.",
381
+ "output": "I would just try to keep segments very manageable, and but you use these waveforms to help you.",
382
+ "exact": false,
383
+ "similarity": 0.943,
384
+ "target_coverage": 0.824,
385
+ "forbidden": []
386
+ },
387
+ {
388
+ "i": 31,
389
+ "category": "prose",
390
+ "transcript": "Um right into the call that we are considering the idea of having a poster session.",
391
+ "target": "Write into the call that we are considering the idea of having a poster session.",
392
+ "output": "Right into the call that we are considering the idea of having a poster session.",
393
+ "exact": false,
394
+ "similarity": 0.963,
395
+ "target_coverage": 0.929,
396
+ "forbidden": []
397
+ },
398
+ {
399
+ "i": 32,
400
+ "category": "prose",
401
+ "transcript": "Well I'm I'm I'm I'm trying tr I'm making sure that the GDA format we've got at the moment will will output the well output all the analysis that that Robin's looking for.",
402
+ "target": "Well, I'm just trying\u2014I'm making sure that the GDF format we've got at the moment will output\u2014say, well, I've output old analysis that Robin's looking for.",
403
+ "output": "Well, I'm\u2014I'm\u2014I'm\u2014I'm trying, making sure that the GDA format we've got at the moment will output the well output all the analysis that Robin's looking for.",
404
+ "exact": false,
405
+ "similarity": 0.849,
406
+ "target_coverage": 0.625,
407
+ "forbidden": []
408
+ },
409
+ {
410
+ "i": 33,
411
+ "category": "prose",
412
+ "transcript": "I can just add SSH stuff in to ev evoke the sound tools on the uh on dice and then copy them back.",
413
+ "target": "I can just add SSH stuff in to evoke the sound tools on Dice, and then copy 'em back.",
414
+ "output": "I can just add SSH stuff in to evoke the sound tools on the dice, then copy them back.",
415
+ "exact": false,
416
+ "similarity": 0.924,
417
+ "target_coverage": 0.722,
418
+ "forbidden": []
419
+ },
420
+ {
421
+ "i": 34,
422
+ "category": "prose",
423
+ "transcript": "have all the l lines of actually lots of different elements and you have to work out like all of the ones which are iron lines.",
424
+ "target": "You have all the lines of actually lots of different elements, and you have to work out at all the ones which are ion lines.",
425
+ "output": "Have all the L lines of actually lots of different elements, and you have to work out, like, all of the ones which are iron lines.",
426
+ "exact": false,
427
+ "similarity": 0.921,
428
+ "target_coverage": 0.792,
429
+ "forbidden": []
430
+ },
431
+ {
432
+ "i": 35,
433
+ "category": "prose",
434
+ "transcript": "Um suppose it doesn't really matter as long as they're unique and it can I can pass them back to you and you can use that to the display.",
435
+ "target": "I suppose it doesn't really matter as long as they're unique, and I can pass 'em back to you and you can use that to the display.",
436
+ "output": "Suppose it doesn't really matter as long as they're unique and it can\u2014I can pass them back to you, and you can use that to the display.",
437
+ "exact": false,
438
+ "similarity": 0.939,
439
+ "target_coverage": 0.857,
440
+ "forbidden": []
441
+ },
442
+ {
443
+ "i": 36,
444
+ "category": "prose",
445
+ "transcript": "So um I don't know, just just to to ask now if you've got anything else you've thought about while we've been talking.",
446
+ "target": "So, dunno, just to ask now if you've got anything else you've thought about while we've been talking.",
447
+ "output": "So I don't know, just to ask now if you've got anything else you've thought about while we've been talking.",
448
+ "exact": false,
449
+ "similarity": 0.952,
450
+ "target_coverage": 0.9,
451
+ "forbidden": []
452
+ },
453
+ {
454
+ "i": 37,
455
+ "category": "meeting",
456
+ "transcript": "I mean there probably are a bunch of issues like if you've got a hundred hours of meetings and they all talk about a lot of the same things.",
457
+ "target": "I mean, there probably are a bunch of issues, like, if you've got a hundred hours of meetings and they all talk about a lot of the same things.",
458
+ "output": "I mean, probably there are a bunch of issues like if you've got a hundred hours of meetings and they all talk about a lot of the same things.",
459
+ "exact": false,
460
+ "similarity": 0.951,
461
+ "target_coverage": 0.897,
462
+ "forbidden": []
463
+ },
464
+ {
465
+ "i": 38,
466
+ "category": "prose",
467
+ "transcript": "Um at least it works if there are several categories with each with one document each, but it um",
468
+ "target": "At least it works if there are several categories, with each, with one document each, but it\u2014yeah.",
469
+ "output": "At least it works if there are several categories with each with one document, but it...",
470
+ "exact": false,
471
+ "similarity": 0.925,
472
+ "target_coverage": 0.824,
473
+ "forbidden": []
474
+ },
475
+ {
476
+ "i": 39,
477
+ "category": "prose",
478
+ "transcript": "Suppose we pick up an we we we screwed up the first time we put the triangle with the square and we threw it away. We decided we didn't like it.",
479
+ "target": "Suppose we screwed up the first time we put the triangle with the square, and we threw it away and decided we didn't like it.",
480
+ "output": "Suppose we pick up\u2014we screwed up the first time we put the triangle with the square, and we threw it away. We decided we didn't like it.",
481
+ "exact": false,
482
+ "similarity": 0.935,
483
+ "target_coverage": 0.92,
484
+ "forbidden": []
485
+ },
486
+ {
487
+ "i": 40,
488
+ "category": "prose",
489
+ "transcript": "I think proportional like I even though I'm I'm always getting myself confused about this, but I think sort of making the summary length thing generally proportional",
490
+ "target": "I think proportion, like, even though I'm always getting myself confused about this, but I think sort of making the summary length thing generally proportion.",
491
+ "output": "I think proportional, like, I even though I'm always getting myself confused about this, but I think sort of making the summary length thing generally proportional.",
492
+ "exact": false,
493
+ "similarity": 0.981,
494
+ "target_coverage": 0.84,
495
+ "forbidden": []
496
+ },
497
+ {
498
+ "i": 41,
499
+ "category": "prose",
500
+ "transcript": "Uh what el uh well I'll I'll have to get to grips with Cra Camtasia uh properly. Uh to generate a little sort of introductory video, I suppose, uh for instructional purposes at the beginning of the experiment.",
501
+ "target": "Well, I'll have to get to grips with Camtasia properly to generate a little sort of introductory video, I suppose, for instructional purposes at the beginning of the experiment.",
502
+ "output": "Well, I'll have to get to grips with CraCamTasia properly. To generate a little sort of introductory video, I suppose, for instructional purposes at the beginning of the experiment.",
503
+ "exact": false,
504
+ "similarity": 0.978,
505
+ "target_coverage": 0.931,
506
+ "forbidden": []
507
+ },
508
+ {
509
+ "i": 42,
510
+ "category": "prose",
511
+ "transcript": "Um what I because nine megabyte is what I got for when I said for every um utterance. This goes from there to there and",
512
+ "target": "What I\u2014because nine megabytes is what I got for when I said for every utterance, this goes from there to there, and...",
513
+ "output": "What I\u2014because nine megabytes is what I got for when I said for every utterance, this goes from there to there.",
514
+ "exact": false,
515
+ "similarity": 0.969,
516
+ "target_coverage": 0.955,
517
+ "forbidden": []
518
+ },
519
+ {
520
+ "i": 43,
521
+ "category": "prose",
522
+ "transcript": "If via the wasn't in there then you'd have it silicon two lines at but without with via the I think that means silicon two derived from these two features.",
523
+ "target": "If it wasn't in there, then you'd have it 'silicone two lines at' but without\u2014with the\u2014I think that means silicone two derived from these two features.",
524
+ "output": "If via the wasn't in there, then you'd have it silicon two lines at, but without via the\u2014I think that means silicon two derived from these two features.",
525
+ "exact": false,
526
+ "similarity": 0.944,
527
+ "target_coverage": 0.724,
528
+ "forbidden": []
529
+ },
530
+ {
531
+ "i": 44,
532
+ "category": "prose",
533
+ "transcript": "So what I've been thinking is maybe if we try to really make sense together of the XML format to be sure that we can all produce the data that we are producing in a way or at least I mean, I guess my data I'll probably load in from completely different way anyway because it's a matrix.",
534
+ "target": "So what I've been thinking is, maybe if we try to really make sense together of the XML format to be sure that we can all produce the data that we are producing in a way\u2014or at least, I mean, I guess my data I'll probably load in from completely different way anyway because it's matrix.",
535
+ "output": "So what I've been thinking is, maybe if we try to really make sense together of the XML format, to be sure that we can all produce the data that we are producing in a way, or at least\u2014I mean, my data, I'll probably load in from completely different way anyway, because it's a matrix.",
536
+ "exact": false,
537
+ "similarity": 0.626,
538
+ "target_coverage": 0.932,
539
+ "forbidden": []
540
+ },
541
+ {
542
+ "i": 45,
543
+ "category": "prose",
544
+ "transcript": "Mm. Cause uh so for the information and action the uh the action here is not direct but uh some kind of uh uh physical action uh that uh the uh participants uh i is going to uh or has done in the past.",
545
+ "target": "'Cause, so, for the information and action, the action here is not dialogue act but some kind of physical action that the participant is going to or has done in the past.",
546
+ "output": "Cause, so for the information and action, the action here is not direct but some kind of physical action, that the participants will have, or has done in the past.",
547
+ "exact": false,
548
+ "similarity": 0.919,
549
+ "target_coverage": 0.742,
550
+ "forbidden": [
551
+ "here is"
552
+ ]
553
+ },
554
+ {
555
+ "i": 46,
556
+ "category": "meeting",
557
+ "transcript": "J because uh after talking to Jim, um just uh we have different ideas whether um meeting action will be about the same size as topic segments.",
558
+ "target": "Because after talking to Jane, just\u2014we have different ideas whether meeting action will be about the same size as topic segments.",
559
+ "output": "J because after talking to Jim, just we have different ideas whether meeting action will be about the same size as topic segments.",
560
+ "exact": false,
561
+ "similarity": 0.958,
562
+ "target_coverage": 0.905,
563
+ "forbidden": []
564
+ },
565
+ {
566
+ "i": 47,
567
+ "category": "prose",
568
+ "transcript": "uh i it's also going to be a problem, uh, because you're going to have one part or construct forming in the middle of a fixation.",
569
+ "target": "It's also going to be a problem because you're going to have one part or a construct forming in the middle of a fixation.",
570
+ "output": "It's also going to be a problem, because you're going to have one part or construct forming in the middle of a fixation.",
571
+ "exact": false,
572
+ "similarity": 0.988,
573
+ "target_coverage": 0.92,
574
+ "forbidden": []
575
+ },
576
+ {
577
+ "i": 48,
578
+ "category": "prose",
579
+ "transcript": "Um it ties you down perhaps a bit later on in terms of the technologies, um, how far you can transmit a signal or the complexity of the functions that you want.",
580
+ "target": "It ties you down perhaps a bit later on in terms of the technologies, how far you can transmit the signal, or the complexity of the functions that you want.",
581
+ "output": "It ties you down perhaps a bit later on in terms of the technologies, how far you can transmit a signal, or the complexity of the functions that you want.",
582
+ "exact": false,
583
+ "similarity": 0.987,
584
+ "target_coverage": 0.931,
585
+ "forbidden": []
586
+ },
587
+ {
588
+ "i": 49,
589
+ "category": "prose",
590
+ "transcript": "Like that initially had quite different ideas about the phrase types and and markations and then eventually you came up with some kind of rules that you set up between uh the two of you.",
591
+ "target": "Like, that initially had quite different ideas about the phrase types and markations, and then eventually you came up with some kind of rules that you set up between the two of you.",
592
+ "output": "Like, that initially had quite different ideas about the phrase types and markings, and then eventually you came up with some kind of rules that you set up between the two of you.",
593
+ "exact": false,
594
+ "similarity": 0.989,
595
+ "target_coverage": 0.938,
596
+ "forbidden": []
597
+ },
598
+ {
599
+ "i": 50,
600
+ "category": "meeting",
601
+ "transcript": "And so I think going through the presentations that um were given at the work package six meeting where um I think it was um it wasn't w was it Anita or was it oh I've forgotten her name.",
602
+ "target": "And so I think going through the presentations that were given at the work package six meeting, where, and I think it was\u2014it wasn't\u2014was it Anita, or was it\u2014oh, I've forgotten her name.",
603
+ "output": "And so I think going through the presentations that were given at the work package 6 meeting where I think it was\u2014was it\u2014anita or was it, oh I've forgotten her name.",
604
+ "exact": false,
605
+ "similarity": 0.917,
606
+ "target_coverage": 0.811,
607
+ "forbidden": []
608
+ },
609
+ {
610
+ "i": 51,
611
+ "category": "prose",
612
+ "transcript": "Um frequencies or something. Um as well as um characters, um different uh keypad styles and symbols.",
613
+ "target": "Frequencies or something, as well as characters, different keypad styles and symbols.",
614
+ "output": "Frequencies or something, as well as characters, different keypad styles and symbols.",
615
+ "exact": true,
616
+ "similarity": 1.0,
617
+ "target_coverage": 1.0,
618
+ "forbidden": []
619
+ },
620
+ {
621
+ "i": 52,
622
+ "category": "prose",
623
+ "transcript": "a couple of hours getting photocopies of degree certificates to give you for your files if I'm just gonna be here'cause they want I think it that one place it said give us copies of degree",
624
+ "target": "A couple of hours getting photocopies of degree certificates to give you for your files, if I'm just gonna be here a good\u2014they won't, I think at one place it said give us copies of degrees.",
625
+ "output": "A couple of hours getting photocopies of degree certificates to give you for your files, if I'm just gonna be here, 'cause they want\u2014I think that one place said give us copies of degree.",
626
+ "exact": false,
627
+ "similarity": 0.939,
628
+ "target_coverage": 0.711,
629
+ "forbidden": []
630
+ },
631
+ {
632
+ "i": 53,
633
+ "category": "prose",
634
+ "transcript": "What um the kinds of events that we had uh before talked about putting into the record for then use in Alan and NXT isn't based on saying every X second something",
635
+ "target": "What\u2014the kinds of events that we had before talked about putting into the record for then use in ELAN and NXT isn't based on saying every X seconds something.",
636
+ "output": "What the kinds of events that we had before, talked about, putting into the record for then, use in Alan and NXT, isn't based on saying every X second something.",
637
+ "exact": false,
638
+ "similarity": 0.959,
639
+ "target_coverage": 0.867,
640
+ "forbidden": []
641
+ },
642
+ {
643
+ "i": 54,
644
+ "category": "prose",
645
+ "transcript": "Mm we were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
646
+ "target": "We were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
647
+ "output": "We were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
648
+ "exact": true,
649
+ "similarity": 1.0,
650
+ "target_coverage": 1.0,
651
+ "forbidden": []
652
+ },
653
+ {
654
+ "i": 55,
655
+ "category": "meeting",
656
+ "transcript": "So uh in meetings I uh from my uh reading of the one of the M meetings IS one oh eight uh the uh the four meetings",
657
+ "target": "So in meetings, from my reading of one of the AMI meetings, IS one O eight, the four meetings.",
658
+ "output": "So in meetings I, from my reading of the one of the meetings, is one eight the four meetings.",
659
+ "exact": false,
660
+ "similarity": 0.909,
661
+ "target_coverage": 0.667,
662
+ "forbidden": []
663
+ },
664
+ {
665
+ "i": 56,
666
+ "category": "meeting",
667
+ "transcript": "And then between us we'll have to have another meeting and and I mean, at the same time as we're sorting through all the other titles and and deciding um how to divide up the sessions.",
668
+ "target": "And then between us we'll have to have another meeting, and I mean, at the same time as we're sorting through all the other titles and deciding how to divide up the sessions.",
669
+ "output": "And then between us we'll have to have another meeting, and I mean, at the same time as we're sorting through all the other titles and deciding how to divide up the sessions.",
670
+ "exact": true,
671
+ "similarity": 1.0,
672
+ "target_coverage": 1.0,
673
+ "forbidden": []
674
+ },
675
+ {
676
+ "i": 57,
677
+ "category": "prose",
678
+ "transcript": "So this person left out a lot of N punctuation and um here's a case where I think she was transcribing an outbreath, um, or possibly an in breath, I uh in and used the hash mark.",
679
+ "target": "So this person left out a lot of end punctuation, and here's a case where I think she was transcribing an out-breath, or possibly an in-breath, in, and used the hash mark.",
680
+ "output": "So this person left out a lot of punctuation, and here's a case where I think she was transcribing an utterance, or possibly an in-brattle, I in, and used the hash mark.",
681
+ "exact": false,
682
+ "similarity": 0.929,
683
+ "target_coverage": 0.794,
684
+ "forbidden": []
685
+ },
686
+ {
687
+ "i": 58,
688
+ "category": "prose",
689
+ "transcript": "And I actually uh think that that's a slightly extreme um position um with regard to the literature that a lot of people might say it doesn't really matter who the different speakers are in an interactive section.",
690
+ "target": "And I actually think that that's a slightly extreme position with regard to the literature, that a lot of people might say it doesn't really matter who the different speakers are in an interactive section.",
691
+ "output": "And I actually think that's a slightly extreme position with regard to the literature that a lot of people might say it doesn't really matter who the different speakers are in an interactive section.",
692
+ "exact": false,
693
+ "similarity": 0.985,
694
+ "target_coverage": 0.972,
695
+ "forbidden": []
696
+ },
697
+ {
698
+ "i": 59,
699
+ "category": "prose",
700
+ "transcript": "Oh, I had one guy, one of the project managers was um he had a really weird accent and he was calling um one guy Mr. Red.",
701
+ "target": "Oh, I had one guy\u2014one of the project managers was, he had a really weird accent and he was calling one guy 'Mister Ed'.",
702
+ "output": "Oh, I had one guy, one of the project managers, he had a really weird accent, and he was calling one guy Mr. Red.",
703
+ "exact": false,
704
+ "similarity": 0.905,
705
+ "target_coverage": 0.833,
706
+ "forbidden": []
707
+ },
708
+ {
709
+ "i": 60,
710
+ "category": "prose",
711
+ "transcript": "By now I just had a look at the year data. Um and actually the average F zero deviation is only slightly higher for the positive ones than for the negative ones.",
712
+ "target": "By now, I just had a look at the data, and actually the average F-zero deviation is only slightly higher for the positive ones than for the negative ones.",
713
+ "output": "By now I just had a look at the year data, and actually the average F-zero deviation is only slightly higher for the positive ones than for the negative ones.",
714
+ "exact": false,
715
+ "similarity": 0.981,
716
+ "target_coverage": 0.966,
717
+ "forbidden": []
718
+ },
719
+ {
720
+ "i": 61,
721
+ "category": "prose",
722
+ "transcript": "Um I would recommend I've found that it's easier when you're checking and you're trying to make sure the boundaries are right for a speech segment.",
723
+ "target": "I would recommend\u2014I've found that it's easier when you're checking and you're trying to make sure the boundaries are right for a speech segment.",
724
+ "output": "I would recommend I've found that it's easier when you're checking, and you're trying to make sure the boundaries are right for a speech segment.",
725
+ "exact": false,
726
+ "similarity": 0.99,
727
+ "target_coverage": 1.0,
728
+ "forbidden": []
729
+ },
730
+ {
731
+ "i": 62,
732
+ "category": "prose",
733
+ "transcript": "But the the text for the actual call, is she going to rework something or uh I think she should",
734
+ "target": "But the text for the actual call, is she going to rework something, or she should?",
735
+ "output": "But the text for the actual call is she going to rework something, or\u2014I think she should.",
736
+ "exact": false,
737
+ "similarity": 0.936,
738
+ "target_coverage": 0.933,
739
+ "forbidden": []
740
+ },
741
+ {
742
+ "i": 63,
743
+ "category": "prose",
744
+ "transcript": "We've got we've got all the data in the ASCII format at the moment, and it's just a matter of what data do we need to pull out of that into the GDF so I can actually do the prop analysis.",
745
+ "target": "'Cause we got all this in the ASCII format at the moment, and it's just a matter of what data do we need to pull out of that into the GDF, so I can actually do the proper analysis.",
746
+ "output": "We've got all the data in the ASCII format at the moment, and it's just a matter of what data we need to pull out of that into the GDF so I can actually do the prop analysis.",
747
+ "exact": false,
748
+ "similarity": 0.932,
749
+ "target_coverage": 0.795,
750
+ "forbidden": []
751
+ },
752
+ {
753
+ "i": 64,
754
+ "category": "prose",
755
+ "transcript": "I think it's'cause we had to specify it ourselves that it's not as um like focus a specification of most um work we have to do.",
756
+ "target": "I think it's 'cause we had to specify it ourselves, that it's not as, like, focus the specification of most work we have to do.",
757
+ "output": "I think it's 'cause we had to specify it ourselves that it's not as, like, focus specification of most work we have to do.",
758
+ "exact": false,
759
+ "similarity": 0.98,
760
+ "target_coverage": 0.923,
761
+ "forbidden": []
762
+ },
763
+ {
764
+ "i": 65,
765
+ "category": "prose",
766
+ "transcript": "Yeah, Dave C in the program manager, do you have a a method to like set the current ID so it'll update the display?",
767
+ "target": "Yeah, Dave, see, in the programme manager, do you have a method to, like, set the current ID so it'll update the display?",
768
+ "output": "Yeah, Dave in the programme manager, do you have a method to, like, set the current ID so it'll update the display?",
769
+ "exact": false,
770
+ "similarity": 0.975,
771
+ "target_coverage": 0.913,
772
+ "forbidden": []
773
+ },
774
+ {
775
+ "i": 66,
776
+ "category": "prose",
777
+ "transcript": "um which is the the first one is that um uh the companies decided that teletext is outdated uh because of how popular the internet is.",
778
+ "target": "Which is the first one, is that the company's decided that teletext is outdated because of how popular the internet is.",
779
+ "output": "Which is the first one, that the companies decided that teletext is outdated because of how popular the internet is?",
780
+ "exact": false,
781
+ "similarity": 0.962,
782
+ "target_coverage": 0.762,
783
+ "forbidden": []
784
+ },
785
+ {
786
+ "i": 67,
787
+ "category": "meeting",
788
+ "transcript": "So should we expect that all the slides from like the work package six meeting or the joint work package five work pack will be up on one of the work package websites?",
789
+ "target": "So should we expect that all the slides from, like, the work package six meeting or the joint work package five work package will be up on one of the work package websites?",
790
+ "output": "So should we expect that all the slides from, like the work package six meeting, or the joint work package five work pack, will be up on one of the work package websites?",
791
+ "exact": false,
792
+ "similarity": 0.982,
793
+ "target_coverage": 0.969,
794
+ "forbidden": []
795
+ },
796
+ {
797
+ "i": 68,
798
+ "category": "prose",
799
+ "transcript": "If we need just frequencies, maybe we should just calculate them by using Pearl or something.",
800
+ "target": "If we need just frequencies, maybe we should just calculate them by using Perl or something.",
801
+ "output": "If we need just frequencies, maybe we should just calculate them by using Pearl or something.",
802
+ "exact": false,
803
+ "similarity": 0.995,
804
+ "target_coverage": 0.867,
805
+ "forbidden": []
806
+ },
807
+ {
808
+ "i": 69,
809
+ "category": "prose",
810
+ "transcript": "So so essentially there's this um A E is divided into T R one and C and other stuff. Okay, where C is the construct, the existing thing.",
811
+ "target": "So essentially there's a AE, is divided into TR-one and C, and other stuff, okay, where C is the construct, the existing thing.",
812
+ "output": "So essentially there's this A-E is divided into T-R-one and C, and other stuff, okay, where C is the construct, the existing thing.",
813
+ "exact": false,
814
+ "similarity": 0.969,
815
+ "target_coverage": 0.792,
816
+ "forbidden": []
817
+ },
818
+ {
819
+ "i": 70,
820
+ "category": "prose",
821
+ "transcript": "If I have to do it f like flexibly then I probably then it'll not be significantly more difficult.",
822
+ "target": "If I have to do it flexibly, then I probably\u2014then it will not be significantly more difficult.",
823
+ "output": "If I have to do it, like, flexibly, then I probably\u2014then it'll not be significantly more difficult.",
824
+ "exact": false,
825
+ "similarity": 0.943,
826
+ "target_coverage": 0.824,
827
+ "forbidden": []
828
+ },
829
+ {
830
+ "i": 71,
831
+ "category": "prose",
832
+ "transcript": "And I've uh sent a thing off to Marlo's talk trying to encourage her again to register for the C S V and uh and what to C V S and uh wh what to do and uh which bit of software I use that seems to be quite easy. I was just imagining that okay, and you never",
833
+ "target": "And I've sent a thing off to Marloes Talk trying to encourage her again to register for the CVS, and what to\u2014the CVS, and what to do, and which bit of software I use, that seems to be quite easy and simple.",
834
+ "output": "And I've sent a thing off to Marlo's talk trying to encourage her again to register for the CSV and what to do and which bit of software I use that seems to be quite easy. I was just imagining that, okay, and you never.",
835
+ "exact": false,
836
+ "similarity": 0.715,
837
+ "target_coverage": 0.791,
838
+ "forbidden": []
839
+ },
840
+ {
841
+ "i": 72,
842
+ "category": "prose",
843
+ "transcript": "Yeah, what I did at the moment is um I um yeah, I got the F zero values from for each speaker for his headphone.",
844
+ "target": "Yeah, what I did at the moment is I got the F-zero values from\u2014for each speaker, for his headphone.",
845
+ "output": "Yeah, what I did at the moment is\u2014I, yeah, I got the F-zero values from for each speaker for his headphone.",
846
+ "exact": false,
847
+ "similarity": 0.942,
848
+ "target_coverage": 1.0,
849
+ "forbidden": []
850
+ },
851
+ {
852
+ "i": 73,
853
+ "category": "prose",
854
+ "transcript": "Oh gosh, narrow emission Okay, so I've highlighted this in red and then the whole thing in green because type two C foot galaxies are one.",
855
+ "target": "Oh gosh, no emission line, okay, so I've highlighted this in red, and then the whole thing in green because type two Seyfart galaxies are one.",
856
+ "output": "Oh gosh, narrow emission, okay, so I've highlighted this in red, and then the whole thing in green, because type 2C galaxies are one.",
857
+ "exact": false,
858
+ "similarity": 0.916,
859
+ "target_coverage": 0.731,
860
+ "forbidden": []
861
+ },
862
+ {
863
+ "i": 74,
864
+ "category": "meeting",
865
+ "transcript": "It more and more appears to me that if we if we scrap the notion of the meeting as an individual thing and sort of ch see meetings as as topic segments and have sort of like hierarchical topic segmentation instead.",
866
+ "target": "It more and more appears to me that if we scrap the notion of the meeting as an individual thing and sort of just see meetings as topic segments and have sort of, like, hierarchical topic segmentation instead.",
867
+ "output": "It more and more appears to me that if we scrap the notion of the meeting as an individual thing and sort of\u2014ch-see meetings as topic segments and have sort of like hierarchical topic segmentation instead.",
868
+ "exact": false,
869
+ "similarity": 0.971,
870
+ "target_coverage": 0.946,
871
+ "forbidden": []
872
+ },
873
+ {
874
+ "i": 75,
875
+ "category": "prose",
876
+ "transcript": "So from uh um my analysis of that kind of dialogues, I could say that there's only there are only four basic uh exchanges depend on the information uh direction of information flow.",
877
+ "target": "So from my analysis of that kind of dialogues, I could say that there are only four basic exchanges, depending on the direction of the information flow.",
878
+ "output": "So from my analysis of that kind of dialogues, I could say that there's only\u2014there are only four basic exchanges, depend on the information direction of information flow.",
879
+ "exact": false,
880
+ "similarity": 0.901,
881
+ "target_coverage": 0.846,
882
+ "forbidden": []
883
+ },
884
+ {
885
+ "i": 76,
886
+ "category": "meeting",
887
+ "transcript": "I think they are more talking about um user requirement for the meeting than subtext they want to know.",
888
+ "target": "I think they are more talking about user requirement for the meeting than soft text they want to know.",
889
+ "output": "I think they are more talking about user requirement for the meeting than subtext they want to know.",
890
+ "exact": false,
891
+ "similarity": 0.97,
892
+ "target_coverage": 0.833,
893
+ "forbidden": []
894
+ },
895
+ {
896
+ "i": 77,
897
+ "category": "prose",
898
+ "transcript": "Um I've sorted out uh travel, etcetera, to Munich for uh for Ellen, John and myself.",
899
+ "target": "I've sorted out travel et cetera to Munich for Ellen, John, and myself.",
900
+ "output": "I've sorted out travel, etcetera, to Munich for Ellen, John, and myself.",
901
+ "exact": false,
902
+ "similarity": 0.979,
903
+ "target_coverage": 0.769,
904
+ "forbidden": []
905
+ },
906
+ {
907
+ "i": 78,
908
+ "category": "prose",
909
+ "transcript": "It does make sense from maybe the design point of view'cause if you have more complicated characters like European languages then you need more buttons.",
910
+ "target": "It does make sense from maybe the design point of view, 'cause you have more complicated characters, like European languages, then you need more buttons.",
911
+ "output": "It does make sense from maybe the design point of view, 'cause if you have more complicated characters, like European languages, then you need more buttons.",
912
+ "exact": false,
913
+ "similarity": 0.99,
914
+ "target_coverage": 0.958,
915
+ "forbidden": []
916
+ },
917
+ {
918
+ "i": 79,
919
+ "category": "prose",
920
+ "transcript": "So it's more like a it's uh it's sort of like a quite literal task. So it's really like finding these kind of uh these types of strings uh rather than really referring to the underlying physical reality.",
921
+ "target": "So it's more like\u2014it's sort of like a quite literal task that's really like finding these kind of, these types of strings, rather than really referring to the underlying physical reality.",
922
+ "output": "So it's more like, sort of, like, a quite literal task, so it's really, like, finding these kind of\u2014these types of strings rather than really referring to the underlying physical reality.",
923
+ "exact": false,
924
+ "similarity": 0.941,
925
+ "target_coverage": 0.882,
926
+ "forbidden": []
927
+ },
928
+ {
929
+ "i": 80,
930
+ "category": "prose",
931
+ "transcript": "And yeah, that they have lots of personality and uh be fit and in robust good health.",
932
+ "target": "And yeah, that they have lots of personality, and be fit, and in robust good health.",
933
+ "output": "And yeah, that they have lots of personality, and be fit and in robust good health.",
934
+ "exact": false,
935
+ "similarity": 0.994,
936
+ "target_coverage": 1.0,
937
+ "forbidden": []
938
+ },
939
+ {
940
+ "i": 81,
941
+ "category": "prose",
942
+ "transcript": "And sometimes with the ds uh if you're thinking, are you anticipating a d or you're you trying to say th and you're just saying the the the the the",
943
+ "target": "And sometimes with the\u2014I would be thinking, are you anticipating, or are you trying to say 'the' and you're just saying 'the the the the the'?",
944
+ "output": "And sometimes with the\u2014if you're thinking, are you anticipating a\u2014you're trying to say, you're just saying the\u2014the, the, the, the...",
945
+ "exact": false,
946
+ "similarity": 0.818,
947
+ "target_coverage": 0.63,
948
+ "forbidden": []
949
+ },
950
+ {
951
+ "i": 82,
952
+ "category": "prose",
953
+ "transcript": "So I mean I I do think you should keep in mind what the final goal is so that you can plug this into something at the end and and um show some benefit of having the markup.",
954
+ "target": "So I mean, I do think you should keep in mind what the final goal is, so that you can plug this into something at the end and show some benefit of having the markup.",
955
+ "output": "So I mean, I do think you should keep in mind what the final goal is, so that you can plug this into something at the end and show some benefit of having the markup.",
956
+ "exact": true,
957
+ "similarity": 1.0,
958
+ "target_coverage": 1.0,
959
+ "forbidden": []
960
+ },
961
+ {
962
+ "i": 83,
963
+ "category": "prose",
964
+ "transcript": "But you wouldn't be able to point to something in a spectrum and say that's a damped Lyman Alpha Absorber unless you'd",
965
+ "target": "But you wouldn't be able to point something in a spectrum and say that's a damped Lyman alpha absorber unless you'd...",
966
+ "output": "But you wouldn't be able to point to something in a spectrum and say that's a damped Lyman alpha absorber unless you'd.",
967
+ "exact": false,
968
+ "similarity": 0.979,
969
+ "target_coverage": 0.957,
970
+ "forbidden": []
971
+ },
972
+ {
973
+ "i": 84,
974
+ "category": "meeting",
975
+ "transcript": "So uh and currently I'm more interested in the uh uh in analyzing the disconstruction multi party meetings.",
976
+ "target": "So, currently I'm more interested in, yeah, analysing the discourse structure in multi-party meetings.",
977
+ "output": "So currently I'm more interested in analysing the disconstruction multi-party meetings.",
978
+ "exact": false,
979
+ "similarity": 0.899,
980
+ "target_coverage": 0.6,
981
+ "forbidden": []
982
+ },
983
+ {
984
+ "i": 85,
985
+ "category": "prose",
986
+ "transcript": "In fact, even by inviting um people from um informatics and from well maybe from philosophy and things, it might bias it in a particular direction.",
987
+ "target": "In fact, even by inviting people from Informatics and from\u2014or maybe from Philosophy and things\u2014it might bias it in a particular direction.",
988
+ "output": "In fact, even by inviting people from informatics and from philosophy, it might bias it in a particular direction.",
989
+ "exact": false,
990
+ "similarity": 0.881,
991
+ "target_coverage": 0.739,
992
+ "forbidden": []
993
+ },
994
+ {
995
+ "i": 86,
996
+ "category": "prose",
997
+ "transcript": "But they're they're creating a there. Uh guy, Jonathan, is creating a web form for you to do this all very simply and like just um upload everything that you've uh uh upload the file that you've transcribed and and you'll be noting whether it's the first pass or the second pass and your name um as the person who did that particular pass.",
998
+ "target": "But they're creating\u2014their guy Jonathan is creating a web form for you to do this all very simply, and like just upload everything that you've\u2014upload the file that you've transcribed, and you'll be noting whether it's the first pass or the second pass, and your name as the person who did that particular pass.",
999
+ "output": "But they're creating a\u2014there, guy, Jonathan, is creating a web form for you to do this all very simple, and, like, just upload everything that you've transcribed, and you'll be noting whether it's the first pass or the second pass, and your name as the person who did that particular pass.",
1000
+ "exact": false,
1001
+ "similarity": 0.2,
1002
+ "target_coverage": 0.867,
1003
+ "forbidden": []
1004
+ },
1005
+ {
1006
+ "i": 87,
1007
+ "category": "prose",
1008
+ "transcript": "So one speaker will have the floored channel um throughout that. And so I guess what you're saying is that the interactive sections would have shorter speaker turns when you're not considering the back channels as interruptions.",
1009
+ "target": "So one speaker will have the floor channel throughout that, and so I guess what you're saying is that the interactive sections would have shorter speaker turns when you're not considering the back channels as interruptions.",
1010
+ "output": "So one speaker will have the flopped channel throughout that, and so I guess what you're saying is that the interactive sections would have shorter speaker turns when you're not considering the back channels as interruptions.",
1011
+ "exact": false,
1012
+ "similarity": 0.179,
1013
+ "target_coverage": 0.946,
1014
+ "forbidden": []
1015
+ },
1016
+ {
1017
+ "i": 88,
1018
+ "category": "prose",
1019
+ "transcript": "It's usually a context problem because I think sometimes if it's not intelligible, you either tend to because you really want it to fit the context",
1020
+ "target": "It's usually a context problem, because I think sometimes if it's not intelligible, you either tend to\u2014because you really want it to fit the context.",
1021
+ "output": "It's usually a context problem because I think sometimes if it's not intelligible, you either tend to\u2014because you really want it to fit the context.",
1022
+ "exact": false,
1023
+ "similarity": 0.997,
1024
+ "target_coverage": 1.0,
1025
+ "forbidden": []
1026
+ },
1027
+ {
1028
+ "i": 89,
1029
+ "category": "meeting",
1030
+ "transcript": "Couldn't we couldn't we write one program that calculates all the um f for all our different contributions to the importance measure the um absolute um dialogue act numbers for the meeting?",
1031
+ "target": "Couldn't we write one programme that calculates all the\u2014for all our different contributions to the importance measure, the absolute dialogue act numbers for the meeting?",
1032
+ "output": "Couldn't we write one programme that calculates all the f for all our different contributions to the importance measure, the absolute dialogue act numbers for the meeting?",
1033
+ "exact": false,
1034
+ "similarity": 0.988,
1035
+ "target_coverage": 0.962,
1036
+ "forbidden": [
1037
+ "sure,"
1038
+ ]
1039
+ },
1040
+ {
1041
+ "i": 90,
1042
+ "category": "prose",
1043
+ "transcript": "So no um n no transcriber will be checking no checker will be checking their own transcription.",
1044
+ "target": "So no transcriber will be checking\u2014no checker will be checking their own transcription.",
1045
+ "output": "Transcriber will be checking their own transcription.",
1046
+ "exact": false,
1047
+ "similarity": 0.743,
1048
+ "target_coverage": 0.615,
1049
+ "forbidden": []
1050
+ },
1051
+ {
1052
+ "i": 91,
1053
+ "category": "prose",
1054
+ "transcript": "In some cases we might if it's really tough, we might be in need of a of some sound system to play recordings.",
1055
+ "target": "In some cases we might\u2014if it's really tough we might be in need of some sound system to play recordings.",
1056
+ "output": "In some cases we might\u2014if it's really tough\u2014we might be in need of some sound system to play recordings.",
1057
+ "exact": false,
1058
+ "similarity": 0.99,
1059
+ "target_coverage": 1.0,
1060
+ "forbidden": []
1061
+ },
1062
+ {
1063
+ "i": 92,
1064
+ "category": "prose",
1065
+ "transcript": "So at the moment I'm looking at act actually the GDF format itself. Um and then to generate the GDA format I'm gonna be taking stuff out of the Jest analyzer um and then using the DOM parser to generate uh XML output from the Gest analyzer.",
1066
+ "target": "So at the moment I'm looking at actually the GDF format itself, and then to generate the GDF format I'm gonna be taking stuff out of the gest analyser, and then using a DOM parser to generate XML output from the gest analyser.",
1067
+ "output": "So at the moment I'm looking at\u2014actually, the GDF format itself, and then to generate the GDA format I'm gonna be taking stuff out of the Jest analyzer, and then using the DOM parser to generate XML output from the Gest analyzer.",
1068
+ "exact": false,
1069
+ "similarity": 0.963,
1070
+ "target_coverage": 0.886,
1071
+ "forbidden": []
1072
+ },
1073
+ {
1074
+ "i": 93,
1075
+ "category": "prose",
1076
+ "transcript": "Well what I think I might try and build is basically a class that you just feed it a linked list of um different waveforms.",
1077
+ "target": "Well, what I think I might try and build is basically a class that you just feed it a linked list of different waveforms.",
1078
+ "output": "Well, what I think I might try and build is basically a class that you just feed it a linked list of different waveforms.",
1079
+ "exact": true,
1080
+ "similarity": 1.0,
1081
+ "target_coverage": 1.0,
1082
+ "forbidden": []
1083
+ },
1084
+ {
1085
+ "i": 94,
1086
+ "category": "intent",
1087
+ "transcript": "So I guess um if I'm gonna be segmenting it with a L C Seg then that's the same format I'd want to um put it back out in, so it'd be equivalent.",
1088
+ "target": "So I guess if I'm gonna be segmenting it with an LCSeg, then that's, like, same format I'd want to put it back out in, so it'd be equivalent.",
1089
+ "output": "So I guess, if I'm gonna be segmenting it with a LCS, then that's the same format\u2014I'd want to put it back out in, so it'd be equivalent.",
1090
+ "exact": false,
1091
+ "similarity": 0.953,
1092
+ "target_coverage": 0.844,
1093
+ "forbidden": []
1094
+ },
1095
+ {
1096
+ "i": 95,
1097
+ "category": "prose",
1098
+ "transcript": "Well well a worry that was was expressed in the new requirements was that if we made this too complex it would it it would affect um how long how long it took us to get this to market.",
1099
+ "target": "Well, a worry that was expressed in the new requirements was that, if we made this too complex, it would affect how long it took us to get this to market.",
1100
+ "output": "Well, a worry that was expressed in the new requirements, was that if we made this too complex it would affect how long it took us to get this to market.",
1101
+ "exact": false,
1102
+ "similarity": 0.99,
1103
+ "target_coverage": 1.0,
1104
+ "forbidden": []
1105
+ },
1106
+ {
1107
+ "i": 96,
1108
+ "category": "prose",
1109
+ "transcript": "Um and so um it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1110
+ "target": "And so it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1111
+ "output": "And so it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1112
+ "exact": true,
1113
+ "similarity": 1.0,
1114
+ "target_coverage": 1.0,
1115
+ "forbidden": []
1116
+ },
1117
+ {
1118
+ "i": 97,
1119
+ "category": "prose",
1120
+ "transcript": "Yeah, that's what I thought as well. That you that probably the the topic segment level is the most um informative for the words.",
1121
+ "target": "Yeah, that's what I thought as well, that probably the topic segment level is the most informative for the words.",
1122
+ "output": "Yeah, that's what I thought, you that probably the topic segment level is the most informative for the words.",
1123
+ "exact": false,
1124
+ "similarity": 0.946,
1125
+ "target_coverage": 0.85,
1126
+ "forbidden": []
1127
+ },
1128
+ {
1129
+ "i": 98,
1130
+ "category": "prose",
1131
+ "transcript": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks because it seems to them to be irrelevant because language is irrelevant.",
1132
+ "target": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks, because it seems to them to be irrelevant, 'cause language is irrelevant.",
1133
+ "output": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks, because it seems to them that it's irrelevant because language is irrelevant.",
1134
+ "exact": false,
1135
+ "similarity": 0.864,
1136
+ "target_coverage": 0.889,
1137
+ "forbidden": []
1138
+ },
1139
+ {
1140
+ "i": 99,
1141
+ "category": "prose",
1142
+ "transcript": "It's sort of it's overrunning the f like it. So okay, so at the moment we are that far that if I now click onto a segment here it's",
1143
+ "target": "It's sort of\u2014it's overrunning the F, like, it\u2014so okay, so at the moment we're that far that if I now click onto a segment, it hits.",
1144
+ "output": "It's sort of\u2014overrunning the f, like, it, so okay, so at the moment we are that far, if I now click onto a segment here, it's...",
1145
+ "exact": false,
1146
+ "similarity": 0.88,
1147
+ "target_coverage": 0.733,
1148
+ "forbidden": []
1149
+ }
1150
+ ]
1151
+ }
eval/eval_ami_v2_1_mlx_4w_g32.json ADDED
@@ -0,0 +1,1145 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "overall": {
3
+ "n": 100,
4
+ "forbidden_rate": 0.01,
5
+ "exact_match_rate": 0.03,
6
+ "mean_similarity": 0.6910109849919605,
7
+ "target_coverage": 0.5906611108170149,
8
+ "gates": {
9
+ "forbidden": true,
10
+ "coverage": false
11
+ },
12
+ "mean_tokens_per_sec": 476.51,
13
+ "verdict": "FAIL"
14
+ },
15
+ "by_category": {
16
+ "prose": {
17
+ "n": 83,
18
+ "forbidden_rate": 0.012,
19
+ "exact_match_rate": 0.0361,
20
+ "mean_similarity": 0.7022111087107978,
21
+ "target_coverage": 0.6126178160830319
22
+ },
23
+ "meeting": {
24
+ "n": 14,
25
+ "forbidden_rate": 0.0,
26
+ "exact_match_rate": 0.0,
27
+ "mean_similarity": 0.6459500827682932,
28
+ "target_coverage": 0.4985009530203537
29
+ },
30
+ "intent": {
31
+ "n": 3,
32
+ "forbidden_rate": 0.0,
33
+ "exact_match_rate": 0.0,
34
+ "mean_similarity": 0.5914251058145765,
35
+ "target_coverage": 0.41327300150829566
36
+ }
37
+ },
38
+ "forbidden_hits": {
39
+ "here's the": 1
40
+ },
41
+ "rows": [
42
+ {
43
+ "i": 0,
44
+ "category": "prose",
45
+ "transcript": "Oh, I think it is uh um s starting with um y European, I think.",
46
+ "target": "Oh, I think it's starting with European, I think.",
47
+ "output": "Starting with Y European, I think.",
48
+ "exact": false,
49
+ "similarity": 0.747,
50
+ "target_coverage": 0.444,
51
+ "forbidden": []
52
+ },
53
+ {
54
+ "i": 1,
55
+ "category": "meeting",
56
+ "transcript": "You could just like sort of zoom back out till you've got the full text for that segment or that meeting rather than a summary.",
57
+ "target": "You could just, like, sort of zoom back out so you got the full text for that segment or that meeting rather than a summary.",
58
+ "output": "You could just like sort of zoom back out till you've got the full text for that segment, or that meeting.",
59
+ "exact": false,
60
+ "similarity": 0.852,
61
+ "target_coverage": 0.708,
62
+ "forbidden": []
63
+ },
64
+ {
65
+ "i": 2,
66
+ "category": "prose",
67
+ "transcript": "Um so uh I guess just to confirm that we know what we're doing in the next well, in the thirty minutes after lunch anyway.",
68
+ "target": "So just to confirm that we know what we're doing in the\u2014well, in the thirty minutes after lunch anyway.",
69
+ "output": "Just to confirm that we know what we're doing in the next 30 minutes after lunch, anyway.",
70
+ "exact": false,
71
+ "similarity": 0.865,
72
+ "target_coverage": 0.75,
73
+ "forbidden": []
74
+ },
75
+ {
76
+ "i": 3,
77
+ "category": "intent",
78
+ "transcript": "And you might want to talk to Alex to find out if somebody's already done this turn redwood stuff into tree bank stuff so that they can compare",
79
+ "target": "And you might wanna talk to Alex to find out if somebody's already done this, turn Redwoods stuff into Treebank stuff, so that they can compare.",
80
+ "output": "And you might want to talk to Alex to find out if somebody's already done this turn redwood stuff into tree bank stuff, so that they can compare.",
81
+ "exact": false,
82
+ "similarity": 0.955,
83
+ "target_coverage": 0.769,
84
+ "forbidden": []
85
+ },
86
+ {
87
+ "i": 4,
88
+ "category": "prose",
89
+ "transcript": "Because it's quite easy in Pearl as well. It's just a line of code for counting all the words and Yeah, it's it's by hashes.",
90
+ "target": "Because it's quite easy in Perl as well, it's just a line of code for counting all the words, and yeah, it's by hashes.",
91
+ "output": "Because it's quite easy in Pearl, as well. It's just a line of code for counting all the words.",
92
+ "exact": false,
93
+ "similarity": 0.85,
94
+ "target_coverage": 0.731,
95
+ "forbidden": []
96
+ },
97
+ {
98
+ "i": 5,
99
+ "category": "prose",
100
+ "transcript": "If if your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
101
+ "target": "If your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
102
+ "output": "If your intention is to move the red triangle to sit on top of the thing already constructed, you would tend to look back and forth.",
103
+ "exact": true,
104
+ "similarity": 1.0,
105
+ "target_coverage": 1.0,
106
+ "forbidden": []
107
+ },
108
+ {
109
+ "i": 6,
110
+ "category": "prose",
111
+ "transcript": "Um one thing that would be convenient for all sorts of things and which I haven't found out about it is how to do tool tips in an arbitrary way in in in swing graphic displays.",
112
+ "target": "One thing that would be convenient for all sorts of things, and which I haven't found out about, is how to do tooltips in an arbitrary way in Swing graphic displays.",
113
+ "output": "One thing that would be convenient for all sorts of things, and which I haven't found out about, is how to do tool tips in an arbitrary way in in Swing graphics displays.",
114
+ "exact": false,
115
+ "similarity": 0.985,
116
+ "target_coverage": 0.871,
117
+ "forbidden": []
118
+ },
119
+ {
120
+ "i": 7,
121
+ "category": "prose",
122
+ "transcript": "What we've finally just uh at twelve o'clock today, looks like we've got it sussed, um, is to get one channel one microphone being the left channel and one being the right channel to merge into a stereo single file.",
123
+ "target": "What we've finally just at twelve o'clock today, looks like we've got it sussed, is to get one channel, one microphone being the left channel, and one being the right channel, to merge into a stereo single file.",
124
+ "output": "At 12 o'clock today, looks like we've got it sussed, um, is to get one channel1 and one microphone.",
125
+ "exact": false,
126
+ "similarity": 0.155,
127
+ "target_coverage": 0.375,
128
+ "forbidden": []
129
+ },
130
+ {
131
+ "i": 8,
132
+ "category": "prose",
133
+ "transcript": "I'm just thinking of you know, ill utterance consisting entirely of laughter and then putting like punctuation in like ha ha ha ha just",
134
+ "target": "I'm just thinking of, you know, an utterance consisting entirely of laughter, and then putting like punctuation in, like...",
135
+ "output": "I'm just thinking of you.",
136
+ "exact": false,
137
+ "similarity": 0.338,
138
+ "target_coverage": 0.263,
139
+ "forbidden": []
140
+ },
141
+ {
142
+ "i": 9,
143
+ "category": "prose",
144
+ "transcript": "So we could zip we could zip through this and look at all the um all the interactions in which people built subcontracts first, which we expect them to do as a wild hypothesis more when they have verbal communication than when they don't.",
145
+ "target": "So we could zip through this and look at all the interactions in which people build subconstructs first, which we expect them to do, but as a wild hypothesis more when they have verbal communication than when they don't.",
146
+ "output": "We could zip through this and look at all the interactions in which people built subcontracts. First, they should do as a wild hypothesis, more when they have verbal communication than when they don't.",
147
+ "exact": false,
148
+ "similarity": 0.375,
149
+ "target_coverage": 0.692,
150
+ "forbidden": []
151
+ },
152
+ {
153
+ "i": 10,
154
+ "category": "prose",
155
+ "transcript": "I'm I I'm getting quite lost um at the moment because um what's um our difference between the um s um uh the importance measure and the skimming?",
156
+ "target": "I'm getting quite lost at the moment because what's our difference between the importance measure and the skimming?",
157
+ "output": "Our difference between the importance measure and the skimming.",
158
+ "exact": false,
159
+ "similarity": 0.685,
160
+ "target_coverage": 0.421,
161
+ "forbidden": []
162
+ },
163
+ {
164
+ "i": 11,
165
+ "category": "prose",
166
+ "transcript": "Which if you just said that it's gone Peterson absorption from neutral hydrogen rather than i if it was a if it was hydrogen absorption",
167
+ "target": "Which, if you just said that it's Gunn-Petersen absorption from neutral hydrogen rather than\u2014if it was a\u2014if it was hydrogen absorption.",
168
+ "output": "- If you just said that it's gone, Peterson absorption from neutral hydrogen rather than I\n- If it was a,",
169
+ "exact": false,
170
+ "similarity": 0.75,
171
+ "target_coverage": 0.667,
172
+ "forbidden": []
173
+ },
174
+ {
175
+ "i": 12,
176
+ "category": "prose",
177
+ "transcript": "So what I'm having is so we we had a we had a long problem about not finding out why the time syncing up between the relative time in a in a sort of in a in a summarized section and the absolute time didn't correspond and stuff.",
178
+ "target": "So what I'm having is, so we had a long problem about not finding out why the time-syncing up between the relative time in a sort of summarised section and the absolute time didn't correspond and stuff.",
179
+ "output": "So what I'm having is so we had a long problem about not finding out why the time syncing up between the relative time in a in a sort of in a summarized section and the absolute time didn't correspond.",
180
+ "exact": false,
181
+ "similarity": 0.864,
182
+ "target_coverage": 0.897,
183
+ "forbidden": []
184
+ },
185
+ {
186
+ "i": 13,
187
+ "category": "meeting",
188
+ "transcript": "So interactivity is a concept is a concept that I'm using to distinguish the two uh uh extremes of uh of interact uh of discourse in meetings.",
189
+ "target": "So 'interactivity' is a concept that I'm using to distinguish the two extremes of discourse in meetings.",
190
+ "output": "Interactivity is a concept, is a concept that I'm using to distinguish the two.",
191
+ "exact": false,
192
+ "similarity": 0.699,
193
+ "target_coverage": 0.647,
194
+ "forbidden": []
195
+ },
196
+ {
197
+ "i": 14,
198
+ "category": "intent",
199
+ "transcript": "And um so far um I think uh it's uh I think it it's uh still um about the s about the same level of segmentation we are talking here.",
200
+ "target": "And so far I think it's still about the same level of segmentation we're talking here.",
201
+ "output": "Still about the same level of segmentation we are talking here.",
202
+ "exact": false,
203
+ "similarity": 0.805,
204
+ "target_coverage": 0.471,
205
+ "forbidden": []
206
+ },
207
+ {
208
+ "i": 15,
209
+ "category": "prose",
210
+ "transcript": "As long as other people don't for some reason, I don't know, disconnect some bits of the equipment, there's no reason why they should.",
211
+ "target": "That as long as other people don't, for some reason\u2014I don't know, disconnect some bits of the equipment\u2014there's no reason why they should.",
212
+ "output": "As long as other people don't for some reason, I don't know, disconnect some bits of the equipment, there's no reason why they should.",
213
+ "exact": false,
214
+ "similarity": 0.949,
215
+ "target_coverage": 0.963,
216
+ "forbidden": []
217
+ },
218
+ {
219
+ "i": 16,
220
+ "category": "prose",
221
+ "transcript": "It's fairly general. Um and I guess the purpose of this is also not to restrict you in in the way you're thinking, like um, voice recognition.",
222
+ "target": "It's fairly general, and I guess the purpose of this is also not to restrict you in the way you're thinking, like voice recognition.",
223
+ "output": "It's fairly general. And I guess the purpose of this is also not to restrict you in the way you're thinking, like:\n\n- Voice recognition",
224
+ "exact": false,
225
+ "similarity": 0.959,
226
+ "target_coverage": 1.0,
227
+ "forbidden": []
228
+ },
229
+ {
230
+ "i": 17,
231
+ "category": "prose",
232
+ "transcript": "W within the sentence that you're sort of currently looking at, um feel free to correct it that way that you like it's not only about resolution but sort of like coming up with a corrected version on these on these places.",
233
+ "target": "Within the sentence that you sort of currently looking at, feel free to correct it that way, that you'll do, you know, like, it's not only about resolution but it's sort of like coming up with a corrected version based on these.",
234
+ "output": "Sort of currently looking at, feel free to correct it that way, you like it's not only about resolution but coming up with a corrected version on these places.",
235
+ "exact": false,
236
+ "similarity": 0.682,
237
+ "target_coverage": 0.591,
238
+ "forbidden": []
239
+ },
240
+ {
241
+ "i": 18,
242
+ "category": "prose",
243
+ "transcript": "And there will also be presumably some kind of task hierarchy modeling going on in I mean,'cause the whole browser working group um final um sort of presentation on that second day was about",
244
+ "target": "And there will also be, presumably, some kind of task hierarchy modelling going on, in\u2014I mean, 'cause the whole browser working group final, sort of, presentation on that second day was about...",
245
+ "output": "And there will also be presumably some kind of task hierarchy modeling going on in IME.",
246
+ "exact": false,
247
+ "similarity": 0.598,
248
+ "target_coverage": 0.375,
249
+ "forbidden": []
250
+ },
251
+ {
252
+ "i": 19,
253
+ "category": "prose",
254
+ "transcript": "Uh right, well basically um high priority for any animal for me is that they be willing to take a lot of physical affection from their family.",
255
+ "target": "Right, well, basically high priority for any animal, for me, is that they be willing to take a lot of physical affection from their family.",
256
+ "output": "High-priority for any animal for me is that they be willing to take a lot of physical affection from their family.",
257
+ "exact": false,
258
+ "similarity": 0.885,
259
+ "target_coverage": 0.875,
260
+ "forbidden": []
261
+ },
262
+ {
263
+ "i": 20,
264
+ "category": "prose",
265
+ "transcript": "It took like the third time till I thought, Oh, you're saying F five.",
266
+ "target": "It took, like, the third time till I thought, oh, you're saying F-five.",
267
+ "output": "It took like the third time till I thought, Oh, you're saying F5.",
268
+ "exact": false,
269
+ "similarity": 0.926,
270
+ "target_coverage": 0.857,
271
+ "forbidden": []
272
+ },
273
+ {
274
+ "i": 21,
275
+ "category": "prose",
276
+ "transcript": "Because, you know, algorithmically you're you're already putting together I mean this is essentially already, you know, these fixations with stuff in between.",
277
+ "target": "Because, you know, algorithmically, you're already putting together\u2014I mean, this is essentially already, you know, these fixations with stuff in between.",
278
+ "output": "These fixations with stuff in between.",
279
+ "exact": false,
280
+ "similarity": 0.387,
281
+ "target_coverage": 0.227,
282
+ "forbidden": []
283
+ },
284
+ {
285
+ "i": 22,
286
+ "category": "prose",
287
+ "transcript": "Yeah. Uh right, damp life enough. See again, that's uh these are source types. Um I mean it's not a source type.",
288
+ "target": "Right, damped Lyman\u2014see, again, that's\u2014these are source types\u2014the, I mean, it's not a source type.",
289
+ "output": "These are source types.",
290
+ "exact": false,
291
+ "similarity": 0.364,
292
+ "target_coverage": 0.158,
293
+ "forbidden": []
294
+ },
295
+ {
296
+ "i": 23,
297
+ "category": "prose",
298
+ "transcript": "So mm so for dialogue, yeah, mm there would be uh some kind of uh interaction structure.",
299
+ "target": "So for dialogue, yeah, there would be some kind of interaction structure.",
300
+ "output": "...",
301
+ "exact": false,
302
+ "similarity": 0.026,
303
+ "target_coverage": 0.0,
304
+ "forbidden": []
305
+ },
306
+ {
307
+ "i": 24,
308
+ "category": "prose",
309
+ "transcript": "Well, I could look'cause I I've got that there's the list, isn't there, of postgraduates that I maintain in in linguistics.",
310
+ "target": "Well, I could look, 'cause I've got\u2014that's the list, isn't there, of postgraduates I maintain in linguistics.",
311
+ "output": "I've got that, there's the list, isn't there, of postgraduates that I maintain in linguistics.",
312
+ "exact": false,
313
+ "similarity": 0.798,
314
+ "target_coverage": 0.65,
315
+ "forbidden": [
316
+ "here's the"
317
+ ]
318
+ },
319
+ {
320
+ "i": 25,
321
+ "category": "prose",
322
+ "transcript": "Um but the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel and um make sure that no back channels were lost, for example.",
323
+ "target": "But the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel, and make sure that no back channels were lost, for example.",
324
+ "output": "But the extra step that we're asking you to do in this case is to look at the silent regions and listen to them for each channel.",
325
+ "exact": false,
326
+ "similarity": 0.811,
327
+ "target_coverage": 0.711,
328
+ "forbidden": []
329
+ },
330
+ {
331
+ "i": 26,
332
+ "category": "meeting",
333
+ "transcript": "Are they doing um uh are are they uh as in the kickoff meeting just exchanging information to get started with the project or are they uh actually addressing some specific design um criterion at the moment?",
334
+ "target": "Are they doing, are they\u2014as in the kick-off meeting just exchanging information to get started with a project, or are they actually addressing some specific design criteria at the moment?",
335
+ "output": "Are they doing...?",
336
+ "exact": false,
337
+ "similarity": 0.146,
338
+ "target_coverage": 0.129,
339
+ "forbidden": []
340
+ },
341
+ {
342
+ "i": 27,
343
+ "category": "prose",
344
+ "transcript": "Would we wanna ask them and put some kind of like proviso in to make it um specific to sort of preemptively",
345
+ "target": "Would we wanna ask them and put some kind of, like, provisor in to make it specific, to sort of preemptively...",
346
+ "output": "Would we wanna ask them and put some kind of proviso in to make it specific to sort of preemptively?",
347
+ "exact": false,
348
+ "similarity": 0.938,
349
+ "target_coverage": 0.85,
350
+ "forbidden": []
351
+ },
352
+ {
353
+ "i": 28,
354
+ "category": "prose",
355
+ "transcript": "And there's especially one there that um I think he's Eastern European and I think that's the only reason I can understand what he's saying at all.",
356
+ "target": "And there's especially one there that, I think he's Eastern European, and I think that's the only reason I can understand what he's saying at all.",
357
+ "output": "And there's especially one there that I think he's Eastern European and I think that's the only reason I can understand what he's saying at all.",
358
+ "exact": false,
359
+ "similarity": 0.993,
360
+ "target_coverage": 1.0,
361
+ "forbidden": []
362
+ },
363
+ {
364
+ "i": 29,
365
+ "category": "meeting",
366
+ "transcript": "Because um I I think it's actually very similar to what I did for my um speaker um uh extraction and I think I would perhaps have to change two lines of code to get you um for each meeting a file that says fr from um this millisecond to this millisecond there was this sequence of words.",
367
+ "target": "Because I think it's actually very similar to what I did for my speaker extraction, and I think I would perhaps have to change two lines of code to get you, for each meeting, a file that says from this millisecond to this millisecond there was this sequence of words.",
368
+ "output": "Because I think it's actually very similar to what I did for my speaker, extraction and I think I would perhaps have to change two lines of code to get you for each meeting. a file that says FR from um this millisecond to this millisecond.",
369
+ "exact": false,
370
+ "similarity": 0.64,
371
+ "target_coverage": 0.84,
372
+ "forbidden": []
373
+ },
374
+ {
375
+ "i": 30,
376
+ "category": "prose",
377
+ "transcript": "I would just try to keep segments very manageable. Um and but y you use these uh waveforms to help you.",
378
+ "target": "I would just try to keep segments very manageable, but, you know, use these waveforms to help you.",
379
+ "output": "Use these waveforms to help you.",
380
+ "exact": false,
381
+ "similarity": 0.477,
382
+ "target_coverage": 0.294,
383
+ "forbidden": []
384
+ },
385
+ {
386
+ "i": 31,
387
+ "category": "prose",
388
+ "transcript": "Um right into the call that we are considering the idea of having a poster session.",
389
+ "target": "Write into the call that we are considering the idea of having a poster session.",
390
+ "output": "Right into the call that we are considering the idea of having a poster session.",
391
+ "exact": false,
392
+ "similarity": 0.963,
393
+ "target_coverage": 0.929,
394
+ "forbidden": []
395
+ },
396
+ {
397
+ "i": 32,
398
+ "category": "prose",
399
+ "transcript": "Well I'm I'm I'm I'm trying tr I'm making sure that the GDA format we've got at the moment will will output the well output all the analysis that that Robin's looking for.",
400
+ "target": "Well, I'm just trying\u2014I'm making sure that the GDF format we've got at the moment will output\u2014say, well, I've output old analysis that Robin's looking for.",
401
+ "output": "Trying tr, making sure that the GDA format we've got at the moment will output the well output, all the analysis that Robin's looking for.",
402
+ "exact": false,
403
+ "similarity": 0.826,
404
+ "target_coverage": 0.5,
405
+ "forbidden": []
406
+ },
407
+ {
408
+ "i": 33,
409
+ "category": "prose",
410
+ "transcript": "I can just add SSH stuff in to ev evoke the sound tools on the uh on dice and then copy them back.",
411
+ "target": "I can just add SSH stuff in to evoke the sound tools on Dice, and then copy 'em back.",
412
+ "output": "Add SSH stuff in to evoke the sound tools on the UH, and then copy them back.",
413
+ "exact": false,
414
+ "similarity": 0.852,
415
+ "target_coverage": 0.611,
416
+ "forbidden": []
417
+ },
418
+ {
419
+ "i": 34,
420
+ "category": "prose",
421
+ "transcript": "have all the l lines of actually lots of different elements and you have to work out like all of the ones which are iron lines.",
422
+ "target": "You have all the lines of actually lots of different elements, and you have to work out at all the ones which are ion lines.",
423
+ "output": "Have all the L lines of actually lots of different elements and you have to work out like all of the ones which are iron lines.",
424
+ "exact": false,
425
+ "similarity": 0.924,
426
+ "target_coverage": 0.792,
427
+ "forbidden": []
428
+ },
429
+ {
430
+ "i": 35,
431
+ "category": "prose",
432
+ "transcript": "Um suppose it doesn't really matter as long as they're unique and it can I can pass them back to you and you can use that to the display.",
433
+ "target": "I suppose it doesn't really matter as long as they're unique, and I can pass 'em back to you and you can use that to the display.",
434
+ "output": "Suppose it doesn't really matter, as long as they're unique and it can.",
435
+ "exact": false,
436
+ "similarity": 0.67,
437
+ "target_coverage": 0.429,
438
+ "forbidden": []
439
+ },
440
+ {
441
+ "i": 36,
442
+ "category": "prose",
443
+ "transcript": "So um I don't know, just just to to ask now if you've got anything else you've thought about while we've been talking.",
444
+ "target": "So, dunno, just to ask now if you've got anything else you've thought about while we've been talking.",
445
+ "output": "Just to ask now, if you've got anything else you've thought about while we've been talking.",
446
+ "exact": false,
447
+ "similarity": 0.927,
448
+ "target_coverage": 0.9,
449
+ "forbidden": []
450
+ },
451
+ {
452
+ "i": 37,
453
+ "category": "meeting",
454
+ "transcript": "I mean there probably are a bunch of issues like if you've got a hundred hours of meetings and they all talk about a lot of the same things.",
455
+ "target": "I mean, there probably are a bunch of issues, like, if you've got a hundred hours of meetings and they all talk about a lot of the same things.",
456
+ "output": "There probably are a bunch of issues.",
457
+ "exact": false,
458
+ "similarity": 0.4,
459
+ "target_coverage": 0.207,
460
+ "forbidden": []
461
+ },
462
+ {
463
+ "i": 38,
464
+ "category": "prose",
465
+ "transcript": "Um at least it works if there are several categories with each with one document each, but it um",
466
+ "target": "At least it works if there are several categories, with each, with one document each, but it\u2014yeah.",
467
+ "output": "At least it works if there are several categories, with each one document.",
468
+ "exact": false,
469
+ "similarity": 0.86,
470
+ "target_coverage": 0.647,
471
+ "forbidden": []
472
+ },
473
+ {
474
+ "i": 39,
475
+ "category": "prose",
476
+ "transcript": "Suppose we pick up an we we we screwed up the first time we put the triangle with the square and we threw it away. We decided we didn't like it.",
477
+ "target": "Suppose we screwed up the first time we put the triangle with the square, and we threw it away and decided we didn't like it.",
478
+ "output": "We decided we didn't like it.",
479
+ "exact": false,
480
+ "similarity": 0.364,
481
+ "target_coverage": 0.2,
482
+ "forbidden": []
483
+ },
484
+ {
485
+ "i": 40,
486
+ "category": "prose",
487
+ "transcript": "I think proportional like I even though I'm I'm always getting myself confused about this, but I think sort of making the summary length thing generally proportional",
488
+ "target": "I think proportion, like, even though I'm always getting myself confused about this, but I think sort of making the summary length thing generally proportion.",
489
+ "output": "I think proportional, but I'm always getting myself confused about this, but I'm making the summary length thing generally proportional.",
490
+ "exact": false,
491
+ "similarity": 0.871,
492
+ "target_coverage": 0.64,
493
+ "forbidden": []
494
+ },
495
+ {
496
+ "i": 41,
497
+ "category": "prose",
498
+ "transcript": "Uh what el uh well I'll I'll have to get to grips with Cra Camtasia uh properly. Uh to generate a little sort of introductory video, I suppose, uh for instructional purposes at the beginning of the experiment.",
499
+ "target": "Well, I'll have to get to grips with Camtasia properly to generate a little sort of introductory video, I suppose, for instructional purposes at the beginning of the experiment.",
500
+ "output": "Uh...well, I'll have to get to grips with CraCamtasia, properly.",
501
+ "exact": false,
502
+ "similarity": 0.448,
503
+ "target_coverage": 0.276,
504
+ "forbidden": []
505
+ },
506
+ {
507
+ "i": 42,
508
+ "category": "prose",
509
+ "transcript": "Um what I because nine megabyte is what I got for when I said for every um utterance. This goes from there to there and",
510
+ "target": "What I\u2014because nine megabytes is what I got for when I said for every utterance, this goes from there to there, and...",
511
+ "output": "This goes from there to there.",
512
+ "exact": false,
513
+ "similarity": 0.392,
514
+ "target_coverage": 0.227,
515
+ "forbidden": []
516
+ },
517
+ {
518
+ "i": 43,
519
+ "category": "prose",
520
+ "transcript": "If via the wasn't in there then you'd have it silicon two lines at but without with via the I think that means silicon two derived from these two features.",
521
+ "target": "If it wasn't in there, then you'd have it 'silicone two lines at' but without\u2014with the\u2014I think that means silicone two derived from these two features.",
522
+ "output": "If via the wasn't in there, you'd have it Silicon2.",
523
+ "exact": false,
524
+ "similarity": 0.436,
525
+ "target_coverage": 0.207,
526
+ "forbidden": []
527
+ },
528
+ {
529
+ "i": 44,
530
+ "category": "prose",
531
+ "transcript": "So what I've been thinking is maybe if we try to really make sense together of the XML format to be sure that we can all produce the data that we are producing in a way or at least I mean, I guess my data I'll probably load in from completely different way anyway because it's a matrix.",
532
+ "target": "So what I've been thinking is, maybe if we try to really make sense together of the XML format to be sure that we can all produce the data that we are producing in a way\u2014or at least, I mean, I guess my data I'll probably load in from completely different way anyway because it's matrix.",
533
+ "output": "So what I've been thinking is maybe if we try to really make sense together of the XML format, to be sure that we can all produce the data that we are producing in a way, or at least I'll remember, I'll probably load in from completely different way anyway because it's a matrix.",
534
+ "exact": false,
535
+ "similarity": 0.396,
536
+ "target_coverage": 0.881,
537
+ "forbidden": []
538
+ },
539
+ {
540
+ "i": 45,
541
+ "category": "prose",
542
+ "transcript": "Mm. Cause uh so for the information and action the uh the action here is not direct but uh some kind of uh uh physical action uh that uh the uh participants uh i is going to uh or has done in the past.",
543
+ "target": "'Cause, so, for the information and action, the action here is not dialogue act but some kind of physical action that the participant is going to or has done in the past.",
544
+ "output": "...",
545
+ "exact": false,
546
+ "similarity": 0.012,
547
+ "target_coverage": 0.0,
548
+ "forbidden": []
549
+ },
550
+ {
551
+ "i": 46,
552
+ "category": "meeting",
553
+ "transcript": "J because uh after talking to Jim, um just uh we have different ideas whether um meeting action will be about the same size as topic segments.",
554
+ "target": "Because after talking to Jane, just\u2014we have different ideas whether meeting action will be about the same size as topic segments.",
555
+ "output": "J because uh after talking to Jim,\n\n- meeting\n- action\n- will\n- be\n- about\n- topic\n- segments",
556
+ "exact": false,
557
+ "similarity": 0.631,
558
+ "target_coverage": 0.333,
559
+ "forbidden": []
560
+ },
561
+ {
562
+ "i": 47,
563
+ "category": "prose",
564
+ "transcript": "uh i it's also going to be a problem, uh, because you're going to have one part or construct forming in the middle of a fixation.",
565
+ "target": "It's also going to be a problem because you're going to have one part or a construct forming in the middle of a fixation.",
566
+ "output": "It's also going to be a problem, because you're going to have one part or constructing forming in the middle of a fixation.",
567
+ "exact": false,
568
+ "similarity": 0.975,
569
+ "target_coverage": 0.88,
570
+ "forbidden": []
571
+ },
572
+ {
573
+ "i": 48,
574
+ "category": "prose",
575
+ "transcript": "Um it ties you down perhaps a bit later on in terms of the technologies, um, how far you can transmit a signal or the complexity of the functions that you want.",
576
+ "target": "It ties you down perhaps a bit later on in terms of the technologies, how far you can transmit the signal, or the complexity of the functions that you want.",
577
+ "output": "It ties you down, perhaps a bit later on in terms of the technologies.",
578
+ "exact": false,
579
+ "similarity": 0.611,
580
+ "target_coverage": 0.483,
581
+ "forbidden": []
582
+ },
583
+ {
584
+ "i": 49,
585
+ "category": "prose",
586
+ "transcript": "Like that initially had quite different ideas about the phrase types and and markations and then eventually you came up with some kind of rules that you set up between uh the two of you.",
587
+ "target": "Like, that initially had quite different ideas about the phrase types and markations, and then eventually you came up with some kind of rules that you set up between the two of you.",
588
+ "output": "Initially had quite different ideas about the phrase types and markings. Then eventually you came up with some kind of rules that you set up between.",
589
+ "exact": false,
590
+ "similarity": 0.879,
591
+ "target_coverage": 0.719,
592
+ "forbidden": []
593
+ },
594
+ {
595
+ "i": 50,
596
+ "category": "meeting",
597
+ "transcript": "And so I think going through the presentations that um were given at the work package six meeting where um I think it was um it wasn't w was it Anita or was it oh I've forgotten her name.",
598
+ "target": "And so I think going through the presentations that were given at the work package six meeting, where, and I think it was\u2014it wasn't\u2014was it Anita, or was it\u2014oh, I've forgotten her name.",
599
+ "output": "And so I think going through the presentations that were given at the work package 6 meeting, where I think it was it wasn't w was it.",
600
+ "exact": false,
601
+ "similarity": 0.824,
602
+ "target_coverage": 0.622,
603
+ "forbidden": []
604
+ },
605
+ {
606
+ "i": 51,
607
+ "category": "prose",
608
+ "transcript": "Um frequencies or something. Um as well as um characters, um different uh keypad styles and symbols.",
609
+ "target": "Frequencies or something, as well as characters, different keypad styles and symbols.",
610
+ "output": "Frequencies:\n- Keypad styles\n- Symbols",
611
+ "exact": false,
612
+ "similarity": 0.504,
613
+ "target_coverage": 0.091,
614
+ "forbidden": []
615
+ },
616
+ {
617
+ "i": 52,
618
+ "category": "prose",
619
+ "transcript": "a couple of hours getting photocopies of degree certificates to give you for your files if I'm just gonna be here'cause they want I think it that one place it said give us copies of degree",
620
+ "target": "A couple of hours getting photocopies of degree certificates to give you for your files, if I'm just gonna be here a good\u2014they won't, I think at one place it said give us copies of degrees.",
621
+ "output": "A couple of hours getting photocopies of degree certificates to give you for your files. If I'm just gonna be here, because they want. It's give us copies of degree.",
622
+ "exact": false,
623
+ "similarity": 0.864,
624
+ "target_coverage": 0.632,
625
+ "forbidden": []
626
+ },
627
+ {
628
+ "i": 53,
629
+ "category": "prose",
630
+ "transcript": "What um the kinds of events that we had uh before talked about putting into the record for then use in Alan and NXT isn't based on saying every X second something",
631
+ "target": "What\u2014the kinds of events that we had before talked about putting into the record for then use in ELAN and NXT isn't based on saying every X seconds something.",
632
+ "output": "The kinds of events that we had before talked about putting into the record for then use in Alan and NXT isn't based on saying every X second.",
633
+ "exact": false,
634
+ "similarity": 0.92,
635
+ "target_coverage": 0.833,
636
+ "forbidden": []
637
+ },
638
+ {
639
+ "i": 54,
640
+ "category": "prose",
641
+ "transcript": "Mm we were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
642
+ "target": "We were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
643
+ "output": "We were doing descriptions that made things separate classes, in which case I'd argue for elliptical, I think.",
644
+ "exact": true,
645
+ "similarity": 1.0,
646
+ "target_coverage": 1.0,
647
+ "forbidden": []
648
+ },
649
+ {
650
+ "i": 55,
651
+ "category": "meeting",
652
+ "transcript": "So uh in meetings I uh from my uh reading of the one of the M meetings IS one oh eight uh the uh the four meetings",
653
+ "target": "So in meetings, from my reading of one of the AMI meetings, IS one O eight, the four meetings.",
654
+ "output": "In meetings:\n- Reading of the one of the M meetings\n- The four meetings",
655
+ "exact": false,
656
+ "similarity": 0.715,
657
+ "target_coverage": 0.333,
658
+ "forbidden": []
659
+ },
660
+ {
661
+ "i": 56,
662
+ "category": "meeting",
663
+ "transcript": "And then between us we'll have to have another meeting and and I mean, at the same time as we're sorting through all the other titles and and deciding um how to divide up the sessions.",
664
+ "target": "And then between us we'll have to have another meeting, and I mean, at the same time as we're sorting through all the other titles and deciding how to divide up the sessions.",
665
+ "output": "And then between us we'll have to have another meeting.",
666
+ "exact": false,
667
+ "similarity": 0.48,
668
+ "target_coverage": 0.294,
669
+ "forbidden": []
670
+ },
671
+ {
672
+ "i": 57,
673
+ "category": "prose",
674
+ "transcript": "So this person left out a lot of N punctuation and um here's a case where I think she was transcribing an outbreath, um, or possibly an in breath, I uh in and used the hash mark.",
675
+ "target": "So this person left out a lot of end punctuation, and here's a case where I think she was transcribing an out-breath, or possibly an in-breath, in, and used the hash mark.",
676
+ "output": "Here's a case where I think she was transcribing an outbreath, I use the hash mark.",
677
+ "exact": false,
678
+ "similarity": 0.638,
679
+ "target_coverage": 0.353,
680
+ "forbidden": []
681
+ },
682
+ {
683
+ "i": 58,
684
+ "category": "prose",
685
+ "transcript": "And I actually uh think that that's a slightly extreme um position um with regard to the literature that a lot of people might say it doesn't really matter who the different speakers are in an interactive section.",
686
+ "target": "And I actually think that that's a slightly extreme position with regard to the literature, that a lot of people might say it doesn't really matter who the different speakers are in an interactive section.",
687
+ "output": "And I actually think that's a slightly extreme position, with regard to the literature that a lot of people might say it doesn't really matter.",
688
+ "exact": false,
689
+ "similarity": 0.345,
690
+ "target_coverage": 0.722,
691
+ "forbidden": []
692
+ },
693
+ {
694
+ "i": 59,
695
+ "category": "prose",
696
+ "transcript": "Oh, I had one guy, one of the project managers was um he had a really weird accent and he was calling um one guy Mr. Red.",
697
+ "target": "Oh, I had one guy\u2014one of the project managers was, he had a really weird accent and he was calling one guy 'Mister Ed'.",
698
+ "output": "Oh, I had one guy, one of the project managers was he had a really weird accent and he was calling one guy Mr. Red.",
699
+ "exact": false,
700
+ "similarity": 0.923,
701
+ "target_coverage": 0.917,
702
+ "forbidden": []
703
+ },
704
+ {
705
+ "i": 60,
706
+ "category": "prose",
707
+ "transcript": "By now I just had a look at the year data. Um and actually the average F zero deviation is only slightly higher for the positive ones than for the negative ones.",
708
+ "target": "By now, I just had a look at the data, and actually the average F-zero deviation is only slightly higher for the positive ones than for the negative ones.",
709
+ "output": "By now, I just had a look at the year data. And actually, the average F0 deviation is only slightly higher for the positive ones than for the negative ones.",
710
+ "exact": false,
711
+ "similarity": 0.948,
712
+ "target_coverage": 0.862,
713
+ "forbidden": []
714
+ },
715
+ {
716
+ "i": 61,
717
+ "category": "prose",
718
+ "transcript": "Um I would recommend I've found that it's easier when you're checking and you're trying to make sure the boundaries are right for a speech segment.",
719
+ "target": "I would recommend\u2014I've found that it's easier when you're checking and you're trying to make sure the boundaries are right for a speech segment.",
720
+ "output": "I would recommend I've found that it's easier when you're checking and you're trying to make sure the boundaries are right for a speech segment.",
721
+ "exact": false,
722
+ "similarity": 0.993,
723
+ "target_coverage": 1.0,
724
+ "forbidden": []
725
+ },
726
+ {
727
+ "i": 62,
728
+ "category": "prose",
729
+ "transcript": "But the the text for the actual call, is she going to rework something or uh I think she should",
730
+ "target": "But the text for the actual call, is she going to rework something, or she should?",
731
+ "output": "She should rework something.",
732
+ "exact": false,
733
+ "similarity": 0.418,
734
+ "target_coverage": 0.133,
735
+ "forbidden": []
736
+ },
737
+ {
738
+ "i": 63,
739
+ "category": "prose",
740
+ "transcript": "We've got we've got all the data in the ASCII format at the moment, and it's just a matter of what data do we need to pull out of that into the GDF so I can actually do the prop analysis.",
741
+ "target": "'Cause we got all this in the ASCII format at the moment, and it's just a matter of what data do we need to pull out of that into the GDF, so I can actually do the proper analysis.",
742
+ "output": "We've got all the data in the ASCII format at the moment, and it's just a matter of what data we need to pull out of that into the GDF so I can actually do the prop analysis.",
743
+ "exact": false,
744
+ "similarity": 0.932,
745
+ "target_coverage": 0.795,
746
+ "forbidden": []
747
+ },
748
+ {
749
+ "i": 64,
750
+ "category": "prose",
751
+ "transcript": "I think it's'cause we had to specify it ourselves that it's not as um like focus a specification of most um work we have to do.",
752
+ "target": "I think it's 'cause we had to specify it ourselves, that it's not as, like, focus the specification of most work we have to do.",
753
+ "output": "We had to do.",
754
+ "exact": false,
755
+ "similarity": 0.171,
756
+ "target_coverage": 0.115,
757
+ "forbidden": []
758
+ },
759
+ {
760
+ "i": 65,
761
+ "category": "prose",
762
+ "transcript": "Yeah, Dave C in the program manager, do you have a a method to like set the current ID so it'll update the display?",
763
+ "target": "Yeah, Dave, see, in the programme manager, do you have a method to, like, set the current ID so it'll update the display?",
764
+ "output": "Yeah, Dave C in the program manager, do you have a method to set the current ID so it'll update the display?",
765
+ "exact": false,
766
+ "similarity": 0.934,
767
+ "target_coverage": 0.739,
768
+ "forbidden": []
769
+ },
770
+ {
771
+ "i": 66,
772
+ "category": "prose",
773
+ "transcript": "um which is the the first one is that um uh the companies decided that teletext is outdated uh because of how popular the internet is.",
774
+ "target": "Which is the first one, is that the company's decided that teletext is outdated because of how popular the internet is.",
775
+ "output": "The companies decided that teletext is outdated, because of how popular the internet is.",
776
+ "exact": false,
777
+ "similarity": 0.812,
778
+ "target_coverage": 0.524,
779
+ "forbidden": []
780
+ },
781
+ {
782
+ "i": 67,
783
+ "category": "meeting",
784
+ "transcript": "So should we expect that all the slides from like the work package six meeting or the joint work package five work pack will be up on one of the work package websites?",
785
+ "target": "So should we expect that all the slides from, like, the work package six meeting or the joint work package five work package will be up on one of the work package websites?",
786
+ "output": "Should we expect that all the slides from the work package 6 meeting will be up on one of the work package websites?",
787
+ "exact": false,
788
+ "similarity": 0.799,
789
+ "target_coverage": 0.625,
790
+ "forbidden": []
791
+ },
792
+ {
793
+ "i": 68,
794
+ "category": "prose",
795
+ "transcript": "If we need just frequencies, maybe we should just calculate them by using Pearl or something.",
796
+ "target": "If we need just frequencies, maybe we should just calculate them by using Perl or something.",
797
+ "output": "If we need just frequencies, maybe we should just calculate them by using Pearl.",
798
+ "exact": false,
799
+ "similarity": 0.919,
800
+ "target_coverage": 0.8,
801
+ "forbidden": []
802
+ },
803
+ {
804
+ "i": 69,
805
+ "category": "prose",
806
+ "transcript": "So so essentially there's this um A E is divided into T R one and C and other stuff. Okay, where C is the construct, the existing thing.",
807
+ "target": "So essentially there's a AE, is divided into TR-one and C, and other stuff, okay, where C is the construct, the existing thing.",
808
+ "output": "Essentially, there's this: A, E, is divided into T, R, and C, and other stuff.",
809
+ "exact": false,
810
+ "similarity": 0.644,
811
+ "target_coverage": 0.333,
812
+ "forbidden": []
813
+ },
814
+ {
815
+ "i": 70,
816
+ "category": "prose",
817
+ "transcript": "If I have to do it f like flexibly then I probably then it'll not be significantly more difficult.",
818
+ "target": "If I have to do it flexibly, then I probably\u2014then it will not be significantly more difficult.",
819
+ "output": "If I have to do it, flexibly then I'll not be significantly more difficult.",
820
+ "exact": false,
821
+ "similarity": 0.864,
822
+ "target_coverage": 0.706,
823
+ "forbidden": []
824
+ },
825
+ {
826
+ "i": 71,
827
+ "category": "prose",
828
+ "transcript": "And I've uh sent a thing off to Marlo's talk trying to encourage her again to register for the C S V and uh and what to C V S and uh wh what to do and uh which bit of software I use that seems to be quite easy. I was just imagining that okay, and you never",
829
+ "target": "And I've sent a thing off to Marloes Talk trying to encourage her again to register for the CVS, and what to\u2014the CVS, and what to do, and which bit of software I use, that seems to be quite easy and simple.",
830
+ "output": "And I've sent a thing off to Marlo's talk, trying to encourage her again to register for the C S V and...",
831
+ "exact": false,
832
+ "similarity": 0.592,
833
+ "target_coverage": 0.372,
834
+ "forbidden": []
835
+ },
836
+ {
837
+ "i": 72,
838
+ "category": "prose",
839
+ "transcript": "Yeah, what I did at the moment is um I um yeah, I got the F zero values from for each speaker for his headphone.",
840
+ "target": "Yeah, what I did at the moment is I got the F-zero values from\u2014for each speaker, for his headphone.",
841
+ "output": "Yeah, what I did at the moment is:\n\n- I got the F0 values from for each speaker for his headphone.",
842
+ "exact": false,
843
+ "similarity": 0.934,
844
+ "target_coverage": 0.85,
845
+ "forbidden": []
846
+ },
847
+ {
848
+ "i": 73,
849
+ "category": "prose",
850
+ "transcript": "Oh gosh, narrow emission Okay, so I've highlighted this in red and then the whole thing in green because type two C foot galaxies are one.",
851
+ "target": "Oh gosh, no emission line, okay, so I've highlighted this in red, and then the whole thing in green because type two Seyfart galaxies are one.",
852
+ "output": "Oh, gosh, narrow emission \u2014OK, so I've highlighted this in red and then the whole thing in green because type 2 C-food galaxies are one.",
853
+ "exact": false,
854
+ "similarity": 0.878,
855
+ "target_coverage": 0.692,
856
+ "forbidden": []
857
+ },
858
+ {
859
+ "i": 74,
860
+ "category": "meeting",
861
+ "transcript": "It more and more appears to me that if we if we scrap the notion of the meeting as an individual thing and sort of ch see meetings as as topic segments and have sort of like hierarchical topic segmentation instead.",
862
+ "target": "It more and more appears to me that if we scrap the notion of the meeting as an individual thing and sort of just see meetings as topic segments and have sort of, like, hierarchical topic segmentation instead.",
863
+ "output": "More and more appears to me that if we scrap the notion of the meeting as an individual thing and sort of ch see meetings as topic segments and have sort of like hierarchical topic segmentation instead.",
864
+ "exact": false,
865
+ "similarity": 0.968,
866
+ "target_coverage": 0.919,
867
+ "forbidden": []
868
+ },
869
+ {
870
+ "i": 75,
871
+ "category": "prose",
872
+ "transcript": "So from uh um my analysis of that kind of dialogues, I could say that there's only there are only four basic uh exchanges depend on the information uh direction of information flow.",
873
+ "target": "So from my analysis of that kind of dialogues, I could say that there are only four basic exchanges, depending on the direction of the information flow.",
874
+ "output": "From up to:\n\n- My analysis of that kind of dialogues, I could say that there's only there are only four basic exchanges.",
875
+ "exact": false,
876
+ "similarity": 0.699,
877
+ "target_coverage": 0.615,
878
+ "forbidden": []
879
+ },
880
+ {
881
+ "i": 76,
882
+ "category": "meeting",
883
+ "transcript": "I think they are more talking about um user requirement for the meeting than subtext they want to know.",
884
+ "target": "I think they are more talking about user requirement for the meeting than soft text they want to know.",
885
+ "output": "I think they are more talking about the user requirement for the meeting than subtext they want to know.",
886
+ "exact": false,
887
+ "similarity": 0.951,
888
+ "target_coverage": 0.778,
889
+ "forbidden": []
890
+ },
891
+ {
892
+ "i": 77,
893
+ "category": "prose",
894
+ "transcript": "Um I've sorted out uh travel, etcetera, to Munich for uh for Ellen, John and myself.",
895
+ "target": "I've sorted out travel et cetera to Munich for Ellen, John, and myself.",
896
+ "output": "I've sorted out...",
897
+ "exact": false,
898
+ "similarity": 0.36,
899
+ "target_coverage": 0.231,
900
+ "forbidden": []
901
+ },
902
+ {
903
+ "i": 78,
904
+ "category": "prose",
905
+ "transcript": "It does make sense from maybe the design point of view'cause if you have more complicated characters like European languages then you need more buttons.",
906
+ "target": "It does make sense from maybe the design point of view, 'cause you have more complicated characters, like European languages, then you need more buttons.",
907
+ "output": "It makes sense from a maybe the design point of view, because if you have more complicated characters like European languages then you need more buttons.",
908
+ "exact": false,
909
+ "similarity": 0.948,
910
+ "target_coverage": 0.75,
911
+ "forbidden": []
912
+ },
913
+ {
914
+ "i": 79,
915
+ "category": "prose",
916
+ "transcript": "So it's more like a it's uh it's sort of like a quite literal task. So it's really like finding these kind of uh these types of strings uh rather than really referring to the underlying physical reality.",
917
+ "target": "So it's more like\u2014it's sort of like a quite literal task that's really like finding these kind of, these types of strings, rather than really referring to the underlying physical reality.",
918
+ "output": "Sort of like a, it's quite literal.",
919
+ "exact": false,
920
+ "similarity": 0.261,
921
+ "target_coverage": 0.176,
922
+ "forbidden": []
923
+ },
924
+ {
925
+ "i": 80,
926
+ "category": "prose",
927
+ "transcript": "And yeah, that they have lots of personality and uh be fit and in robust good health.",
928
+ "target": "And yeah, that they have lots of personality, and be fit, and in robust good health.",
929
+ "output": "And yeah, that they have lots of personality and be fit and in robust good health.",
930
+ "exact": false,
931
+ "similarity": 0.988,
932
+ "target_coverage": 1.0,
933
+ "forbidden": []
934
+ },
935
+ {
936
+ "i": 81,
937
+ "category": "prose",
938
+ "transcript": "And sometimes with the ds uh if you're thinking, are you anticipating a d or you're you trying to say th and you're just saying the the the the the",
939
+ "target": "And sometimes with the\u2014I would be thinking, are you anticipating, or are you trying to say 'the' and you're just saying 'the the the the the'?",
940
+ "output": "...",
941
+ "exact": false,
942
+ "similarity": 0.0,
943
+ "target_coverage": 0.0,
944
+ "forbidden": []
945
+ },
946
+ {
947
+ "i": 82,
948
+ "category": "prose",
949
+ "transcript": "So I mean I I do think you should keep in mind what the final goal is so that you can plug this into something at the end and and um show some benefit of having the markup.",
950
+ "target": "So I mean, I do think you should keep in mind what the final goal is, so that you can plug this into something at the end and show some benefit of having the markup.",
951
+ "output": "I do think you should keep in mind what the final goal is, so that you can plug this into something at the end and show some benefit of having the markup.",
952
+ "exact": false,
953
+ "similarity": 0.966,
954
+ "target_coverage": 0.912,
955
+ "forbidden": []
956
+ },
957
+ {
958
+ "i": 83,
959
+ "category": "prose",
960
+ "transcript": "But you wouldn't be able to point to something in a spectrum and say that's a damped Lyman Alpha Absorber unless you'd",
961
+ "target": "But you wouldn't be able to point something in a spectrum and say that's a damped Lyman alpha absorber unless you'd...",
962
+ "output": "But you wouldn't be able to point to something in a spectrum and say that's a damped Lyman-Alpha Absorber unless you'd.",
963
+ "exact": false,
964
+ "similarity": 0.954,
965
+ "target_coverage": 0.957,
966
+ "forbidden": []
967
+ },
968
+ {
969
+ "i": 84,
970
+ "category": "meeting",
971
+ "transcript": "So uh and currently I'm more interested in the uh uh in analyzing the disconstruction multi party meetings.",
972
+ "target": "So, currently I'm more interested in, yeah, analysing the discourse structure in multi-party meetings.",
973
+ "output": "Currently I'm more interested in the disconstruction multi-party meetings.",
974
+ "exact": false,
975
+ "similarity": 0.807,
976
+ "target_coverage": 0.467,
977
+ "forbidden": []
978
+ },
979
+ {
980
+ "i": 85,
981
+ "category": "prose",
982
+ "transcript": "In fact, even by inviting um people from um informatics and from well maybe from philosophy and things, it might bias it in a particular direction.",
983
+ "target": "In fact, even by inviting people from Informatics and from\u2014or maybe from Philosophy and things\u2014it might bias it in a particular direction.",
984
+ "output": "In fact, even by inviting people from informatics and from philosophy and things, it might bias it in a particular direction.",
985
+ "exact": false,
986
+ "similarity": 0.92,
987
+ "target_coverage": 0.87,
988
+ "forbidden": []
989
+ },
990
+ {
991
+ "i": 86,
992
+ "category": "prose",
993
+ "transcript": "But they're they're creating a there. Uh guy, Jonathan, is creating a web form for you to do this all very simply and like just um upload everything that you've uh uh upload the file that you've transcribed and and you'll be noting whether it's the first pass or the second pass and your name um as the person who did that particular pass.",
994
+ "target": "But they're creating\u2014their guy Jonathan is creating a web form for you to do this all very simply, and like just upload everything that you've\u2014upload the file that you've transcribed, and you'll be noting whether it's the first pass or the second pass, and your name as the person who did that particular pass.",
995
+ "output": "Uh, guy, Jonathan, is creating a web form for you to do this, all very simply and like just Upload everything that you've.",
996
+ "exact": false,
997
+ "similarity": 0.042,
998
+ "target_coverage": 0.4,
999
+ "forbidden": []
1000
+ },
1001
+ {
1002
+ "i": 87,
1003
+ "category": "prose",
1004
+ "transcript": "So one speaker will have the floored channel um throughout that. And so I guess what you're saying is that the interactive sections would have shorter speaker turns when you're not considering the back channels as interruptions.",
1005
+ "target": "So one speaker will have the floor channel throughout that, and so I guess what you're saying is that the interactive sections would have shorter speaker turns when you're not considering the back channels as interruptions.",
1006
+ "output": "...",
1007
+ "exact": false,
1008
+ "similarity": 0.009,
1009
+ "target_coverage": 0.0,
1010
+ "forbidden": []
1011
+ },
1012
+ {
1013
+ "i": 88,
1014
+ "category": "prose",
1015
+ "transcript": "It's usually a context problem because I think sometimes if it's not intelligible, you either tend to because you really want it to fit the context",
1016
+ "target": "It's usually a context problem, because I think sometimes if it's not intelligible, you either tend to\u2014because you really want it to fit the context.",
1017
+ "output": "It's usually a context problem because I think sometimes if it's not intelligible, you either tend to because you really want it to fit the context.",
1018
+ "exact": false,
1019
+ "similarity": 0.99,
1020
+ "target_coverage": 1.0,
1021
+ "forbidden": []
1022
+ },
1023
+ {
1024
+ "i": 89,
1025
+ "category": "meeting",
1026
+ "transcript": "Couldn't we couldn't we write one program that calculates all the um f for all our different contributions to the importance measure the um absolute um dialogue act numbers for the meeting?",
1027
+ "target": "Couldn't we write one programme that calculates all the\u2014for all our different contributions to the importance measure, the absolute dialogue act numbers for the meeting?",
1028
+ "output": "Couldn't we?\n\n-1",
1029
+ "exact": false,
1030
+ "similarity": 0.13,
1031
+ "target_coverage": 0.077,
1032
+ "forbidden": []
1033
+ },
1034
+ {
1035
+ "i": 90,
1036
+ "category": "prose",
1037
+ "transcript": "So no um n no transcriber will be checking no checker will be checking their own transcription.",
1038
+ "target": "So no transcriber will be checking\u2014no checker will be checking their own transcription.",
1039
+ "output": "Transcriber will be checking their own transcription.",
1040
+ "exact": false,
1041
+ "similarity": 0.743,
1042
+ "target_coverage": 0.615,
1043
+ "forbidden": []
1044
+ },
1045
+ {
1046
+ "i": 91,
1047
+ "category": "prose",
1048
+ "transcript": "In some cases we might if it's really tough, we might be in need of a of some sound system to play recordings.",
1049
+ "target": "In some cases we might\u2014if it's really tough we might be in need of some sound system to play recordings.",
1050
+ "output": "In some cases, we might be in need of a sound system to play recordings.",
1051
+ "exact": false,
1052
+ "similarity": 0.795,
1053
+ "target_coverage": 0.619,
1054
+ "forbidden": []
1055
+ },
1056
+ {
1057
+ "i": 92,
1058
+ "category": "prose",
1059
+ "transcript": "So at the moment I'm looking at act actually the GDF format itself. Um and then to generate the GDA format I'm gonna be taking stuff out of the Jest analyzer um and then using the DOM parser to generate uh XML output from the Gest analyzer.",
1060
+ "target": "So at the moment I'm looking at actually the GDF format itself, and then to generate the GDF format I'm gonna be taking stuff out of the gest analyser, and then using a DOM parser to generate XML output from the gest analyser.",
1061
+ "output": "...",
1062
+ "exact": false,
1063
+ "similarity": 0.009,
1064
+ "target_coverage": 0.0,
1065
+ "forbidden": []
1066
+ },
1067
+ {
1068
+ "i": 93,
1069
+ "category": "prose",
1070
+ "transcript": "Well what I think I might try and build is basically a class that you just feed it a linked list of um different waveforms.",
1071
+ "target": "Well, what I think I might try and build is basically a class that you just feed it a linked list of different waveforms.",
1072
+ "output": "Well, what I think I might try and build is basically a class that you just feed it a linked list of different waveforms.",
1073
+ "exact": true,
1074
+ "similarity": 1.0,
1075
+ "target_coverage": 1.0,
1076
+ "forbidden": []
1077
+ },
1078
+ {
1079
+ "i": 94,
1080
+ "category": "intent",
1081
+ "transcript": "So I guess um if I'm gonna be segmenting it with a L C Seg then that's the same format I'd want to um put it back out in, so it'd be equivalent.",
1082
+ "target": "So I guess if I'm gonna be segmenting it with an LCSeg, then that's, like, same format I'd want to put it back out in, so it'd be equivalent.",
1083
+ "output": "...",
1084
+ "exact": false,
1085
+ "similarity": 0.014,
1086
+ "target_coverage": 0.0,
1087
+ "forbidden": []
1088
+ },
1089
+ {
1090
+ "i": 95,
1091
+ "category": "prose",
1092
+ "transcript": "Well well a worry that was was expressed in the new requirements was that if we made this too complex it would it it would affect um how long how long it took us to get this to market.",
1093
+ "target": "Well, a worry that was expressed in the new requirements was that, if we made this too complex, it would affect how long it took us to get this to market.",
1094
+ "output": "Well, a worry that was expressed in the new requirements. Was that if we made this too complex it would, it would affect, how long, how long it took us to get this to market.",
1095
+ "exact": false,
1096
+ "similarity": 0.927,
1097
+ "target_coverage": 1.0,
1098
+ "forbidden": []
1099
+ },
1100
+ {
1101
+ "i": 96,
1102
+ "category": "prose",
1103
+ "transcript": "Um and so um it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1104
+ "target": "And so it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1105
+ "output": "And so, it is important that these relations have a semantics that's tied to the semantics of the utterances, right?",
1106
+ "exact": false,
1107
+ "similarity": 0.996,
1108
+ "target_coverage": 1.0,
1109
+ "forbidden": []
1110
+ },
1111
+ {
1112
+ "i": 97,
1113
+ "category": "prose",
1114
+ "transcript": "Yeah, that's what I thought as well. That you that probably the the topic segment level is the most um informative for the words.",
1115
+ "target": "Yeah, that's what I thought as well, that probably the topic segment level is the most informative for the words.",
1116
+ "output": "Yeah, that's what I thought, well. The topic segment level is the most informative for the words.",
1117
+ "exact": false,
1118
+ "similarity": 0.895,
1119
+ "target_coverage": 0.75,
1120
+ "forbidden": []
1121
+ },
1122
+ {
1123
+ "i": 98,
1124
+ "category": "prose",
1125
+ "transcript": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks because it seems to them to be irrelevant because language is irrelevant.",
1126
+ "target": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks, because it seems to them to be irrelevant, 'cause language is irrelevant.",
1127
+ "output": "If people are busy interacting all the time and all of our colleagues don't even bother to control for whether people are talking to one another when they're doing these joint tasks, because it seems to them be irrelevant.",
1128
+ "exact": false,
1129
+ "similarity": 0.929,
1130
+ "target_coverage": 0.867,
1131
+ "forbidden": []
1132
+ },
1133
+ {
1134
+ "i": 99,
1135
+ "category": "prose",
1136
+ "transcript": "It's sort of it's overrunning the f like it. So okay, so at the moment we are that far that if I now click onto a segment here it's",
1137
+ "target": "It's sort of\u2014it's overrunning the F, like, it\u2014so okay, so at the moment we're that far that if I now click onto a segment, it hits.",
1138
+ "output": "It's overrunning the f, like it.\n\nOkay, so at the moment we are that far. If I now click onto a segment.",
1139
+ "exact": false,
1140
+ "similarity": 0.809,
1141
+ "target_coverage": 0.633,
1142
+ "forbidden": []
1143
+ }
1144
+ ]
1145
+ }
lfm2_5_350m_config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "dim": 1024,
3
+ "ffn_dim_multiplier": 1,
4
+ "hidden_dim": 4608,
5
+ "n_heads": 16,
6
+ "n_kv_heads": 8,
7
+ "n_layers": 16,
8
+ "norm_eps": 1e-5,
9
+ "rope_theta": 1000000.0,
10
+ "use_scaled_rope": false,
11
+ "vocab_size": 65536,
12
+ "use_hf_rope": true,
13
+ "use_qk_norm": true,
14
+ "qk_norm_before_rope": true,
15
+ "layer_types": [
16
+ "conv",
17
+ "conv",
18
+ "full_attention",
19
+ "conv",
20
+ "conv",
21
+ "full_attention",
22
+ "conv",
23
+ "conv",
24
+ "full_attention",
25
+ "conv",
26
+ "full_attention",
27
+ "conv",
28
+ "full_attention",
29
+ "conv",
30
+ "full_attention",
31
+ "conv"
32
+ ]
33
+ }
lfm2_5_350m_ft.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa46b25ba5541e1e4bb6eaa1953235234f8fcbe1c978b5cad23ae91933b1c5fb
3
+ size 1417985357
lfm2_5_350m_mlx_4w.pte ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3e220c62890f3ac655e23068f2ec59aa2cdabeb74aa86a95a725d7d463bb853
3
+ size 490342656
tokenizer/chat_template.jinja ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {{- bos_token -}}
2
+ {%- set keep_past_thinking = keep_past_thinking | default(false) -%}
3
+ {%- set ns = namespace(system_prompt="") -%}
4
+ {%- if messages[0]["role"] == "system" -%}
5
+ {%- set sys_content = messages[0]["content"] -%}
6
+ {%- if sys_content is not string -%}
7
+ {%- for item in sys_content -%}
8
+ {%- if item["type"] == "text" -%}
9
+ {%- set ns.system_prompt = ns.system_prompt + item["text"] -%}
10
+ {%- endif -%}
11
+ {%- endfor -%}
12
+ {%- else -%}
13
+ {%- set ns.system_prompt = sys_content -%}
14
+ {%- endif -%}
15
+ {%- set messages = messages[1:] -%}
16
+ {%- endif -%}
17
+ {%- if tools -%}
18
+ {%- set ns.system_prompt = ns.system_prompt + ("\n" if ns.system_prompt else "") + "List of tools: [" -%}
19
+ {%- for tool in tools -%}
20
+ {%- if tool is not string -%}
21
+ {%- set tool = tool | tojson -%}
22
+ {%- endif -%}
23
+ {%- set ns.system_prompt = ns.system_prompt + tool -%}
24
+ {%- if not loop.last -%}
25
+ {%- set ns.system_prompt = ns.system_prompt + ", " -%}
26
+ {%- endif -%}
27
+ {%- endfor -%}
28
+ {%- set ns.system_prompt = ns.system_prompt + "]" -%}
29
+ {%- endif -%}
30
+ {%- if ns.system_prompt -%}
31
+ {{- "<|im_start|>system\n" + ns.system_prompt + "<|im_end|>\n" -}}
32
+ {%- endif -%}
33
+ {%- set ns.last_assistant_index = -1 -%}
34
+ {%- for message in messages -%}
35
+ {%- if message["role"] == "assistant" -%}
36
+ {%- set ns.last_assistant_index = loop.index0 -%}
37
+ {%- endif -%}
38
+ {%- endfor -%}
39
+ {%- for message in messages -%}
40
+ {{- "<|im_start|>" + message["role"] + "\n" -}}
41
+ {%- set content = message["content"] -%}
42
+ {%- if content is not string -%}
43
+ {%- set ns.content = "" -%}
44
+ {%- for item in content -%}
45
+ {%- if item["type"] == "image" -%}
46
+ {%- set ns.content = ns.content + "<image>" -%}
47
+ {%- elif item["type"] == "text" -%}
48
+ {%- set ns.content = ns.content + item["text"] -%}
49
+ {%- else -%}
50
+ {%- set ns.content = ns.content + item | tojson -%}
51
+ {%- endif -%}
52
+ {%- endfor -%}
53
+ {%- set content = ns.content -%}
54
+ {%- endif -%}
55
+ {%- if message["role"] == "assistant" and not keep_past_thinking and loop.index0 != ns.last_assistant_index -%}
56
+ {%- if "</think>" in content -%}
57
+ {%- set content = content.split("</think>")[-1] | trim -%}
58
+ {%- endif -%}
59
+ {%- endif -%}
60
+ {{- content + "<|im_end|>\n" -}}
61
+ {%- endfor -%}
62
+ {%- if add_generation_prompt -%}
63
+ {{- "<|im_start|>assistant\n" -}}
64
+ {%- endif -%}
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|startoftext|>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|im_end|>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "<|pad|>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ }
23
+ }
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,4091 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<|pad|>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<|startoftext|>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "<|endoftext|>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<|fim_pre|>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "4": {
36
+ "content": "<|fim_mid|>",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ },
43
+ "5": {
44
+ "content": "<|fim_suf|>",
45
+ "lstrip": false,
46
+ "normalized": false,
47
+ "rstrip": false,
48
+ "single_word": false,
49
+ "special": true
50
+ },
51
+ "6": {
52
+ "content": "<|im_start|>",
53
+ "lstrip": false,
54
+ "normalized": false,
55
+ "rstrip": false,
56
+ "single_word": false,
57
+ "special": true
58
+ },
59
+ "7": {
60
+ "content": "<|im_end|>",
61
+ "lstrip": false,
62
+ "normalized": false,
63
+ "rstrip": false,
64
+ "single_word": false,
65
+ "special": true
66
+ },
67
+ "8": {
68
+ "content": "<|tool_list_start|>",
69
+ "lstrip": false,
70
+ "normalized": false,
71
+ "rstrip": false,
72
+ "single_word": false,
73
+ "special": true
74
+ },
75
+ "9": {
76
+ "content": "<|tool_list_end|>",
77
+ "lstrip": false,
78
+ "normalized": false,
79
+ "rstrip": false,
80
+ "single_word": false,
81
+ "special": true
82
+ },
83
+ "10": {
84
+ "content": "<|tool_call_start|>",
85
+ "lstrip": false,
86
+ "normalized": false,
87
+ "rstrip": false,
88
+ "single_word": false,
89
+ "special": true
90
+ },
91
+ "11": {
92
+ "content": "<|tool_call_end|>",
93
+ "lstrip": false,
94
+ "normalized": false,
95
+ "rstrip": false,
96
+ "single_word": false,
97
+ "special": true
98
+ },
99
+ "12": {
100
+ "content": "<|tool_response_start|>",
101
+ "lstrip": false,
102
+ "normalized": false,
103
+ "rstrip": false,
104
+ "single_word": false,
105
+ "special": true
106
+ },
107
+ "13": {
108
+ "content": "<|tool_response_end|>",
109
+ "lstrip": false,
110
+ "normalized": false,
111
+ "rstrip": false,
112
+ "single_word": false,
113
+ "special": true
114
+ },
115
+ "16": {
116
+ "content": "<|reserved_6|>",
117
+ "lstrip": false,
118
+ "normalized": false,
119
+ "rstrip": false,
120
+ "single_word": false,
121
+ "special": true
122
+ },
123
+ "17": {
124
+ "content": "<|reserved_7|>",
125
+ "lstrip": false,
126
+ "normalized": false,
127
+ "rstrip": false,
128
+ "single_word": false,
129
+ "special": true
130
+ },
131
+ "18": {
132
+ "content": "<|reserved_8|>",
133
+ "lstrip": false,
134
+ "normalized": false,
135
+ "rstrip": false,
136
+ "single_word": false,
137
+ "special": true
138
+ },
139
+ "19": {
140
+ "content": "<|reserved_9|>",
141
+ "lstrip": false,
142
+ "normalized": false,
143
+ "rstrip": false,
144
+ "single_word": false,
145
+ "special": true
146
+ },
147
+ "20": {
148
+ "content": "<|reserved_10|>",
149
+ "lstrip": false,
150
+ "normalized": false,
151
+ "rstrip": false,
152
+ "single_word": false,
153
+ "special": true
154
+ },
155
+ "21": {
156
+ "content": "<|reserved_11|>",
157
+ "lstrip": false,
158
+ "normalized": false,
159
+ "rstrip": false,
160
+ "single_word": false,
161
+ "special": true
162
+ },
163
+ "22": {
164
+ "content": "<|reserved_12|>",
165
+ "lstrip": false,
166
+ "normalized": false,
167
+ "rstrip": false,
168
+ "single_word": false,
169
+ "special": true
170
+ },
171
+ "23": {
172
+ "content": "<|reserved_13|>",
173
+ "lstrip": false,
174
+ "normalized": false,
175
+ "rstrip": false,
176
+ "single_word": false,
177
+ "special": true
178
+ },
179
+ "24": {
180
+ "content": "<|reserved_14|>",
181
+ "lstrip": false,
182
+ "normalized": false,
183
+ "rstrip": false,
184
+ "single_word": false,
185
+ "special": true
186
+ },
187
+ "25": {
188
+ "content": "<|reserved_15|>",
189
+ "lstrip": false,
190
+ "normalized": false,
191
+ "rstrip": false,
192
+ "single_word": false,
193
+ "special": true
194
+ },
195
+ "26": {
196
+ "content": "<|reserved_16|>",
197
+ "lstrip": false,
198
+ "normalized": false,
199
+ "rstrip": false,
200
+ "single_word": false,
201
+ "special": true
202
+ },
203
+ "27": {
204
+ "content": "<|reserved_17|>",
205
+ "lstrip": false,
206
+ "normalized": false,
207
+ "rstrip": false,
208
+ "single_word": false,
209
+ "special": true
210
+ },
211
+ "28": {
212
+ "content": "<|reserved_18|>",
213
+ "lstrip": false,
214
+ "normalized": false,
215
+ "rstrip": false,
216
+ "single_word": false,
217
+ "special": true
218
+ },
219
+ "29": {
220
+ "content": "<|reserved_19|>",
221
+ "lstrip": false,
222
+ "normalized": false,
223
+ "rstrip": false,
224
+ "single_word": false,
225
+ "special": true
226
+ },
227
+ "30": {
228
+ "content": "<|reserved_20|>",
229
+ "lstrip": false,
230
+ "normalized": false,
231
+ "rstrip": false,
232
+ "single_word": false,
233
+ "special": true
234
+ },
235
+ "31": {
236
+ "content": "<|reserved_21|>",
237
+ "lstrip": false,
238
+ "normalized": false,
239
+ "rstrip": false,
240
+ "single_word": false,
241
+ "special": true
242
+ },
243
+ "32": {
244
+ "content": "<|reserved_22|>",
245
+ "lstrip": false,
246
+ "normalized": false,
247
+ "rstrip": false,
248
+ "single_word": false,
249
+ "special": true
250
+ },
251
+ "33": {
252
+ "content": "<|reserved_23|>",
253
+ "lstrip": false,
254
+ "normalized": false,
255
+ "rstrip": false,
256
+ "single_word": false,
257
+ "special": true
258
+ },
259
+ "34": {
260
+ "content": "<|reserved_24|>",
261
+ "lstrip": false,
262
+ "normalized": false,
263
+ "rstrip": false,
264
+ "single_word": false,
265
+ "special": true
266
+ },
267
+ "35": {
268
+ "content": "<|reserved_25|>",
269
+ "lstrip": false,
270
+ "normalized": false,
271
+ "rstrip": false,
272
+ "single_word": false,
273
+ "special": true
274
+ },
275
+ "36": {
276
+ "content": "<|reserved_26|>",
277
+ "lstrip": false,
278
+ "normalized": false,
279
+ "rstrip": false,
280
+ "single_word": false,
281
+ "special": true
282
+ },
283
+ "37": {
284
+ "content": "<|reserved_27|>",
285
+ "lstrip": false,
286
+ "normalized": false,
287
+ "rstrip": false,
288
+ "single_word": false,
289
+ "special": true
290
+ },
291
+ "38": {
292
+ "content": "<|reserved_28|>",
293
+ "lstrip": false,
294
+ "normalized": false,
295
+ "rstrip": false,
296
+ "single_word": false,
297
+ "special": true
298
+ },
299
+ "39": {
300
+ "content": "<|reserved_29|>",
301
+ "lstrip": false,
302
+ "normalized": false,
303
+ "rstrip": false,
304
+ "single_word": false,
305
+ "special": true
306
+ },
307
+ "40": {
308
+ "content": "<|reserved_30|>",
309
+ "lstrip": false,
310
+ "normalized": false,
311
+ "rstrip": false,
312
+ "single_word": false,
313
+ "special": true
314
+ },
315
+ "41": {
316
+ "content": "<|reserved_31|>",
317
+ "lstrip": false,
318
+ "normalized": false,
319
+ "rstrip": false,
320
+ "single_word": false,
321
+ "special": true
322
+ },
323
+ "42": {
324
+ "content": "<|reserved_32|>",
325
+ "lstrip": false,
326
+ "normalized": false,
327
+ "rstrip": false,
328
+ "single_word": false,
329
+ "special": true
330
+ },
331
+ "43": {
332
+ "content": "<|reserved_33|>",
333
+ "lstrip": false,
334
+ "normalized": false,
335
+ "rstrip": false,
336
+ "single_word": false,
337
+ "special": true
338
+ },
339
+ "44": {
340
+ "content": "<|reserved_34|>",
341
+ "lstrip": false,
342
+ "normalized": false,
343
+ "rstrip": false,
344
+ "single_word": false,
345
+ "special": true
346
+ },
347
+ "45": {
348
+ "content": "<|reserved_35|>",
349
+ "lstrip": false,
350
+ "normalized": false,
351
+ "rstrip": false,
352
+ "single_word": false,
353
+ "special": true
354
+ },
355
+ "46": {
356
+ "content": "<|reserved_36|>",
357
+ "lstrip": false,
358
+ "normalized": false,
359
+ "rstrip": false,
360
+ "single_word": false,
361
+ "special": true
362
+ },
363
+ "47": {
364
+ "content": "<|reserved_37|>",
365
+ "lstrip": false,
366
+ "normalized": false,
367
+ "rstrip": false,
368
+ "single_word": false,
369
+ "special": true
370
+ },
371
+ "48": {
372
+ "content": "<|reserved_38|>",
373
+ "lstrip": false,
374
+ "normalized": false,
375
+ "rstrip": false,
376
+ "single_word": false,
377
+ "special": true
378
+ },
379
+ "49": {
380
+ "content": "<|reserved_39|>",
381
+ "lstrip": false,
382
+ "normalized": false,
383
+ "rstrip": false,
384
+ "single_word": false,
385
+ "special": true
386
+ },
387
+ "50": {
388
+ "content": "<|reserved_40|>",
389
+ "lstrip": false,
390
+ "normalized": false,
391
+ "rstrip": false,
392
+ "single_word": false,
393
+ "special": true
394
+ },
395
+ "51": {
396
+ "content": "<|reserved_41|>",
397
+ "lstrip": false,
398
+ "normalized": false,
399
+ "rstrip": false,
400
+ "single_word": false,
401
+ "special": true
402
+ },
403
+ "52": {
404
+ "content": "<|reserved_42|>",
405
+ "lstrip": false,
406
+ "normalized": false,
407
+ "rstrip": false,
408
+ "single_word": false,
409
+ "special": true
410
+ },
411
+ "53": {
412
+ "content": "<|reserved_43|>",
413
+ "lstrip": false,
414
+ "normalized": false,
415
+ "rstrip": false,
416
+ "single_word": false,
417
+ "special": true
418
+ },
419
+ "54": {
420
+ "content": "<|reserved_44|>",
421
+ "lstrip": false,
422
+ "normalized": false,
423
+ "rstrip": false,
424
+ "single_word": false,
425
+ "special": true
426
+ },
427
+ "55": {
428
+ "content": "<|reserved_45|>",
429
+ "lstrip": false,
430
+ "normalized": false,
431
+ "rstrip": false,
432
+ "single_word": false,
433
+ "special": true
434
+ },
435
+ "56": {
436
+ "content": "<|reserved_46|>",
437
+ "lstrip": false,
438
+ "normalized": false,
439
+ "rstrip": false,
440
+ "single_word": false,
441
+ "special": true
442
+ },
443
+ "57": {
444
+ "content": "<|reserved_47|>",
445
+ "lstrip": false,
446
+ "normalized": false,
447
+ "rstrip": false,
448
+ "single_word": false,
449
+ "special": true
450
+ },
451
+ "58": {
452
+ "content": "<|reserved_48|>",
453
+ "lstrip": false,
454
+ "normalized": false,
455
+ "rstrip": false,
456
+ "single_word": false,
457
+ "special": true
458
+ },
459
+ "59": {
460
+ "content": "<|reserved_49|>",
461
+ "lstrip": false,
462
+ "normalized": false,
463
+ "rstrip": false,
464
+ "single_word": false,
465
+ "special": true
466
+ },
467
+ "60": {
468
+ "content": "<|reserved_50|>",
469
+ "lstrip": false,
470
+ "normalized": false,
471
+ "rstrip": false,
472
+ "single_word": false,
473
+ "special": true
474
+ },
475
+ "61": {
476
+ "content": "<|reserved_51|>",
477
+ "lstrip": false,
478
+ "normalized": false,
479
+ "rstrip": false,
480
+ "single_word": false,
481
+ "special": true
482
+ },
483
+ "62": {
484
+ "content": "<|reserved_52|>",
485
+ "lstrip": false,
486
+ "normalized": false,
487
+ "rstrip": false,
488
+ "single_word": false,
489
+ "special": true
490
+ },
491
+ "63": {
492
+ "content": "<|reserved_53|>",
493
+ "lstrip": false,
494
+ "normalized": false,
495
+ "rstrip": false,
496
+ "single_word": false,
497
+ "special": true
498
+ },
499
+ "64": {
500
+ "content": "<|reserved_54|>",
501
+ "lstrip": false,
502
+ "normalized": false,
503
+ "rstrip": false,
504
+ "single_word": false,
505
+ "special": true
506
+ },
507
+ "65": {
508
+ "content": "<|reserved_55|>",
509
+ "lstrip": false,
510
+ "normalized": false,
511
+ "rstrip": false,
512
+ "single_word": false,
513
+ "special": true
514
+ },
515
+ "66": {
516
+ "content": "<|reserved_56|>",
517
+ "lstrip": false,
518
+ "normalized": false,
519
+ "rstrip": false,
520
+ "single_word": false,
521
+ "special": true
522
+ },
523
+ "67": {
524
+ "content": "<|reserved_57|>",
525
+ "lstrip": false,
526
+ "normalized": false,
527
+ "rstrip": false,
528
+ "single_word": false,
529
+ "special": true
530
+ },
531
+ "68": {
532
+ "content": "<|reserved_58|>",
533
+ "lstrip": false,
534
+ "normalized": false,
535
+ "rstrip": false,
536
+ "single_word": false,
537
+ "special": true
538
+ },
539
+ "69": {
540
+ "content": "<|reserved_59|>",
541
+ "lstrip": false,
542
+ "normalized": false,
543
+ "rstrip": false,
544
+ "single_word": false,
545
+ "special": true
546
+ },
547
+ "70": {
548
+ "content": "<|reserved_60|>",
549
+ "lstrip": false,
550
+ "normalized": false,
551
+ "rstrip": false,
552
+ "single_word": false,
553
+ "special": true
554
+ },
555
+ "71": {
556
+ "content": "<|reserved_61|>",
557
+ "lstrip": false,
558
+ "normalized": false,
559
+ "rstrip": false,
560
+ "single_word": false,
561
+ "special": true
562
+ },
563
+ "72": {
564
+ "content": "<|reserved_62|>",
565
+ "lstrip": false,
566
+ "normalized": false,
567
+ "rstrip": false,
568
+ "single_word": false,
569
+ "special": true
570
+ },
571
+ "73": {
572
+ "content": "<|reserved_63|>",
573
+ "lstrip": false,
574
+ "normalized": false,
575
+ "rstrip": false,
576
+ "single_word": false,
577
+ "special": true
578
+ },
579
+ "74": {
580
+ "content": "<|reserved_64|>",
581
+ "lstrip": false,
582
+ "normalized": false,
583
+ "rstrip": false,
584
+ "single_word": false,
585
+ "special": true
586
+ },
587
+ "75": {
588
+ "content": "<|reserved_65|>",
589
+ "lstrip": false,
590
+ "normalized": false,
591
+ "rstrip": false,
592
+ "single_word": false,
593
+ "special": true
594
+ },
595
+ "76": {
596
+ "content": "<|reserved_66|>",
597
+ "lstrip": false,
598
+ "normalized": false,
599
+ "rstrip": false,
600
+ "single_word": false,
601
+ "special": true
602
+ },
603
+ "77": {
604
+ "content": "<|reserved_67|>",
605
+ "lstrip": false,
606
+ "normalized": false,
607
+ "rstrip": false,
608
+ "single_word": false,
609
+ "special": true
610
+ },
611
+ "78": {
612
+ "content": "<|reserved_68|>",
613
+ "lstrip": false,
614
+ "normalized": false,
615
+ "rstrip": false,
616
+ "single_word": false,
617
+ "special": true
618
+ },
619
+ "79": {
620
+ "content": "<|reserved_69|>",
621
+ "lstrip": false,
622
+ "normalized": false,
623
+ "rstrip": false,
624
+ "single_word": false,
625
+ "special": true
626
+ },
627
+ "80": {
628
+ "content": "<|reserved_70|>",
629
+ "lstrip": false,
630
+ "normalized": false,
631
+ "rstrip": false,
632
+ "single_word": false,
633
+ "special": true
634
+ },
635
+ "81": {
636
+ "content": "<|reserved_71|>",
637
+ "lstrip": false,
638
+ "normalized": false,
639
+ "rstrip": false,
640
+ "single_word": false,
641
+ "special": true
642
+ },
643
+ "82": {
644
+ "content": "<|reserved_72|>",
645
+ "lstrip": false,
646
+ "normalized": false,
647
+ "rstrip": false,
648
+ "single_word": false,
649
+ "special": true
650
+ },
651
+ "83": {
652
+ "content": "<|reserved_73|>",
653
+ "lstrip": false,
654
+ "normalized": false,
655
+ "rstrip": false,
656
+ "single_word": false,
657
+ "special": true
658
+ },
659
+ "84": {
660
+ "content": "<|reserved_74|>",
661
+ "lstrip": false,
662
+ "normalized": false,
663
+ "rstrip": false,
664
+ "single_word": false,
665
+ "special": true
666
+ },
667
+ "85": {
668
+ "content": "<|reserved_75|>",
669
+ "lstrip": false,
670
+ "normalized": false,
671
+ "rstrip": false,
672
+ "single_word": false,
673
+ "special": true
674
+ },
675
+ "86": {
676
+ "content": "<|reserved_76|>",
677
+ "lstrip": false,
678
+ "normalized": false,
679
+ "rstrip": false,
680
+ "single_word": false,
681
+ "special": true
682
+ },
683
+ "87": {
684
+ "content": "<|reserved_77|>",
685
+ "lstrip": false,
686
+ "normalized": false,
687
+ "rstrip": false,
688
+ "single_word": false,
689
+ "special": true
690
+ },
691
+ "88": {
692
+ "content": "<|reserved_78|>",
693
+ "lstrip": false,
694
+ "normalized": false,
695
+ "rstrip": false,
696
+ "single_word": false,
697
+ "special": true
698
+ },
699
+ "89": {
700
+ "content": "<|reserved_79|>",
701
+ "lstrip": false,
702
+ "normalized": false,
703
+ "rstrip": false,
704
+ "single_word": false,
705
+ "special": true
706
+ },
707
+ "90": {
708
+ "content": "<|reserved_80|>",
709
+ "lstrip": false,
710
+ "normalized": false,
711
+ "rstrip": false,
712
+ "single_word": false,
713
+ "special": true
714
+ },
715
+ "91": {
716
+ "content": "<|reserved_81|>",
717
+ "lstrip": false,
718
+ "normalized": false,
719
+ "rstrip": false,
720
+ "single_word": false,
721
+ "special": true
722
+ },
723
+ "92": {
724
+ "content": "<|reserved_82|>",
725
+ "lstrip": false,
726
+ "normalized": false,
727
+ "rstrip": false,
728
+ "single_word": false,
729
+ "special": true
730
+ },
731
+ "93": {
732
+ "content": "<|reserved_83|>",
733
+ "lstrip": false,
734
+ "normalized": false,
735
+ "rstrip": false,
736
+ "single_word": false,
737
+ "special": true
738
+ },
739
+ "94": {
740
+ "content": "<|reserved_84|>",
741
+ "lstrip": false,
742
+ "normalized": false,
743
+ "rstrip": false,
744
+ "single_word": false,
745
+ "special": true
746
+ },
747
+ "95": {
748
+ "content": "<|reserved_85|>",
749
+ "lstrip": false,
750
+ "normalized": false,
751
+ "rstrip": false,
752
+ "single_word": false,
753
+ "special": true
754
+ },
755
+ "96": {
756
+ "content": "<|reserved_86|>",
757
+ "lstrip": false,
758
+ "normalized": false,
759
+ "rstrip": false,
760
+ "single_word": false,
761
+ "special": true
762
+ },
763
+ "97": {
764
+ "content": "<|reserved_87|>",
765
+ "lstrip": false,
766
+ "normalized": false,
767
+ "rstrip": false,
768
+ "single_word": false,
769
+ "special": true
770
+ },
771
+ "98": {
772
+ "content": "<|reserved_88|>",
773
+ "lstrip": false,
774
+ "normalized": false,
775
+ "rstrip": false,
776
+ "single_word": false,
777
+ "special": true
778
+ },
779
+ "99": {
780
+ "content": "<|reserved_89|>",
781
+ "lstrip": false,
782
+ "normalized": false,
783
+ "rstrip": false,
784
+ "single_word": false,
785
+ "special": true
786
+ },
787
+ "100": {
788
+ "content": "<|reserved_90|>",
789
+ "lstrip": false,
790
+ "normalized": false,
791
+ "rstrip": false,
792
+ "single_word": false,
793
+ "special": true
794
+ },
795
+ "101": {
796
+ "content": "<|reserved_91|>",
797
+ "lstrip": false,
798
+ "normalized": false,
799
+ "rstrip": false,
800
+ "single_word": false,
801
+ "special": true
802
+ },
803
+ "102": {
804
+ "content": "<|reserved_92|>",
805
+ "lstrip": false,
806
+ "normalized": false,
807
+ "rstrip": false,
808
+ "single_word": false,
809
+ "special": true
810
+ },
811
+ "103": {
812
+ "content": "<|reserved_93|>",
813
+ "lstrip": false,
814
+ "normalized": false,
815
+ "rstrip": false,
816
+ "single_word": false,
817
+ "special": true
818
+ },
819
+ "104": {
820
+ "content": "<|reserved_94|>",
821
+ "lstrip": false,
822
+ "normalized": false,
823
+ "rstrip": false,
824
+ "single_word": false,
825
+ "special": true
826
+ },
827
+ "105": {
828
+ "content": "<|reserved_95|>",
829
+ "lstrip": false,
830
+ "normalized": false,
831
+ "rstrip": false,
832
+ "single_word": false,
833
+ "special": true
834
+ },
835
+ "106": {
836
+ "content": "<|reserved_96|>",
837
+ "lstrip": false,
838
+ "normalized": false,
839
+ "rstrip": false,
840
+ "single_word": false,
841
+ "special": true
842
+ },
843
+ "107": {
844
+ "content": "<|reserved_97|>",
845
+ "lstrip": false,
846
+ "normalized": false,
847
+ "rstrip": false,
848
+ "single_word": false,
849
+ "special": true
850
+ },
851
+ "108": {
852
+ "content": "<|reserved_98|>",
853
+ "lstrip": false,
854
+ "normalized": false,
855
+ "rstrip": false,
856
+ "single_word": false,
857
+ "special": true
858
+ },
859
+ "109": {
860
+ "content": "<|reserved_99|>",
861
+ "lstrip": false,
862
+ "normalized": false,
863
+ "rstrip": false,
864
+ "single_word": false,
865
+ "special": true
866
+ },
867
+ "110": {
868
+ "content": "<|reserved_100|>",
869
+ "lstrip": false,
870
+ "normalized": false,
871
+ "rstrip": false,
872
+ "single_word": false,
873
+ "special": true
874
+ },
875
+ "111": {
876
+ "content": "<|reserved_101|>",
877
+ "lstrip": false,
878
+ "normalized": false,
879
+ "rstrip": false,
880
+ "single_word": false,
881
+ "special": true
882
+ },
883
+ "112": {
884
+ "content": "<|reserved_102|>",
885
+ "lstrip": false,
886
+ "normalized": false,
887
+ "rstrip": false,
888
+ "single_word": false,
889
+ "special": true
890
+ },
891
+ "113": {
892
+ "content": "<|reserved_103|>",
893
+ "lstrip": false,
894
+ "normalized": false,
895
+ "rstrip": false,
896
+ "single_word": false,
897
+ "special": true
898
+ },
899
+ "114": {
900
+ "content": "<|reserved_104|>",
901
+ "lstrip": false,
902
+ "normalized": false,
903
+ "rstrip": false,
904
+ "single_word": false,
905
+ "special": true
906
+ },
907
+ "115": {
908
+ "content": "<|reserved_105|>",
909
+ "lstrip": false,
910
+ "normalized": false,
911
+ "rstrip": false,
912
+ "single_word": false,
913
+ "special": true
914
+ },
915
+ "116": {
916
+ "content": "<|reserved_106|>",
917
+ "lstrip": false,
918
+ "normalized": false,
919
+ "rstrip": false,
920
+ "single_word": false,
921
+ "special": true
922
+ },
923
+ "117": {
924
+ "content": "<|reserved_107|>",
925
+ "lstrip": false,
926
+ "normalized": false,
927
+ "rstrip": false,
928
+ "single_word": false,
929
+ "special": true
930
+ },
931
+ "118": {
932
+ "content": "<|reserved_108|>",
933
+ "lstrip": false,
934
+ "normalized": false,
935
+ "rstrip": false,
936
+ "single_word": false,
937
+ "special": true
938
+ },
939
+ "119": {
940
+ "content": "<|reserved_109|>",
941
+ "lstrip": false,
942
+ "normalized": false,
943
+ "rstrip": false,
944
+ "single_word": false,
945
+ "special": true
946
+ },
947
+ "120": {
948
+ "content": "<|reserved_110|>",
949
+ "lstrip": false,
950
+ "normalized": false,
951
+ "rstrip": false,
952
+ "single_word": false,
953
+ "special": true
954
+ },
955
+ "121": {
956
+ "content": "<|reserved_111|>",
957
+ "lstrip": false,
958
+ "normalized": false,
959
+ "rstrip": false,
960
+ "single_word": false,
961
+ "special": true
962
+ },
963
+ "122": {
964
+ "content": "<|reserved_112|>",
965
+ "lstrip": false,
966
+ "normalized": false,
967
+ "rstrip": false,
968
+ "single_word": false,
969
+ "special": true
970
+ },
971
+ "123": {
972
+ "content": "<|reserved_113|>",
973
+ "lstrip": false,
974
+ "normalized": false,
975
+ "rstrip": false,
976
+ "single_word": false,
977
+ "special": true
978
+ },
979
+ "124": {
980
+ "content": "<|reserved_114|>",
981
+ "lstrip": false,
982
+ "normalized": false,
983
+ "rstrip": false,
984
+ "single_word": false,
985
+ "special": true
986
+ },
987
+ "125": {
988
+ "content": "<|reserved_115|>",
989
+ "lstrip": false,
990
+ "normalized": false,
991
+ "rstrip": false,
992
+ "single_word": false,
993
+ "special": true
994
+ },
995
+ "126": {
996
+ "content": "<|reserved_116|>",
997
+ "lstrip": false,
998
+ "normalized": false,
999
+ "rstrip": false,
1000
+ "single_word": false,
1001
+ "special": true
1002
+ },
1003
+ "127": {
1004
+ "content": "<|reserved_117|>",
1005
+ "lstrip": false,
1006
+ "normalized": false,
1007
+ "rstrip": false,
1008
+ "single_word": false,
1009
+ "special": true
1010
+ },
1011
+ "128": {
1012
+ "content": "<|audio_start|>",
1013
+ "lstrip": false,
1014
+ "normalized": false,
1015
+ "rstrip": false,
1016
+ "single_word": false,
1017
+ "special": true
1018
+ },
1019
+ "129": {
1020
+ "content": "<|text_start|>",
1021
+ "lstrip": false,
1022
+ "normalized": false,
1023
+ "rstrip": false,
1024
+ "single_word": false,
1025
+ "special": true
1026
+ },
1027
+ "130": {
1028
+ "content": "<|text_end|>",
1029
+ "lstrip": false,
1030
+ "normalized": false,
1031
+ "rstrip": false,
1032
+ "single_word": false,
1033
+ "special": true
1034
+ },
1035
+ "131": {
1036
+ "content": "<|mixed_start|>",
1037
+ "lstrip": false,
1038
+ "normalized": false,
1039
+ "rstrip": false,
1040
+ "single_word": false,
1041
+ "special": true
1042
+ },
1043
+ "132": {
1044
+ "content": "<|mixed_end|>",
1045
+ "lstrip": false,
1046
+ "normalized": false,
1047
+ "rstrip": false,
1048
+ "single_word": false,
1049
+ "special": true
1050
+ },
1051
+ "133": {
1052
+ "content": "<|reserved_123|>",
1053
+ "lstrip": false,
1054
+ "normalized": false,
1055
+ "rstrip": false,
1056
+ "single_word": false,
1057
+ "special": true
1058
+ },
1059
+ "134": {
1060
+ "content": "<|reserved_124|>",
1061
+ "lstrip": false,
1062
+ "normalized": false,
1063
+ "rstrip": false,
1064
+ "single_word": false,
1065
+ "special": true
1066
+ },
1067
+ "135": {
1068
+ "content": "<|reserved_125|>",
1069
+ "lstrip": false,
1070
+ "normalized": false,
1071
+ "rstrip": false,
1072
+ "single_word": false,
1073
+ "special": true
1074
+ },
1075
+ "136": {
1076
+ "content": "<|reserved_126|>",
1077
+ "lstrip": false,
1078
+ "normalized": false,
1079
+ "rstrip": false,
1080
+ "single_word": false,
1081
+ "special": true
1082
+ },
1083
+ "137": {
1084
+ "content": "<|reserved_127|>",
1085
+ "lstrip": false,
1086
+ "normalized": false,
1087
+ "rstrip": false,
1088
+ "single_word": false,
1089
+ "special": true
1090
+ },
1091
+ "138": {
1092
+ "content": "<|reserved_128|>",
1093
+ "lstrip": false,
1094
+ "normalized": false,
1095
+ "rstrip": false,
1096
+ "single_word": false,
1097
+ "special": true
1098
+ },
1099
+ "139": {
1100
+ "content": "<|reserved_129|>",
1101
+ "lstrip": false,
1102
+ "normalized": false,
1103
+ "rstrip": false,
1104
+ "single_word": false,
1105
+ "special": true
1106
+ },
1107
+ "140": {
1108
+ "content": "<|reserved_130|>",
1109
+ "lstrip": false,
1110
+ "normalized": false,
1111
+ "rstrip": false,
1112
+ "single_word": false,
1113
+ "special": true
1114
+ },
1115
+ "141": {
1116
+ "content": "<|reserved_131|>",
1117
+ "lstrip": false,
1118
+ "normalized": false,
1119
+ "rstrip": false,
1120
+ "single_word": false,
1121
+ "special": true
1122
+ },
1123
+ "142": {
1124
+ "content": "<|reserved_132|>",
1125
+ "lstrip": false,
1126
+ "normalized": false,
1127
+ "rstrip": false,
1128
+ "single_word": false,
1129
+ "special": true
1130
+ },
1131
+ "143": {
1132
+ "content": "<|reserved_133|>",
1133
+ "lstrip": false,
1134
+ "normalized": false,
1135
+ "rstrip": false,
1136
+ "single_word": false,
1137
+ "special": true
1138
+ },
1139
+ "144": {
1140
+ "content": "<|reserved_134|>",
1141
+ "lstrip": false,
1142
+ "normalized": false,
1143
+ "rstrip": false,
1144
+ "single_word": false,
1145
+ "special": true
1146
+ },
1147
+ "145": {
1148
+ "content": "<|reserved_135|>",
1149
+ "lstrip": false,
1150
+ "normalized": false,
1151
+ "rstrip": false,
1152
+ "single_word": false,
1153
+ "special": true
1154
+ },
1155
+ "146": {
1156
+ "content": "<|reserved_136|>",
1157
+ "lstrip": false,
1158
+ "normalized": false,
1159
+ "rstrip": false,
1160
+ "single_word": false,
1161
+ "special": true
1162
+ },
1163
+ "147": {
1164
+ "content": "<|reserved_137|>",
1165
+ "lstrip": false,
1166
+ "normalized": false,
1167
+ "rstrip": false,
1168
+ "single_word": false,
1169
+ "special": true
1170
+ },
1171
+ "148": {
1172
+ "content": "<|reserved_138|>",
1173
+ "lstrip": false,
1174
+ "normalized": false,
1175
+ "rstrip": false,
1176
+ "single_word": false,
1177
+ "special": true
1178
+ },
1179
+ "149": {
1180
+ "content": "<|reserved_139|>",
1181
+ "lstrip": false,
1182
+ "normalized": false,
1183
+ "rstrip": false,
1184
+ "single_word": false,
1185
+ "special": true
1186
+ },
1187
+ "150": {
1188
+ "content": "<|reserved_140|>",
1189
+ "lstrip": false,
1190
+ "normalized": false,
1191
+ "rstrip": false,
1192
+ "single_word": false,
1193
+ "special": true
1194
+ },
1195
+ "151": {
1196
+ "content": "<|reserved_141|>",
1197
+ "lstrip": false,
1198
+ "normalized": false,
1199
+ "rstrip": false,
1200
+ "single_word": false,
1201
+ "special": true
1202
+ },
1203
+ "152": {
1204
+ "content": "<|reserved_142|>",
1205
+ "lstrip": false,
1206
+ "normalized": false,
1207
+ "rstrip": false,
1208
+ "single_word": false,
1209
+ "special": true
1210
+ },
1211
+ "153": {
1212
+ "content": "<|reserved_143|>",
1213
+ "lstrip": false,
1214
+ "normalized": false,
1215
+ "rstrip": false,
1216
+ "single_word": false,
1217
+ "special": true
1218
+ },
1219
+ "154": {
1220
+ "content": "<|reserved_144|>",
1221
+ "lstrip": false,
1222
+ "normalized": false,
1223
+ "rstrip": false,
1224
+ "single_word": false,
1225
+ "special": true
1226
+ },
1227
+ "155": {
1228
+ "content": "<|reserved_145|>",
1229
+ "lstrip": false,
1230
+ "normalized": false,
1231
+ "rstrip": false,
1232
+ "single_word": false,
1233
+ "special": true
1234
+ },
1235
+ "156": {
1236
+ "content": "<|reserved_146|>",
1237
+ "lstrip": false,
1238
+ "normalized": false,
1239
+ "rstrip": false,
1240
+ "single_word": false,
1241
+ "special": true
1242
+ },
1243
+ "157": {
1244
+ "content": "<|reserved_147|>",
1245
+ "lstrip": false,
1246
+ "normalized": false,
1247
+ "rstrip": false,
1248
+ "single_word": false,
1249
+ "special": true
1250
+ },
1251
+ "158": {
1252
+ "content": "<|reserved_148|>",
1253
+ "lstrip": false,
1254
+ "normalized": false,
1255
+ "rstrip": false,
1256
+ "single_word": false,
1257
+ "special": true
1258
+ },
1259
+ "159": {
1260
+ "content": "<|reserved_149|>",
1261
+ "lstrip": false,
1262
+ "normalized": false,
1263
+ "rstrip": false,
1264
+ "single_word": false,
1265
+ "special": true
1266
+ },
1267
+ "160": {
1268
+ "content": "<|reserved_150|>",
1269
+ "lstrip": false,
1270
+ "normalized": false,
1271
+ "rstrip": false,
1272
+ "single_word": false,
1273
+ "special": true
1274
+ },
1275
+ "161": {
1276
+ "content": "<|reserved_151|>",
1277
+ "lstrip": false,
1278
+ "normalized": false,
1279
+ "rstrip": false,
1280
+ "single_word": false,
1281
+ "special": true
1282
+ },
1283
+ "162": {
1284
+ "content": "<|reserved_152|>",
1285
+ "lstrip": false,
1286
+ "normalized": false,
1287
+ "rstrip": false,
1288
+ "single_word": false,
1289
+ "special": true
1290
+ },
1291
+ "163": {
1292
+ "content": "<|reserved_153|>",
1293
+ "lstrip": false,
1294
+ "normalized": false,
1295
+ "rstrip": false,
1296
+ "single_word": false,
1297
+ "special": true
1298
+ },
1299
+ "164": {
1300
+ "content": "<|reserved_154|>",
1301
+ "lstrip": false,
1302
+ "normalized": false,
1303
+ "rstrip": false,
1304
+ "single_word": false,
1305
+ "special": true
1306
+ },
1307
+ "165": {
1308
+ "content": "<|reserved_155|>",
1309
+ "lstrip": false,
1310
+ "normalized": false,
1311
+ "rstrip": false,
1312
+ "single_word": false,
1313
+ "special": true
1314
+ },
1315
+ "166": {
1316
+ "content": "<|reserved_156|>",
1317
+ "lstrip": false,
1318
+ "normalized": false,
1319
+ "rstrip": false,
1320
+ "single_word": false,
1321
+ "special": true
1322
+ },
1323
+ "167": {
1324
+ "content": "<|reserved_157|>",
1325
+ "lstrip": false,
1326
+ "normalized": false,
1327
+ "rstrip": false,
1328
+ "single_word": false,
1329
+ "special": true
1330
+ },
1331
+ "168": {
1332
+ "content": "<|reserved_158|>",
1333
+ "lstrip": false,
1334
+ "normalized": false,
1335
+ "rstrip": false,
1336
+ "single_word": false,
1337
+ "special": true
1338
+ },
1339
+ "169": {
1340
+ "content": "<|reserved_159|>",
1341
+ "lstrip": false,
1342
+ "normalized": false,
1343
+ "rstrip": false,
1344
+ "single_word": false,
1345
+ "special": true
1346
+ },
1347
+ "170": {
1348
+ "content": "<|reserved_160|>",
1349
+ "lstrip": false,
1350
+ "normalized": false,
1351
+ "rstrip": false,
1352
+ "single_word": false,
1353
+ "special": true
1354
+ },
1355
+ "171": {
1356
+ "content": "<|reserved_161|>",
1357
+ "lstrip": false,
1358
+ "normalized": false,
1359
+ "rstrip": false,
1360
+ "single_word": false,
1361
+ "special": true
1362
+ },
1363
+ "172": {
1364
+ "content": "<|reserved_162|>",
1365
+ "lstrip": false,
1366
+ "normalized": false,
1367
+ "rstrip": false,
1368
+ "single_word": false,
1369
+ "special": true
1370
+ },
1371
+ "173": {
1372
+ "content": "<|reserved_163|>",
1373
+ "lstrip": false,
1374
+ "normalized": false,
1375
+ "rstrip": false,
1376
+ "single_word": false,
1377
+ "special": true
1378
+ },
1379
+ "174": {
1380
+ "content": "<|reserved_164|>",
1381
+ "lstrip": false,
1382
+ "normalized": false,
1383
+ "rstrip": false,
1384
+ "single_word": false,
1385
+ "special": true
1386
+ },
1387
+ "175": {
1388
+ "content": "<|reserved_165|>",
1389
+ "lstrip": false,
1390
+ "normalized": false,
1391
+ "rstrip": false,
1392
+ "single_word": false,
1393
+ "special": true
1394
+ },
1395
+ "176": {
1396
+ "content": "<|reserved_166|>",
1397
+ "lstrip": false,
1398
+ "normalized": false,
1399
+ "rstrip": false,
1400
+ "single_word": false,
1401
+ "special": true
1402
+ },
1403
+ "177": {
1404
+ "content": "<|reserved_167|>",
1405
+ "lstrip": false,
1406
+ "normalized": false,
1407
+ "rstrip": false,
1408
+ "single_word": false,
1409
+ "special": true
1410
+ },
1411
+ "178": {
1412
+ "content": "<|reserved_168|>",
1413
+ "lstrip": false,
1414
+ "normalized": false,
1415
+ "rstrip": false,
1416
+ "single_word": false,
1417
+ "special": true
1418
+ },
1419
+ "179": {
1420
+ "content": "<|reserved_169|>",
1421
+ "lstrip": false,
1422
+ "normalized": false,
1423
+ "rstrip": false,
1424
+ "single_word": false,
1425
+ "special": true
1426
+ },
1427
+ "180": {
1428
+ "content": "<|reserved_170|>",
1429
+ "lstrip": false,
1430
+ "normalized": false,
1431
+ "rstrip": false,
1432
+ "single_word": false,
1433
+ "special": true
1434
+ },
1435
+ "181": {
1436
+ "content": "<|reserved_171|>",
1437
+ "lstrip": false,
1438
+ "normalized": false,
1439
+ "rstrip": false,
1440
+ "single_word": false,
1441
+ "special": true
1442
+ },
1443
+ "182": {
1444
+ "content": "<|reserved_172|>",
1445
+ "lstrip": false,
1446
+ "normalized": false,
1447
+ "rstrip": false,
1448
+ "single_word": false,
1449
+ "special": true
1450
+ },
1451
+ "183": {
1452
+ "content": "<|reserved_173|>",
1453
+ "lstrip": false,
1454
+ "normalized": false,
1455
+ "rstrip": false,
1456
+ "single_word": false,
1457
+ "special": true
1458
+ },
1459
+ "184": {
1460
+ "content": "<|reserved_174|>",
1461
+ "lstrip": false,
1462
+ "normalized": false,
1463
+ "rstrip": false,
1464
+ "single_word": false,
1465
+ "special": true
1466
+ },
1467
+ "185": {
1468
+ "content": "<|reserved_175|>",
1469
+ "lstrip": false,
1470
+ "normalized": false,
1471
+ "rstrip": false,
1472
+ "single_word": false,
1473
+ "special": true
1474
+ },
1475
+ "186": {
1476
+ "content": "<|reserved_176|>",
1477
+ "lstrip": false,
1478
+ "normalized": false,
1479
+ "rstrip": false,
1480
+ "single_word": false,
1481
+ "special": true
1482
+ },
1483
+ "187": {
1484
+ "content": "<|reserved_177|>",
1485
+ "lstrip": false,
1486
+ "normalized": false,
1487
+ "rstrip": false,
1488
+ "single_word": false,
1489
+ "special": true
1490
+ },
1491
+ "188": {
1492
+ "content": "<|reserved_178|>",
1493
+ "lstrip": false,
1494
+ "normalized": false,
1495
+ "rstrip": false,
1496
+ "single_word": false,
1497
+ "special": true
1498
+ },
1499
+ "189": {
1500
+ "content": "<|reserved_179|>",
1501
+ "lstrip": false,
1502
+ "normalized": false,
1503
+ "rstrip": false,
1504
+ "single_word": false,
1505
+ "special": true
1506
+ },
1507
+ "190": {
1508
+ "content": "<|reserved_180|>",
1509
+ "lstrip": false,
1510
+ "normalized": false,
1511
+ "rstrip": false,
1512
+ "single_word": false,
1513
+ "special": true
1514
+ },
1515
+ "191": {
1516
+ "content": "<|reserved_181|>",
1517
+ "lstrip": false,
1518
+ "normalized": false,
1519
+ "rstrip": false,
1520
+ "single_word": false,
1521
+ "special": true
1522
+ },
1523
+ "192": {
1524
+ "content": "<|reserved_182|>",
1525
+ "lstrip": false,
1526
+ "normalized": false,
1527
+ "rstrip": false,
1528
+ "single_word": false,
1529
+ "special": true
1530
+ },
1531
+ "193": {
1532
+ "content": "<|reserved_183|>",
1533
+ "lstrip": false,
1534
+ "normalized": false,
1535
+ "rstrip": false,
1536
+ "single_word": false,
1537
+ "special": true
1538
+ },
1539
+ "194": {
1540
+ "content": "<|reserved_184|>",
1541
+ "lstrip": false,
1542
+ "normalized": false,
1543
+ "rstrip": false,
1544
+ "single_word": false,
1545
+ "special": true
1546
+ },
1547
+ "195": {
1548
+ "content": "<|reserved_185|>",
1549
+ "lstrip": false,
1550
+ "normalized": false,
1551
+ "rstrip": false,
1552
+ "single_word": false,
1553
+ "special": true
1554
+ },
1555
+ "196": {
1556
+ "content": "<|reserved_186|>",
1557
+ "lstrip": false,
1558
+ "normalized": false,
1559
+ "rstrip": false,
1560
+ "single_word": false,
1561
+ "special": true
1562
+ },
1563
+ "197": {
1564
+ "content": "<|reserved_187|>",
1565
+ "lstrip": false,
1566
+ "normalized": false,
1567
+ "rstrip": false,
1568
+ "single_word": false,
1569
+ "special": true
1570
+ },
1571
+ "198": {
1572
+ "content": "<|reserved_188|>",
1573
+ "lstrip": false,
1574
+ "normalized": false,
1575
+ "rstrip": false,
1576
+ "single_word": false,
1577
+ "special": true
1578
+ },
1579
+ "199": {
1580
+ "content": "<|reserved_189|>",
1581
+ "lstrip": false,
1582
+ "normalized": false,
1583
+ "rstrip": false,
1584
+ "single_word": false,
1585
+ "special": true
1586
+ },
1587
+ "200": {
1588
+ "content": "<|reserved_190|>",
1589
+ "lstrip": false,
1590
+ "normalized": false,
1591
+ "rstrip": false,
1592
+ "single_word": false,
1593
+ "special": true
1594
+ },
1595
+ "201": {
1596
+ "content": "<|reserved_191|>",
1597
+ "lstrip": false,
1598
+ "normalized": false,
1599
+ "rstrip": false,
1600
+ "single_word": false,
1601
+ "special": true
1602
+ },
1603
+ "202": {
1604
+ "content": "<|reserved_192|>",
1605
+ "lstrip": false,
1606
+ "normalized": false,
1607
+ "rstrip": false,
1608
+ "single_word": false,
1609
+ "special": true
1610
+ },
1611
+ "203": {
1612
+ "content": "<|reserved_193|>",
1613
+ "lstrip": false,
1614
+ "normalized": false,
1615
+ "rstrip": false,
1616
+ "single_word": false,
1617
+ "special": true
1618
+ },
1619
+ "204": {
1620
+ "content": "<|reserved_194|>",
1621
+ "lstrip": false,
1622
+ "normalized": false,
1623
+ "rstrip": false,
1624
+ "single_word": false,
1625
+ "special": true
1626
+ },
1627
+ "205": {
1628
+ "content": "<|reserved_195|>",
1629
+ "lstrip": false,
1630
+ "normalized": false,
1631
+ "rstrip": false,
1632
+ "single_word": false,
1633
+ "special": true
1634
+ },
1635
+ "206": {
1636
+ "content": "<|reserved_196|>",
1637
+ "lstrip": false,
1638
+ "normalized": false,
1639
+ "rstrip": false,
1640
+ "single_word": false,
1641
+ "special": true
1642
+ },
1643
+ "207": {
1644
+ "content": "<|reserved_197|>",
1645
+ "lstrip": false,
1646
+ "normalized": false,
1647
+ "rstrip": false,
1648
+ "single_word": false,
1649
+ "special": true
1650
+ },
1651
+ "208": {
1652
+ "content": "<|reserved_198|>",
1653
+ "lstrip": false,
1654
+ "normalized": false,
1655
+ "rstrip": false,
1656
+ "single_word": false,
1657
+ "special": true
1658
+ },
1659
+ "209": {
1660
+ "content": "<|reserved_199|>",
1661
+ "lstrip": false,
1662
+ "normalized": false,
1663
+ "rstrip": false,
1664
+ "single_word": false,
1665
+ "special": true
1666
+ },
1667
+ "210": {
1668
+ "content": "<|reserved_200|>",
1669
+ "lstrip": false,
1670
+ "normalized": false,
1671
+ "rstrip": false,
1672
+ "single_word": false,
1673
+ "special": true
1674
+ },
1675
+ "211": {
1676
+ "content": "<|reserved_201|>",
1677
+ "lstrip": false,
1678
+ "normalized": false,
1679
+ "rstrip": false,
1680
+ "single_word": false,
1681
+ "special": true
1682
+ },
1683
+ "212": {
1684
+ "content": "<|reserved_202|>",
1685
+ "lstrip": false,
1686
+ "normalized": false,
1687
+ "rstrip": false,
1688
+ "single_word": false,
1689
+ "special": true
1690
+ },
1691
+ "213": {
1692
+ "content": "<|reserved_203|>",
1693
+ "lstrip": false,
1694
+ "normalized": false,
1695
+ "rstrip": false,
1696
+ "single_word": false,
1697
+ "special": true
1698
+ },
1699
+ "214": {
1700
+ "content": "<|reserved_204|>",
1701
+ "lstrip": false,
1702
+ "normalized": false,
1703
+ "rstrip": false,
1704
+ "single_word": false,
1705
+ "special": true
1706
+ },
1707
+ "215": {
1708
+ "content": "<|reserved_205|>",
1709
+ "lstrip": false,
1710
+ "normalized": false,
1711
+ "rstrip": false,
1712
+ "single_word": false,
1713
+ "special": true
1714
+ },
1715
+ "216": {
1716
+ "content": "<|reserved_206|>",
1717
+ "lstrip": false,
1718
+ "normalized": false,
1719
+ "rstrip": false,
1720
+ "single_word": false,
1721
+ "special": true
1722
+ },
1723
+ "217": {
1724
+ "content": "<|reserved_207|>",
1725
+ "lstrip": false,
1726
+ "normalized": false,
1727
+ "rstrip": false,
1728
+ "single_word": false,
1729
+ "special": true
1730
+ },
1731
+ "218": {
1732
+ "content": "<|reserved_208|>",
1733
+ "lstrip": false,
1734
+ "normalized": false,
1735
+ "rstrip": false,
1736
+ "single_word": false,
1737
+ "special": true
1738
+ },
1739
+ "219": {
1740
+ "content": "<|reserved_209|>",
1741
+ "lstrip": false,
1742
+ "normalized": false,
1743
+ "rstrip": false,
1744
+ "single_word": false,
1745
+ "special": true
1746
+ },
1747
+ "220": {
1748
+ "content": "<|reserved_210|>",
1749
+ "lstrip": false,
1750
+ "normalized": false,
1751
+ "rstrip": false,
1752
+ "single_word": false,
1753
+ "special": true
1754
+ },
1755
+ "221": {
1756
+ "content": "<|reserved_211|>",
1757
+ "lstrip": false,
1758
+ "normalized": false,
1759
+ "rstrip": false,
1760
+ "single_word": false,
1761
+ "special": true
1762
+ },
1763
+ "222": {
1764
+ "content": "<|reserved_212|>",
1765
+ "lstrip": false,
1766
+ "normalized": false,
1767
+ "rstrip": false,
1768
+ "single_word": false,
1769
+ "special": true
1770
+ },
1771
+ "223": {
1772
+ "content": "<|reserved_213|>",
1773
+ "lstrip": false,
1774
+ "normalized": false,
1775
+ "rstrip": false,
1776
+ "single_word": false,
1777
+ "special": true
1778
+ },
1779
+ "224": {
1780
+ "content": "<|reserved_214|>",
1781
+ "lstrip": false,
1782
+ "normalized": false,
1783
+ "rstrip": false,
1784
+ "single_word": false,
1785
+ "special": true
1786
+ },
1787
+ "225": {
1788
+ "content": "<|reserved_215|>",
1789
+ "lstrip": false,
1790
+ "normalized": false,
1791
+ "rstrip": false,
1792
+ "single_word": false,
1793
+ "special": true
1794
+ },
1795
+ "226": {
1796
+ "content": "<|reserved_216|>",
1797
+ "lstrip": false,
1798
+ "normalized": false,
1799
+ "rstrip": false,
1800
+ "single_word": false,
1801
+ "special": true
1802
+ },
1803
+ "227": {
1804
+ "content": "<|reserved_217|>",
1805
+ "lstrip": false,
1806
+ "normalized": false,
1807
+ "rstrip": false,
1808
+ "single_word": false,
1809
+ "special": true
1810
+ },
1811
+ "228": {
1812
+ "content": "<|reserved_218|>",
1813
+ "lstrip": false,
1814
+ "normalized": false,
1815
+ "rstrip": false,
1816
+ "single_word": false,
1817
+ "special": true
1818
+ },
1819
+ "229": {
1820
+ "content": "<|reserved_219|>",
1821
+ "lstrip": false,
1822
+ "normalized": false,
1823
+ "rstrip": false,
1824
+ "single_word": false,
1825
+ "special": true
1826
+ },
1827
+ "230": {
1828
+ "content": "<|reserved_220|>",
1829
+ "lstrip": false,
1830
+ "normalized": false,
1831
+ "rstrip": false,
1832
+ "single_word": false,
1833
+ "special": true
1834
+ },
1835
+ "231": {
1836
+ "content": "<|reserved_221|>",
1837
+ "lstrip": false,
1838
+ "normalized": false,
1839
+ "rstrip": false,
1840
+ "single_word": false,
1841
+ "special": true
1842
+ },
1843
+ "232": {
1844
+ "content": "<|reserved_222|>",
1845
+ "lstrip": false,
1846
+ "normalized": false,
1847
+ "rstrip": false,
1848
+ "single_word": false,
1849
+ "special": true
1850
+ },
1851
+ "233": {
1852
+ "content": "<|reserved_223|>",
1853
+ "lstrip": false,
1854
+ "normalized": false,
1855
+ "rstrip": false,
1856
+ "single_word": false,
1857
+ "special": true
1858
+ },
1859
+ "234": {
1860
+ "content": "<|reserved_224|>",
1861
+ "lstrip": false,
1862
+ "normalized": false,
1863
+ "rstrip": false,
1864
+ "single_word": false,
1865
+ "special": true
1866
+ },
1867
+ "235": {
1868
+ "content": "<|reserved_225|>",
1869
+ "lstrip": false,
1870
+ "normalized": false,
1871
+ "rstrip": false,
1872
+ "single_word": false,
1873
+ "special": true
1874
+ },
1875
+ "236": {
1876
+ "content": "<|reserved_226|>",
1877
+ "lstrip": false,
1878
+ "normalized": false,
1879
+ "rstrip": false,
1880
+ "single_word": false,
1881
+ "special": true
1882
+ },
1883
+ "237": {
1884
+ "content": "<|reserved_227|>",
1885
+ "lstrip": false,
1886
+ "normalized": false,
1887
+ "rstrip": false,
1888
+ "single_word": false,
1889
+ "special": true
1890
+ },
1891
+ "238": {
1892
+ "content": "<|reserved_228|>",
1893
+ "lstrip": false,
1894
+ "normalized": false,
1895
+ "rstrip": false,
1896
+ "single_word": false,
1897
+ "special": true
1898
+ },
1899
+ "239": {
1900
+ "content": "<|reserved_229|>",
1901
+ "lstrip": false,
1902
+ "normalized": false,
1903
+ "rstrip": false,
1904
+ "single_word": false,
1905
+ "special": true
1906
+ },
1907
+ "240": {
1908
+ "content": "<|reserved_230|>",
1909
+ "lstrip": false,
1910
+ "normalized": false,
1911
+ "rstrip": false,
1912
+ "single_word": false,
1913
+ "special": true
1914
+ },
1915
+ "241": {
1916
+ "content": "<|reserved_231|>",
1917
+ "lstrip": false,
1918
+ "normalized": false,
1919
+ "rstrip": false,
1920
+ "single_word": false,
1921
+ "special": true
1922
+ },
1923
+ "242": {
1924
+ "content": "<|reserved_232|>",
1925
+ "lstrip": false,
1926
+ "normalized": false,
1927
+ "rstrip": false,
1928
+ "single_word": false,
1929
+ "special": true
1930
+ },
1931
+ "243": {
1932
+ "content": "<|reserved_233|>",
1933
+ "lstrip": false,
1934
+ "normalized": false,
1935
+ "rstrip": false,
1936
+ "single_word": false,
1937
+ "special": true
1938
+ },
1939
+ "244": {
1940
+ "content": "<|reserved_234|>",
1941
+ "lstrip": false,
1942
+ "normalized": false,
1943
+ "rstrip": false,
1944
+ "single_word": false,
1945
+ "special": true
1946
+ },
1947
+ "245": {
1948
+ "content": "<|reserved_235|>",
1949
+ "lstrip": false,
1950
+ "normalized": false,
1951
+ "rstrip": false,
1952
+ "single_word": false,
1953
+ "special": true
1954
+ },
1955
+ "246": {
1956
+ "content": "<|reserved_236|>",
1957
+ "lstrip": false,
1958
+ "normalized": false,
1959
+ "rstrip": false,
1960
+ "single_word": false,
1961
+ "special": true
1962
+ },
1963
+ "247": {
1964
+ "content": "<|reserved_237|>",
1965
+ "lstrip": false,
1966
+ "normalized": false,
1967
+ "rstrip": false,
1968
+ "single_word": false,
1969
+ "special": true
1970
+ },
1971
+ "248": {
1972
+ "content": "<|reserved_238|>",
1973
+ "lstrip": false,
1974
+ "normalized": false,
1975
+ "rstrip": false,
1976
+ "single_word": false,
1977
+ "special": true
1978
+ },
1979
+ "249": {
1980
+ "content": "<|reserved_239|>",
1981
+ "lstrip": false,
1982
+ "normalized": false,
1983
+ "rstrip": false,
1984
+ "single_word": false,
1985
+ "special": true
1986
+ },
1987
+ "250": {
1988
+ "content": "<|reserved_240|>",
1989
+ "lstrip": false,
1990
+ "normalized": false,
1991
+ "rstrip": false,
1992
+ "single_word": false,
1993
+ "special": true
1994
+ },
1995
+ "251": {
1996
+ "content": "<|reserved_241|>",
1997
+ "lstrip": false,
1998
+ "normalized": false,
1999
+ "rstrip": false,
2000
+ "single_word": false,
2001
+ "special": true
2002
+ },
2003
+ "252": {
2004
+ "content": "<|reserved_242|>",
2005
+ "lstrip": false,
2006
+ "normalized": false,
2007
+ "rstrip": false,
2008
+ "single_word": false,
2009
+ "special": true
2010
+ },
2011
+ "253": {
2012
+ "content": "<|reserved_243|>",
2013
+ "lstrip": false,
2014
+ "normalized": false,
2015
+ "rstrip": false,
2016
+ "single_word": false,
2017
+ "special": true
2018
+ },
2019
+ "254": {
2020
+ "content": "<|reserved_244|>",
2021
+ "lstrip": false,
2022
+ "normalized": false,
2023
+ "rstrip": false,
2024
+ "single_word": false,
2025
+ "special": true
2026
+ },
2027
+ "255": {
2028
+ "content": "<|reserved_245|>",
2029
+ "lstrip": false,
2030
+ "normalized": false,
2031
+ "rstrip": false,
2032
+ "single_word": false,
2033
+ "special": true
2034
+ },
2035
+ "256": {
2036
+ "content": "<|reserved_246|>",
2037
+ "lstrip": false,
2038
+ "normalized": false,
2039
+ "rstrip": false,
2040
+ "single_word": false,
2041
+ "special": true
2042
+ },
2043
+ "257": {
2044
+ "content": "<|reserved_247|>",
2045
+ "lstrip": false,
2046
+ "normalized": false,
2047
+ "rstrip": false,
2048
+ "single_word": false,
2049
+ "special": true
2050
+ },
2051
+ "258": {
2052
+ "content": "<|reserved_248|>",
2053
+ "lstrip": false,
2054
+ "normalized": false,
2055
+ "rstrip": false,
2056
+ "single_word": false,
2057
+ "special": true
2058
+ },
2059
+ "259": {
2060
+ "content": "<|reserved_249|>",
2061
+ "lstrip": false,
2062
+ "normalized": false,
2063
+ "rstrip": false,
2064
+ "single_word": false,
2065
+ "special": true
2066
+ },
2067
+ "260": {
2068
+ "content": "<|reserved_250|>",
2069
+ "lstrip": false,
2070
+ "normalized": false,
2071
+ "rstrip": false,
2072
+ "single_word": false,
2073
+ "special": true
2074
+ },
2075
+ "261": {
2076
+ "content": "<|reserved_251|>",
2077
+ "lstrip": false,
2078
+ "normalized": false,
2079
+ "rstrip": false,
2080
+ "single_word": false,
2081
+ "special": true
2082
+ },
2083
+ "262": {
2084
+ "content": "<|reserved_252|>",
2085
+ "lstrip": false,
2086
+ "normalized": false,
2087
+ "rstrip": false,
2088
+ "single_word": false,
2089
+ "special": true
2090
+ },
2091
+ "263": {
2092
+ "content": "<|reserved_253|>",
2093
+ "lstrip": false,
2094
+ "normalized": false,
2095
+ "rstrip": false,
2096
+ "single_word": false,
2097
+ "special": true
2098
+ },
2099
+ "264": {
2100
+ "content": "<|reserved_254|>",
2101
+ "lstrip": false,
2102
+ "normalized": false,
2103
+ "rstrip": false,
2104
+ "single_word": false,
2105
+ "special": true
2106
+ },
2107
+ "265": {
2108
+ "content": "<|reserved_255|>",
2109
+ "lstrip": false,
2110
+ "normalized": false,
2111
+ "rstrip": false,
2112
+ "single_word": false,
2113
+ "special": true
2114
+ },
2115
+ "266": {
2116
+ "content": "<|reserved_256|>",
2117
+ "lstrip": false,
2118
+ "normalized": false,
2119
+ "rstrip": false,
2120
+ "single_word": false,
2121
+ "special": true
2122
+ },
2123
+ "267": {
2124
+ "content": "<|reserved_257|>",
2125
+ "lstrip": false,
2126
+ "normalized": false,
2127
+ "rstrip": false,
2128
+ "single_word": false,
2129
+ "special": true
2130
+ },
2131
+ "268": {
2132
+ "content": "<|reserved_258|>",
2133
+ "lstrip": false,
2134
+ "normalized": false,
2135
+ "rstrip": false,
2136
+ "single_word": false,
2137
+ "special": true
2138
+ },
2139
+ "269": {
2140
+ "content": "<|reserved_259|>",
2141
+ "lstrip": false,
2142
+ "normalized": false,
2143
+ "rstrip": false,
2144
+ "single_word": false,
2145
+ "special": true
2146
+ },
2147
+ "270": {
2148
+ "content": "<|reserved_260|>",
2149
+ "lstrip": false,
2150
+ "normalized": false,
2151
+ "rstrip": false,
2152
+ "single_word": false,
2153
+ "special": true
2154
+ },
2155
+ "271": {
2156
+ "content": "<|reserved_261|>",
2157
+ "lstrip": false,
2158
+ "normalized": false,
2159
+ "rstrip": false,
2160
+ "single_word": false,
2161
+ "special": true
2162
+ },
2163
+ "272": {
2164
+ "content": "<|reserved_262|>",
2165
+ "lstrip": false,
2166
+ "normalized": false,
2167
+ "rstrip": false,
2168
+ "single_word": false,
2169
+ "special": true
2170
+ },
2171
+ "273": {
2172
+ "content": "<|reserved_263|>",
2173
+ "lstrip": false,
2174
+ "normalized": false,
2175
+ "rstrip": false,
2176
+ "single_word": false,
2177
+ "special": true
2178
+ },
2179
+ "274": {
2180
+ "content": "<|reserved_264|>",
2181
+ "lstrip": false,
2182
+ "normalized": false,
2183
+ "rstrip": false,
2184
+ "single_word": false,
2185
+ "special": true
2186
+ },
2187
+ "275": {
2188
+ "content": "<|reserved_265|>",
2189
+ "lstrip": false,
2190
+ "normalized": false,
2191
+ "rstrip": false,
2192
+ "single_word": false,
2193
+ "special": true
2194
+ },
2195
+ "276": {
2196
+ "content": "<|reserved_266|>",
2197
+ "lstrip": false,
2198
+ "normalized": false,
2199
+ "rstrip": false,
2200
+ "single_word": false,
2201
+ "special": true
2202
+ },
2203
+ "277": {
2204
+ "content": "<|reserved_267|>",
2205
+ "lstrip": false,
2206
+ "normalized": false,
2207
+ "rstrip": false,
2208
+ "single_word": false,
2209
+ "special": true
2210
+ },
2211
+ "278": {
2212
+ "content": "<|reserved_268|>",
2213
+ "lstrip": false,
2214
+ "normalized": false,
2215
+ "rstrip": false,
2216
+ "single_word": false,
2217
+ "special": true
2218
+ },
2219
+ "279": {
2220
+ "content": "<|reserved_269|>",
2221
+ "lstrip": false,
2222
+ "normalized": false,
2223
+ "rstrip": false,
2224
+ "single_word": false,
2225
+ "special": true
2226
+ },
2227
+ "280": {
2228
+ "content": "<|reserved_270|>",
2229
+ "lstrip": false,
2230
+ "normalized": false,
2231
+ "rstrip": false,
2232
+ "single_word": false,
2233
+ "special": true
2234
+ },
2235
+ "281": {
2236
+ "content": "<|reserved_271|>",
2237
+ "lstrip": false,
2238
+ "normalized": false,
2239
+ "rstrip": false,
2240
+ "single_word": false,
2241
+ "special": true
2242
+ },
2243
+ "282": {
2244
+ "content": "<|reserved_272|>",
2245
+ "lstrip": false,
2246
+ "normalized": false,
2247
+ "rstrip": false,
2248
+ "single_word": false,
2249
+ "special": true
2250
+ },
2251
+ "283": {
2252
+ "content": "<|reserved_273|>",
2253
+ "lstrip": false,
2254
+ "normalized": false,
2255
+ "rstrip": false,
2256
+ "single_word": false,
2257
+ "special": true
2258
+ },
2259
+ "284": {
2260
+ "content": "<|reserved_274|>",
2261
+ "lstrip": false,
2262
+ "normalized": false,
2263
+ "rstrip": false,
2264
+ "single_word": false,
2265
+ "special": true
2266
+ },
2267
+ "285": {
2268
+ "content": "<|reserved_275|>",
2269
+ "lstrip": false,
2270
+ "normalized": false,
2271
+ "rstrip": false,
2272
+ "single_word": false,
2273
+ "special": true
2274
+ },
2275
+ "286": {
2276
+ "content": "<|reserved_276|>",
2277
+ "lstrip": false,
2278
+ "normalized": false,
2279
+ "rstrip": false,
2280
+ "single_word": false,
2281
+ "special": true
2282
+ },
2283
+ "287": {
2284
+ "content": "<|reserved_277|>",
2285
+ "lstrip": false,
2286
+ "normalized": false,
2287
+ "rstrip": false,
2288
+ "single_word": false,
2289
+ "special": true
2290
+ },
2291
+ "288": {
2292
+ "content": "<|reserved_278|>",
2293
+ "lstrip": false,
2294
+ "normalized": false,
2295
+ "rstrip": false,
2296
+ "single_word": false,
2297
+ "special": true
2298
+ },
2299
+ "289": {
2300
+ "content": "<|reserved_279|>",
2301
+ "lstrip": false,
2302
+ "normalized": false,
2303
+ "rstrip": false,
2304
+ "single_word": false,
2305
+ "special": true
2306
+ },
2307
+ "290": {
2308
+ "content": "<|reserved_280|>",
2309
+ "lstrip": false,
2310
+ "normalized": false,
2311
+ "rstrip": false,
2312
+ "single_word": false,
2313
+ "special": true
2314
+ },
2315
+ "291": {
2316
+ "content": "<|reserved_281|>",
2317
+ "lstrip": false,
2318
+ "normalized": false,
2319
+ "rstrip": false,
2320
+ "single_word": false,
2321
+ "special": true
2322
+ },
2323
+ "292": {
2324
+ "content": "<|reserved_282|>",
2325
+ "lstrip": false,
2326
+ "normalized": false,
2327
+ "rstrip": false,
2328
+ "single_word": false,
2329
+ "special": true
2330
+ },
2331
+ "293": {
2332
+ "content": "<|reserved_283|>",
2333
+ "lstrip": false,
2334
+ "normalized": false,
2335
+ "rstrip": false,
2336
+ "single_word": false,
2337
+ "special": true
2338
+ },
2339
+ "294": {
2340
+ "content": "<|reserved_284|>",
2341
+ "lstrip": false,
2342
+ "normalized": false,
2343
+ "rstrip": false,
2344
+ "single_word": false,
2345
+ "special": true
2346
+ },
2347
+ "295": {
2348
+ "content": "<|reserved_285|>",
2349
+ "lstrip": false,
2350
+ "normalized": false,
2351
+ "rstrip": false,
2352
+ "single_word": false,
2353
+ "special": true
2354
+ },
2355
+ "296": {
2356
+ "content": "<|reserved_286|>",
2357
+ "lstrip": false,
2358
+ "normalized": false,
2359
+ "rstrip": false,
2360
+ "single_word": false,
2361
+ "special": true
2362
+ },
2363
+ "297": {
2364
+ "content": "<|reserved_287|>",
2365
+ "lstrip": false,
2366
+ "normalized": false,
2367
+ "rstrip": false,
2368
+ "single_word": false,
2369
+ "special": true
2370
+ },
2371
+ "298": {
2372
+ "content": "<|reserved_288|>",
2373
+ "lstrip": false,
2374
+ "normalized": false,
2375
+ "rstrip": false,
2376
+ "single_word": false,
2377
+ "special": true
2378
+ },
2379
+ "299": {
2380
+ "content": "<|reserved_289|>",
2381
+ "lstrip": false,
2382
+ "normalized": false,
2383
+ "rstrip": false,
2384
+ "single_word": false,
2385
+ "special": true
2386
+ },
2387
+ "300": {
2388
+ "content": "<|reserved_290|>",
2389
+ "lstrip": false,
2390
+ "normalized": false,
2391
+ "rstrip": false,
2392
+ "single_word": false,
2393
+ "special": true
2394
+ },
2395
+ "301": {
2396
+ "content": "<|reserved_291|>",
2397
+ "lstrip": false,
2398
+ "normalized": false,
2399
+ "rstrip": false,
2400
+ "single_word": false,
2401
+ "special": true
2402
+ },
2403
+ "302": {
2404
+ "content": "<|reserved_292|>",
2405
+ "lstrip": false,
2406
+ "normalized": false,
2407
+ "rstrip": false,
2408
+ "single_word": false,
2409
+ "special": true
2410
+ },
2411
+ "303": {
2412
+ "content": "<|reserved_293|>",
2413
+ "lstrip": false,
2414
+ "normalized": false,
2415
+ "rstrip": false,
2416
+ "single_word": false,
2417
+ "special": true
2418
+ },
2419
+ "304": {
2420
+ "content": "<|reserved_294|>",
2421
+ "lstrip": false,
2422
+ "normalized": false,
2423
+ "rstrip": false,
2424
+ "single_word": false,
2425
+ "special": true
2426
+ },
2427
+ "305": {
2428
+ "content": "<|reserved_295|>",
2429
+ "lstrip": false,
2430
+ "normalized": false,
2431
+ "rstrip": false,
2432
+ "single_word": false,
2433
+ "special": true
2434
+ },
2435
+ "306": {
2436
+ "content": "<|reserved_296|>",
2437
+ "lstrip": false,
2438
+ "normalized": false,
2439
+ "rstrip": false,
2440
+ "single_word": false,
2441
+ "special": true
2442
+ },
2443
+ "307": {
2444
+ "content": "<|reserved_297|>",
2445
+ "lstrip": false,
2446
+ "normalized": false,
2447
+ "rstrip": false,
2448
+ "single_word": false,
2449
+ "special": true
2450
+ },
2451
+ "308": {
2452
+ "content": "<|reserved_298|>",
2453
+ "lstrip": false,
2454
+ "normalized": false,
2455
+ "rstrip": false,
2456
+ "single_word": false,
2457
+ "special": true
2458
+ },
2459
+ "309": {
2460
+ "content": "<|reserved_299|>",
2461
+ "lstrip": false,
2462
+ "normalized": false,
2463
+ "rstrip": false,
2464
+ "single_word": false,
2465
+ "special": true
2466
+ },
2467
+ "310": {
2468
+ "content": "<|reserved_300|>",
2469
+ "lstrip": false,
2470
+ "normalized": false,
2471
+ "rstrip": false,
2472
+ "single_word": false,
2473
+ "special": true
2474
+ },
2475
+ "311": {
2476
+ "content": "<|reserved_301|>",
2477
+ "lstrip": false,
2478
+ "normalized": false,
2479
+ "rstrip": false,
2480
+ "single_word": false,
2481
+ "special": true
2482
+ },
2483
+ "312": {
2484
+ "content": "<|reserved_302|>",
2485
+ "lstrip": false,
2486
+ "normalized": false,
2487
+ "rstrip": false,
2488
+ "single_word": false,
2489
+ "special": true
2490
+ },
2491
+ "313": {
2492
+ "content": "<|reserved_303|>",
2493
+ "lstrip": false,
2494
+ "normalized": false,
2495
+ "rstrip": false,
2496
+ "single_word": false,
2497
+ "special": true
2498
+ },
2499
+ "314": {
2500
+ "content": "<|reserved_304|>",
2501
+ "lstrip": false,
2502
+ "normalized": false,
2503
+ "rstrip": false,
2504
+ "single_word": false,
2505
+ "special": true
2506
+ },
2507
+ "315": {
2508
+ "content": "<|reserved_305|>",
2509
+ "lstrip": false,
2510
+ "normalized": false,
2511
+ "rstrip": false,
2512
+ "single_word": false,
2513
+ "special": true
2514
+ },
2515
+ "316": {
2516
+ "content": "<|reserved_306|>",
2517
+ "lstrip": false,
2518
+ "normalized": false,
2519
+ "rstrip": false,
2520
+ "single_word": false,
2521
+ "special": true
2522
+ },
2523
+ "317": {
2524
+ "content": "<|reserved_307|>",
2525
+ "lstrip": false,
2526
+ "normalized": false,
2527
+ "rstrip": false,
2528
+ "single_word": false,
2529
+ "special": true
2530
+ },
2531
+ "318": {
2532
+ "content": "<|reserved_308|>",
2533
+ "lstrip": false,
2534
+ "normalized": false,
2535
+ "rstrip": false,
2536
+ "single_word": false,
2537
+ "special": true
2538
+ },
2539
+ "319": {
2540
+ "content": "<|reserved_309|>",
2541
+ "lstrip": false,
2542
+ "normalized": false,
2543
+ "rstrip": false,
2544
+ "single_word": false,
2545
+ "special": true
2546
+ },
2547
+ "320": {
2548
+ "content": "<|reserved_310|>",
2549
+ "lstrip": false,
2550
+ "normalized": false,
2551
+ "rstrip": false,
2552
+ "single_word": false,
2553
+ "special": true
2554
+ },
2555
+ "321": {
2556
+ "content": "<|reserved_311|>",
2557
+ "lstrip": false,
2558
+ "normalized": false,
2559
+ "rstrip": false,
2560
+ "single_word": false,
2561
+ "special": true
2562
+ },
2563
+ "322": {
2564
+ "content": "<|reserved_312|>",
2565
+ "lstrip": false,
2566
+ "normalized": false,
2567
+ "rstrip": false,
2568
+ "single_word": false,
2569
+ "special": true
2570
+ },
2571
+ "323": {
2572
+ "content": "<|reserved_313|>",
2573
+ "lstrip": false,
2574
+ "normalized": false,
2575
+ "rstrip": false,
2576
+ "single_word": false,
2577
+ "special": true
2578
+ },
2579
+ "324": {
2580
+ "content": "<|reserved_314|>",
2581
+ "lstrip": false,
2582
+ "normalized": false,
2583
+ "rstrip": false,
2584
+ "single_word": false,
2585
+ "special": true
2586
+ },
2587
+ "325": {
2588
+ "content": "<|reserved_315|>",
2589
+ "lstrip": false,
2590
+ "normalized": false,
2591
+ "rstrip": false,
2592
+ "single_word": false,
2593
+ "special": true
2594
+ },
2595
+ "326": {
2596
+ "content": "<|reserved_316|>",
2597
+ "lstrip": false,
2598
+ "normalized": false,
2599
+ "rstrip": false,
2600
+ "single_word": false,
2601
+ "special": true
2602
+ },
2603
+ "327": {
2604
+ "content": "<|reserved_317|>",
2605
+ "lstrip": false,
2606
+ "normalized": false,
2607
+ "rstrip": false,
2608
+ "single_word": false,
2609
+ "special": true
2610
+ },
2611
+ "328": {
2612
+ "content": "<|reserved_318|>",
2613
+ "lstrip": false,
2614
+ "normalized": false,
2615
+ "rstrip": false,
2616
+ "single_word": false,
2617
+ "special": true
2618
+ },
2619
+ "329": {
2620
+ "content": "<|reserved_319|>",
2621
+ "lstrip": false,
2622
+ "normalized": false,
2623
+ "rstrip": false,
2624
+ "single_word": false,
2625
+ "special": true
2626
+ },
2627
+ "330": {
2628
+ "content": "<|reserved_320|>",
2629
+ "lstrip": false,
2630
+ "normalized": false,
2631
+ "rstrip": false,
2632
+ "single_word": false,
2633
+ "special": true
2634
+ },
2635
+ "331": {
2636
+ "content": "<|reserved_321|>",
2637
+ "lstrip": false,
2638
+ "normalized": false,
2639
+ "rstrip": false,
2640
+ "single_word": false,
2641
+ "special": true
2642
+ },
2643
+ "332": {
2644
+ "content": "<|reserved_322|>",
2645
+ "lstrip": false,
2646
+ "normalized": false,
2647
+ "rstrip": false,
2648
+ "single_word": false,
2649
+ "special": true
2650
+ },
2651
+ "333": {
2652
+ "content": "<|reserved_323|>",
2653
+ "lstrip": false,
2654
+ "normalized": false,
2655
+ "rstrip": false,
2656
+ "single_word": false,
2657
+ "special": true
2658
+ },
2659
+ "334": {
2660
+ "content": "<|reserved_324|>",
2661
+ "lstrip": false,
2662
+ "normalized": false,
2663
+ "rstrip": false,
2664
+ "single_word": false,
2665
+ "special": true
2666
+ },
2667
+ "335": {
2668
+ "content": "<|reserved_325|>",
2669
+ "lstrip": false,
2670
+ "normalized": false,
2671
+ "rstrip": false,
2672
+ "single_word": false,
2673
+ "special": true
2674
+ },
2675
+ "336": {
2676
+ "content": "<|reserved_326|>",
2677
+ "lstrip": false,
2678
+ "normalized": false,
2679
+ "rstrip": false,
2680
+ "single_word": false,
2681
+ "special": true
2682
+ },
2683
+ "337": {
2684
+ "content": "<|reserved_327|>",
2685
+ "lstrip": false,
2686
+ "normalized": false,
2687
+ "rstrip": false,
2688
+ "single_word": false,
2689
+ "special": true
2690
+ },
2691
+ "338": {
2692
+ "content": "<|reserved_328|>",
2693
+ "lstrip": false,
2694
+ "normalized": false,
2695
+ "rstrip": false,
2696
+ "single_word": false,
2697
+ "special": true
2698
+ },
2699
+ "339": {
2700
+ "content": "<|reserved_329|>",
2701
+ "lstrip": false,
2702
+ "normalized": false,
2703
+ "rstrip": false,
2704
+ "single_word": false,
2705
+ "special": true
2706
+ },
2707
+ "340": {
2708
+ "content": "<|reserved_330|>",
2709
+ "lstrip": false,
2710
+ "normalized": false,
2711
+ "rstrip": false,
2712
+ "single_word": false,
2713
+ "special": true
2714
+ },
2715
+ "341": {
2716
+ "content": "<|reserved_331|>",
2717
+ "lstrip": false,
2718
+ "normalized": false,
2719
+ "rstrip": false,
2720
+ "single_word": false,
2721
+ "special": true
2722
+ },
2723
+ "342": {
2724
+ "content": "<|reserved_332|>",
2725
+ "lstrip": false,
2726
+ "normalized": false,
2727
+ "rstrip": false,
2728
+ "single_word": false,
2729
+ "special": true
2730
+ },
2731
+ "343": {
2732
+ "content": "<|reserved_333|>",
2733
+ "lstrip": false,
2734
+ "normalized": false,
2735
+ "rstrip": false,
2736
+ "single_word": false,
2737
+ "special": true
2738
+ },
2739
+ "344": {
2740
+ "content": "<|reserved_334|>",
2741
+ "lstrip": false,
2742
+ "normalized": false,
2743
+ "rstrip": false,
2744
+ "single_word": false,
2745
+ "special": true
2746
+ },
2747
+ "345": {
2748
+ "content": "<|reserved_335|>",
2749
+ "lstrip": false,
2750
+ "normalized": false,
2751
+ "rstrip": false,
2752
+ "single_word": false,
2753
+ "special": true
2754
+ },
2755
+ "346": {
2756
+ "content": "<|reserved_336|>",
2757
+ "lstrip": false,
2758
+ "normalized": false,
2759
+ "rstrip": false,
2760
+ "single_word": false,
2761
+ "special": true
2762
+ },
2763
+ "347": {
2764
+ "content": "<|reserved_337|>",
2765
+ "lstrip": false,
2766
+ "normalized": false,
2767
+ "rstrip": false,
2768
+ "single_word": false,
2769
+ "special": true
2770
+ },
2771
+ "348": {
2772
+ "content": "<|reserved_338|>",
2773
+ "lstrip": false,
2774
+ "normalized": false,
2775
+ "rstrip": false,
2776
+ "single_word": false,
2777
+ "special": true
2778
+ },
2779
+ "349": {
2780
+ "content": "<|reserved_339|>",
2781
+ "lstrip": false,
2782
+ "normalized": false,
2783
+ "rstrip": false,
2784
+ "single_word": false,
2785
+ "special": true
2786
+ },
2787
+ "350": {
2788
+ "content": "<|reserved_340|>",
2789
+ "lstrip": false,
2790
+ "normalized": false,
2791
+ "rstrip": false,
2792
+ "single_word": false,
2793
+ "special": true
2794
+ },
2795
+ "351": {
2796
+ "content": "<|reserved_341|>",
2797
+ "lstrip": false,
2798
+ "normalized": false,
2799
+ "rstrip": false,
2800
+ "single_word": false,
2801
+ "special": true
2802
+ },
2803
+ "352": {
2804
+ "content": "<|reserved_342|>",
2805
+ "lstrip": false,
2806
+ "normalized": false,
2807
+ "rstrip": false,
2808
+ "single_word": false,
2809
+ "special": true
2810
+ },
2811
+ "353": {
2812
+ "content": "<|reserved_343|>",
2813
+ "lstrip": false,
2814
+ "normalized": false,
2815
+ "rstrip": false,
2816
+ "single_word": false,
2817
+ "special": true
2818
+ },
2819
+ "354": {
2820
+ "content": "<|reserved_344|>",
2821
+ "lstrip": false,
2822
+ "normalized": false,
2823
+ "rstrip": false,
2824
+ "single_word": false,
2825
+ "special": true
2826
+ },
2827
+ "355": {
2828
+ "content": "<|reserved_345|>",
2829
+ "lstrip": false,
2830
+ "normalized": false,
2831
+ "rstrip": false,
2832
+ "single_word": false,
2833
+ "special": true
2834
+ },
2835
+ "356": {
2836
+ "content": "<|reserved_346|>",
2837
+ "lstrip": false,
2838
+ "normalized": false,
2839
+ "rstrip": false,
2840
+ "single_word": false,
2841
+ "special": true
2842
+ },
2843
+ "357": {
2844
+ "content": "<|reserved_347|>",
2845
+ "lstrip": false,
2846
+ "normalized": false,
2847
+ "rstrip": false,
2848
+ "single_word": false,
2849
+ "special": true
2850
+ },
2851
+ "358": {
2852
+ "content": "<|reserved_348|>",
2853
+ "lstrip": false,
2854
+ "normalized": false,
2855
+ "rstrip": false,
2856
+ "single_word": false,
2857
+ "special": true
2858
+ },
2859
+ "359": {
2860
+ "content": "<|reserved_349|>",
2861
+ "lstrip": false,
2862
+ "normalized": false,
2863
+ "rstrip": false,
2864
+ "single_word": false,
2865
+ "special": true
2866
+ },
2867
+ "360": {
2868
+ "content": "<|reserved_350|>",
2869
+ "lstrip": false,
2870
+ "normalized": false,
2871
+ "rstrip": false,
2872
+ "single_word": false,
2873
+ "special": true
2874
+ },
2875
+ "361": {
2876
+ "content": "<|reserved_351|>",
2877
+ "lstrip": false,
2878
+ "normalized": false,
2879
+ "rstrip": false,
2880
+ "single_word": false,
2881
+ "special": true
2882
+ },
2883
+ "362": {
2884
+ "content": "<|reserved_352|>",
2885
+ "lstrip": false,
2886
+ "normalized": false,
2887
+ "rstrip": false,
2888
+ "single_word": false,
2889
+ "special": true
2890
+ },
2891
+ "363": {
2892
+ "content": "<|reserved_353|>",
2893
+ "lstrip": false,
2894
+ "normalized": false,
2895
+ "rstrip": false,
2896
+ "single_word": false,
2897
+ "special": true
2898
+ },
2899
+ "364": {
2900
+ "content": "<|reserved_354|>",
2901
+ "lstrip": false,
2902
+ "normalized": false,
2903
+ "rstrip": false,
2904
+ "single_word": false,
2905
+ "special": true
2906
+ },
2907
+ "365": {
2908
+ "content": "<|reserved_355|>",
2909
+ "lstrip": false,
2910
+ "normalized": false,
2911
+ "rstrip": false,
2912
+ "single_word": false,
2913
+ "special": true
2914
+ },
2915
+ "366": {
2916
+ "content": "<|reserved_356|>",
2917
+ "lstrip": false,
2918
+ "normalized": false,
2919
+ "rstrip": false,
2920
+ "single_word": false,
2921
+ "special": true
2922
+ },
2923
+ "367": {
2924
+ "content": "<|reserved_357|>",
2925
+ "lstrip": false,
2926
+ "normalized": false,
2927
+ "rstrip": false,
2928
+ "single_word": false,
2929
+ "special": true
2930
+ },
2931
+ "368": {
2932
+ "content": "<|reserved_358|>",
2933
+ "lstrip": false,
2934
+ "normalized": false,
2935
+ "rstrip": false,
2936
+ "single_word": false,
2937
+ "special": true
2938
+ },
2939
+ "369": {
2940
+ "content": "<|reserved_359|>",
2941
+ "lstrip": false,
2942
+ "normalized": false,
2943
+ "rstrip": false,
2944
+ "single_word": false,
2945
+ "special": true
2946
+ },
2947
+ "370": {
2948
+ "content": "<|reserved_360|>",
2949
+ "lstrip": false,
2950
+ "normalized": false,
2951
+ "rstrip": false,
2952
+ "single_word": false,
2953
+ "special": true
2954
+ },
2955
+ "371": {
2956
+ "content": "<|reserved_361|>",
2957
+ "lstrip": false,
2958
+ "normalized": false,
2959
+ "rstrip": false,
2960
+ "single_word": false,
2961
+ "special": true
2962
+ },
2963
+ "372": {
2964
+ "content": "<|reserved_362|>",
2965
+ "lstrip": false,
2966
+ "normalized": false,
2967
+ "rstrip": false,
2968
+ "single_word": false,
2969
+ "special": true
2970
+ },
2971
+ "373": {
2972
+ "content": "<|reserved_363|>",
2973
+ "lstrip": false,
2974
+ "normalized": false,
2975
+ "rstrip": false,
2976
+ "single_word": false,
2977
+ "special": true
2978
+ },
2979
+ "374": {
2980
+ "content": "<|reserved_364|>",
2981
+ "lstrip": false,
2982
+ "normalized": false,
2983
+ "rstrip": false,
2984
+ "single_word": false,
2985
+ "special": true
2986
+ },
2987
+ "375": {
2988
+ "content": "<|reserved_365|>",
2989
+ "lstrip": false,
2990
+ "normalized": false,
2991
+ "rstrip": false,
2992
+ "single_word": false,
2993
+ "special": true
2994
+ },
2995
+ "376": {
2996
+ "content": "<|reserved_366|>",
2997
+ "lstrip": false,
2998
+ "normalized": false,
2999
+ "rstrip": false,
3000
+ "single_word": false,
3001
+ "special": true
3002
+ },
3003
+ "377": {
3004
+ "content": "<|reserved_367|>",
3005
+ "lstrip": false,
3006
+ "normalized": false,
3007
+ "rstrip": false,
3008
+ "single_word": false,
3009
+ "special": true
3010
+ },
3011
+ "378": {
3012
+ "content": "<|reserved_368|>",
3013
+ "lstrip": false,
3014
+ "normalized": false,
3015
+ "rstrip": false,
3016
+ "single_word": false,
3017
+ "special": true
3018
+ },
3019
+ "379": {
3020
+ "content": "<|reserved_369|>",
3021
+ "lstrip": false,
3022
+ "normalized": false,
3023
+ "rstrip": false,
3024
+ "single_word": false,
3025
+ "special": true
3026
+ },
3027
+ "380": {
3028
+ "content": "<|reserved_370|>",
3029
+ "lstrip": false,
3030
+ "normalized": false,
3031
+ "rstrip": false,
3032
+ "single_word": false,
3033
+ "special": true
3034
+ },
3035
+ "381": {
3036
+ "content": "<|reserved_371|>",
3037
+ "lstrip": false,
3038
+ "normalized": false,
3039
+ "rstrip": false,
3040
+ "single_word": false,
3041
+ "special": true
3042
+ },
3043
+ "382": {
3044
+ "content": "<|reserved_372|>",
3045
+ "lstrip": false,
3046
+ "normalized": false,
3047
+ "rstrip": false,
3048
+ "single_word": false,
3049
+ "special": true
3050
+ },
3051
+ "383": {
3052
+ "content": "<|reserved_373|>",
3053
+ "lstrip": false,
3054
+ "normalized": false,
3055
+ "rstrip": false,
3056
+ "single_word": false,
3057
+ "special": true
3058
+ },
3059
+ "384": {
3060
+ "content": "<|reserved_374|>",
3061
+ "lstrip": false,
3062
+ "normalized": false,
3063
+ "rstrip": false,
3064
+ "single_word": false,
3065
+ "special": true
3066
+ },
3067
+ "385": {
3068
+ "content": "<|reserved_375|>",
3069
+ "lstrip": false,
3070
+ "normalized": false,
3071
+ "rstrip": false,
3072
+ "single_word": false,
3073
+ "special": true
3074
+ },
3075
+ "386": {
3076
+ "content": "<|reserved_376|>",
3077
+ "lstrip": false,
3078
+ "normalized": false,
3079
+ "rstrip": false,
3080
+ "single_word": false,
3081
+ "special": true
3082
+ },
3083
+ "387": {
3084
+ "content": "<|reserved_377|>",
3085
+ "lstrip": false,
3086
+ "normalized": false,
3087
+ "rstrip": false,
3088
+ "single_word": false,
3089
+ "special": true
3090
+ },
3091
+ "388": {
3092
+ "content": "<|reserved_378|>",
3093
+ "lstrip": false,
3094
+ "normalized": false,
3095
+ "rstrip": false,
3096
+ "single_word": false,
3097
+ "special": true
3098
+ },
3099
+ "389": {
3100
+ "content": "<|reserved_379|>",
3101
+ "lstrip": false,
3102
+ "normalized": false,
3103
+ "rstrip": false,
3104
+ "single_word": false,
3105
+ "special": true
3106
+ },
3107
+ "390": {
3108
+ "content": "<|reserved_380|>",
3109
+ "lstrip": false,
3110
+ "normalized": false,
3111
+ "rstrip": false,
3112
+ "single_word": false,
3113
+ "special": true
3114
+ },
3115
+ "391": {
3116
+ "content": "<|reserved_381|>",
3117
+ "lstrip": false,
3118
+ "normalized": false,
3119
+ "rstrip": false,
3120
+ "single_word": false,
3121
+ "special": true
3122
+ },
3123
+ "392": {
3124
+ "content": "<|reserved_382|>",
3125
+ "lstrip": false,
3126
+ "normalized": false,
3127
+ "rstrip": false,
3128
+ "single_word": false,
3129
+ "special": true
3130
+ },
3131
+ "393": {
3132
+ "content": "<|reserved_383|>",
3133
+ "lstrip": false,
3134
+ "normalized": false,
3135
+ "rstrip": false,
3136
+ "single_word": false,
3137
+ "special": true
3138
+ },
3139
+ "394": {
3140
+ "content": "<|reserved_384|>",
3141
+ "lstrip": false,
3142
+ "normalized": false,
3143
+ "rstrip": false,
3144
+ "single_word": false,
3145
+ "special": true
3146
+ },
3147
+ "395": {
3148
+ "content": "<|reserved_385|>",
3149
+ "lstrip": false,
3150
+ "normalized": false,
3151
+ "rstrip": false,
3152
+ "single_word": false,
3153
+ "special": true
3154
+ },
3155
+ "396": {
3156
+ "content": "<image>",
3157
+ "lstrip": false,
3158
+ "normalized": false,
3159
+ "rstrip": false,
3160
+ "single_word": false,
3161
+ "special": true
3162
+ },
3163
+ "397": {
3164
+ "content": "<|img_row_1_col_1|>",
3165
+ "lstrip": false,
3166
+ "normalized": false,
3167
+ "rstrip": false,
3168
+ "single_word": false,
3169
+ "special": true
3170
+ },
3171
+ "398": {
3172
+ "content": "<|img_row_1_col_2|>",
3173
+ "lstrip": false,
3174
+ "normalized": false,
3175
+ "rstrip": false,
3176
+ "single_word": false,
3177
+ "special": true
3178
+ },
3179
+ "399": {
3180
+ "content": "<|img_row_1_col_3|>",
3181
+ "lstrip": false,
3182
+ "normalized": false,
3183
+ "rstrip": false,
3184
+ "single_word": false,
3185
+ "special": true
3186
+ },
3187
+ "400": {
3188
+ "content": "<|img_row_1_col_4|>",
3189
+ "lstrip": false,
3190
+ "normalized": false,
3191
+ "rstrip": false,
3192
+ "single_word": false,
3193
+ "special": true
3194
+ },
3195
+ "401": {
3196
+ "content": "<|img_row_1_col_5|>",
3197
+ "lstrip": false,
3198
+ "normalized": false,
3199
+ "rstrip": false,
3200
+ "single_word": false,
3201
+ "special": true
3202
+ },
3203
+ "402": {
3204
+ "content": "<|img_row_1_col_6|>",
3205
+ "lstrip": false,
3206
+ "normalized": false,
3207
+ "rstrip": false,
3208
+ "single_word": false,
3209
+ "special": true
3210
+ },
3211
+ "403": {
3212
+ "content": "<|img_row_1_col_7|>",
3213
+ "lstrip": false,
3214
+ "normalized": false,
3215
+ "rstrip": false,
3216
+ "single_word": false,
3217
+ "special": true
3218
+ },
3219
+ "404": {
3220
+ "content": "<|img_row_1_col_8|>",
3221
+ "lstrip": false,
3222
+ "normalized": false,
3223
+ "rstrip": false,
3224
+ "single_word": false,
3225
+ "special": true
3226
+ },
3227
+ "405": {
3228
+ "content": "<|img_row_1_col_9|>",
3229
+ "lstrip": false,
3230
+ "normalized": false,
3231
+ "rstrip": false,
3232
+ "single_word": false,
3233
+ "special": true
3234
+ },
3235
+ "406": {
3236
+ "content": "<|img_row_1_col_10|>",
3237
+ "lstrip": false,
3238
+ "normalized": false,
3239
+ "rstrip": false,
3240
+ "single_word": false,
3241
+ "special": true
3242
+ },
3243
+ "407": {
3244
+ "content": "<|img_row_2_col_1|>",
3245
+ "lstrip": false,
3246
+ "normalized": false,
3247
+ "rstrip": false,
3248
+ "single_word": false,
3249
+ "special": true
3250
+ },
3251
+ "408": {
3252
+ "content": "<|img_row_2_col_2|>",
3253
+ "lstrip": false,
3254
+ "normalized": false,
3255
+ "rstrip": false,
3256
+ "single_word": false,
3257
+ "special": true
3258
+ },
3259
+ "409": {
3260
+ "content": "<|img_row_2_col_3|>",
3261
+ "lstrip": false,
3262
+ "normalized": false,
3263
+ "rstrip": false,
3264
+ "single_word": false,
3265
+ "special": true
3266
+ },
3267
+ "410": {
3268
+ "content": "<|img_row_2_col_4|>",
3269
+ "lstrip": false,
3270
+ "normalized": false,
3271
+ "rstrip": false,
3272
+ "single_word": false,
3273
+ "special": true
3274
+ },
3275
+ "411": {
3276
+ "content": "<|img_row_2_col_5|>",
3277
+ "lstrip": false,
3278
+ "normalized": false,
3279
+ "rstrip": false,
3280
+ "single_word": false,
3281
+ "special": true
3282
+ },
3283
+ "412": {
3284
+ "content": "<|img_row_2_col_6|>",
3285
+ "lstrip": false,
3286
+ "normalized": false,
3287
+ "rstrip": false,
3288
+ "single_word": false,
3289
+ "special": true
3290
+ },
3291
+ "413": {
3292
+ "content": "<|img_row_2_col_7|>",
3293
+ "lstrip": false,
3294
+ "normalized": false,
3295
+ "rstrip": false,
3296
+ "single_word": false,
3297
+ "special": true
3298
+ },
3299
+ "414": {
3300
+ "content": "<|img_row_2_col_8|>",
3301
+ "lstrip": false,
3302
+ "normalized": false,
3303
+ "rstrip": false,
3304
+ "single_word": false,
3305
+ "special": true
3306
+ },
3307
+ "415": {
3308
+ "content": "<|img_row_2_col_9|>",
3309
+ "lstrip": false,
3310
+ "normalized": false,
3311
+ "rstrip": false,
3312
+ "single_word": false,
3313
+ "special": true
3314
+ },
3315
+ "416": {
3316
+ "content": "<|img_row_2_col_10|>",
3317
+ "lstrip": false,
3318
+ "normalized": false,
3319
+ "rstrip": false,
3320
+ "single_word": false,
3321
+ "special": true
3322
+ },
3323
+ "417": {
3324
+ "content": "<|img_row_3_col_1|>",
3325
+ "lstrip": false,
3326
+ "normalized": false,
3327
+ "rstrip": false,
3328
+ "single_word": false,
3329
+ "special": true
3330
+ },
3331
+ "418": {
3332
+ "content": "<|img_row_3_col_2|>",
3333
+ "lstrip": false,
3334
+ "normalized": false,
3335
+ "rstrip": false,
3336
+ "single_word": false,
3337
+ "special": true
3338
+ },
3339
+ "419": {
3340
+ "content": "<|img_row_3_col_3|>",
3341
+ "lstrip": false,
3342
+ "normalized": false,
3343
+ "rstrip": false,
3344
+ "single_word": false,
3345
+ "special": true
3346
+ },
3347
+ "420": {
3348
+ "content": "<|img_row_3_col_4|>",
3349
+ "lstrip": false,
3350
+ "normalized": false,
3351
+ "rstrip": false,
3352
+ "single_word": false,
3353
+ "special": true
3354
+ },
3355
+ "421": {
3356
+ "content": "<|img_row_3_col_5|>",
3357
+ "lstrip": false,
3358
+ "normalized": false,
3359
+ "rstrip": false,
3360
+ "single_word": false,
3361
+ "special": true
3362
+ },
3363
+ "422": {
3364
+ "content": "<|img_row_3_col_6|>",
3365
+ "lstrip": false,
3366
+ "normalized": false,
3367
+ "rstrip": false,
3368
+ "single_word": false,
3369
+ "special": true
3370
+ },
3371
+ "423": {
3372
+ "content": "<|img_row_3_col_7|>",
3373
+ "lstrip": false,
3374
+ "normalized": false,
3375
+ "rstrip": false,
3376
+ "single_word": false,
3377
+ "special": true
3378
+ },
3379
+ "424": {
3380
+ "content": "<|img_row_3_col_8|>",
3381
+ "lstrip": false,
3382
+ "normalized": false,
3383
+ "rstrip": false,
3384
+ "single_word": false,
3385
+ "special": true
3386
+ },
3387
+ "425": {
3388
+ "content": "<|img_row_3_col_9|>",
3389
+ "lstrip": false,
3390
+ "normalized": false,
3391
+ "rstrip": false,
3392
+ "single_word": false,
3393
+ "special": true
3394
+ },
3395
+ "426": {
3396
+ "content": "<|img_row_3_col_10|>",
3397
+ "lstrip": false,
3398
+ "normalized": false,
3399
+ "rstrip": false,
3400
+ "single_word": false,
3401
+ "special": true
3402
+ },
3403
+ "427": {
3404
+ "content": "<|img_row_4_col_1|>",
3405
+ "lstrip": false,
3406
+ "normalized": false,
3407
+ "rstrip": false,
3408
+ "single_word": false,
3409
+ "special": true
3410
+ },
3411
+ "428": {
3412
+ "content": "<|img_row_4_col_2|>",
3413
+ "lstrip": false,
3414
+ "normalized": false,
3415
+ "rstrip": false,
3416
+ "single_word": false,
3417
+ "special": true
3418
+ },
3419
+ "429": {
3420
+ "content": "<|img_row_4_col_3|>",
3421
+ "lstrip": false,
3422
+ "normalized": false,
3423
+ "rstrip": false,
3424
+ "single_word": false,
3425
+ "special": true
3426
+ },
3427
+ "430": {
3428
+ "content": "<|img_row_4_col_4|>",
3429
+ "lstrip": false,
3430
+ "normalized": false,
3431
+ "rstrip": false,
3432
+ "single_word": false,
3433
+ "special": true
3434
+ },
3435
+ "431": {
3436
+ "content": "<|img_row_4_col_5|>",
3437
+ "lstrip": false,
3438
+ "normalized": false,
3439
+ "rstrip": false,
3440
+ "single_word": false,
3441
+ "special": true
3442
+ },
3443
+ "432": {
3444
+ "content": "<|img_row_4_col_6|>",
3445
+ "lstrip": false,
3446
+ "normalized": false,
3447
+ "rstrip": false,
3448
+ "single_word": false,
3449
+ "special": true
3450
+ },
3451
+ "433": {
3452
+ "content": "<|img_row_4_col_7|>",
3453
+ "lstrip": false,
3454
+ "normalized": false,
3455
+ "rstrip": false,
3456
+ "single_word": false,
3457
+ "special": true
3458
+ },
3459
+ "434": {
3460
+ "content": "<|img_row_4_col_8|>",
3461
+ "lstrip": false,
3462
+ "normalized": false,
3463
+ "rstrip": false,
3464
+ "single_word": false,
3465
+ "special": true
3466
+ },
3467
+ "435": {
3468
+ "content": "<|img_row_4_col_9|>",
3469
+ "lstrip": false,
3470
+ "normalized": false,
3471
+ "rstrip": false,
3472
+ "single_word": false,
3473
+ "special": true
3474
+ },
3475
+ "436": {
3476
+ "content": "<|img_row_4_col_10|>",
3477
+ "lstrip": false,
3478
+ "normalized": false,
3479
+ "rstrip": false,
3480
+ "single_word": false,
3481
+ "special": true
3482
+ },
3483
+ "437": {
3484
+ "content": "<|img_row_5_col_1|>",
3485
+ "lstrip": false,
3486
+ "normalized": false,
3487
+ "rstrip": false,
3488
+ "single_word": false,
3489
+ "special": true
3490
+ },
3491
+ "438": {
3492
+ "content": "<|img_row_5_col_2|>",
3493
+ "lstrip": false,
3494
+ "normalized": false,
3495
+ "rstrip": false,
3496
+ "single_word": false,
3497
+ "special": true
3498
+ },
3499
+ "439": {
3500
+ "content": "<|img_row_5_col_3|>",
3501
+ "lstrip": false,
3502
+ "normalized": false,
3503
+ "rstrip": false,
3504
+ "single_word": false,
3505
+ "special": true
3506
+ },
3507
+ "440": {
3508
+ "content": "<|img_row_5_col_4|>",
3509
+ "lstrip": false,
3510
+ "normalized": false,
3511
+ "rstrip": false,
3512
+ "single_word": false,
3513
+ "special": true
3514
+ },
3515
+ "441": {
3516
+ "content": "<|img_row_5_col_5|>",
3517
+ "lstrip": false,
3518
+ "normalized": false,
3519
+ "rstrip": false,
3520
+ "single_word": false,
3521
+ "special": true
3522
+ },
3523
+ "442": {
3524
+ "content": "<|img_row_5_col_6|>",
3525
+ "lstrip": false,
3526
+ "normalized": false,
3527
+ "rstrip": false,
3528
+ "single_word": false,
3529
+ "special": true
3530
+ },
3531
+ "443": {
3532
+ "content": "<|img_row_5_col_7|>",
3533
+ "lstrip": false,
3534
+ "normalized": false,
3535
+ "rstrip": false,
3536
+ "single_word": false,
3537
+ "special": true
3538
+ },
3539
+ "444": {
3540
+ "content": "<|img_row_5_col_8|>",
3541
+ "lstrip": false,
3542
+ "normalized": false,
3543
+ "rstrip": false,
3544
+ "single_word": false,
3545
+ "special": true
3546
+ },
3547
+ "445": {
3548
+ "content": "<|img_row_5_col_9|>",
3549
+ "lstrip": false,
3550
+ "normalized": false,
3551
+ "rstrip": false,
3552
+ "single_word": false,
3553
+ "special": true
3554
+ },
3555
+ "446": {
3556
+ "content": "<|img_row_5_col_10|>",
3557
+ "lstrip": false,
3558
+ "normalized": false,
3559
+ "rstrip": false,
3560
+ "single_word": false,
3561
+ "special": true
3562
+ },
3563
+ "447": {
3564
+ "content": "<|img_row_6_col_1|>",
3565
+ "lstrip": false,
3566
+ "normalized": false,
3567
+ "rstrip": false,
3568
+ "single_word": false,
3569
+ "special": true
3570
+ },
3571
+ "448": {
3572
+ "content": "<|img_row_6_col_2|>",
3573
+ "lstrip": false,
3574
+ "normalized": false,
3575
+ "rstrip": false,
3576
+ "single_word": false,
3577
+ "special": true
3578
+ },
3579
+ "449": {
3580
+ "content": "<|img_row_6_col_3|>",
3581
+ "lstrip": false,
3582
+ "normalized": false,
3583
+ "rstrip": false,
3584
+ "single_word": false,
3585
+ "special": true
3586
+ },
3587
+ "450": {
3588
+ "content": "<|img_row_6_col_4|>",
3589
+ "lstrip": false,
3590
+ "normalized": false,
3591
+ "rstrip": false,
3592
+ "single_word": false,
3593
+ "special": true
3594
+ },
3595
+ "451": {
3596
+ "content": "<|img_row_6_col_5|>",
3597
+ "lstrip": false,
3598
+ "normalized": false,
3599
+ "rstrip": false,
3600
+ "single_word": false,
3601
+ "special": true
3602
+ },
3603
+ "452": {
3604
+ "content": "<|img_row_6_col_6|>",
3605
+ "lstrip": false,
3606
+ "normalized": false,
3607
+ "rstrip": false,
3608
+ "single_word": false,
3609
+ "special": true
3610
+ },
3611
+ "453": {
3612
+ "content": "<|img_row_6_col_7|>",
3613
+ "lstrip": false,
3614
+ "normalized": false,
3615
+ "rstrip": false,
3616
+ "single_word": false,
3617
+ "special": true
3618
+ },
3619
+ "454": {
3620
+ "content": "<|img_row_6_col_8|>",
3621
+ "lstrip": false,
3622
+ "normalized": false,
3623
+ "rstrip": false,
3624
+ "single_word": false,
3625
+ "special": true
3626
+ },
3627
+ "455": {
3628
+ "content": "<|img_row_6_col_9|>",
3629
+ "lstrip": false,
3630
+ "normalized": false,
3631
+ "rstrip": false,
3632
+ "single_word": false,
3633
+ "special": true
3634
+ },
3635
+ "456": {
3636
+ "content": "<|img_row_6_col_10|>",
3637
+ "lstrip": false,
3638
+ "normalized": false,
3639
+ "rstrip": false,
3640
+ "single_word": false,
3641
+ "special": true
3642
+ },
3643
+ "457": {
3644
+ "content": "<|img_row_7_col_1|>",
3645
+ "lstrip": false,
3646
+ "normalized": false,
3647
+ "rstrip": false,
3648
+ "single_word": false,
3649
+ "special": true
3650
+ },
3651
+ "458": {
3652
+ "content": "<|img_row_7_col_2|>",
3653
+ "lstrip": false,
3654
+ "normalized": false,
3655
+ "rstrip": false,
3656
+ "single_word": false,
3657
+ "special": true
3658
+ },
3659
+ "459": {
3660
+ "content": "<|img_row_7_col_3|>",
3661
+ "lstrip": false,
3662
+ "normalized": false,
3663
+ "rstrip": false,
3664
+ "single_word": false,
3665
+ "special": true
3666
+ },
3667
+ "460": {
3668
+ "content": "<|img_row_7_col_4|>",
3669
+ "lstrip": false,
3670
+ "normalized": false,
3671
+ "rstrip": false,
3672
+ "single_word": false,
3673
+ "special": true
3674
+ },
3675
+ "461": {
3676
+ "content": "<|img_row_7_col_5|>",
3677
+ "lstrip": false,
3678
+ "normalized": false,
3679
+ "rstrip": false,
3680
+ "single_word": false,
3681
+ "special": true
3682
+ },
3683
+ "462": {
3684
+ "content": "<|img_row_7_col_6|>",
3685
+ "lstrip": false,
3686
+ "normalized": false,
3687
+ "rstrip": false,
3688
+ "single_word": false,
3689
+ "special": true
3690
+ },
3691
+ "463": {
3692
+ "content": "<|img_row_7_col_7|>",
3693
+ "lstrip": false,
3694
+ "normalized": false,
3695
+ "rstrip": false,
3696
+ "single_word": false,
3697
+ "special": true
3698
+ },
3699
+ "464": {
3700
+ "content": "<|img_row_7_col_8|>",
3701
+ "lstrip": false,
3702
+ "normalized": false,
3703
+ "rstrip": false,
3704
+ "single_word": false,
3705
+ "special": true
3706
+ },
3707
+ "465": {
3708
+ "content": "<|img_row_7_col_9|>",
3709
+ "lstrip": false,
3710
+ "normalized": false,
3711
+ "rstrip": false,
3712
+ "single_word": false,
3713
+ "special": true
3714
+ },
3715
+ "466": {
3716
+ "content": "<|img_row_7_col_10|>",
3717
+ "lstrip": false,
3718
+ "normalized": false,
3719
+ "rstrip": false,
3720
+ "single_word": false,
3721
+ "special": true
3722
+ },
3723
+ "467": {
3724
+ "content": "<|img_row_8_col_1|>",
3725
+ "lstrip": false,
3726
+ "normalized": false,
3727
+ "rstrip": false,
3728
+ "single_word": false,
3729
+ "special": true
3730
+ },
3731
+ "468": {
3732
+ "content": "<|img_row_8_col_2|>",
3733
+ "lstrip": false,
3734
+ "normalized": false,
3735
+ "rstrip": false,
3736
+ "single_word": false,
3737
+ "special": true
3738
+ },
3739
+ "469": {
3740
+ "content": "<|img_row_8_col_3|>",
3741
+ "lstrip": false,
3742
+ "normalized": false,
3743
+ "rstrip": false,
3744
+ "single_word": false,
3745
+ "special": true
3746
+ },
3747
+ "470": {
3748
+ "content": "<|img_row_8_col_4|>",
3749
+ "lstrip": false,
3750
+ "normalized": false,
3751
+ "rstrip": false,
3752
+ "single_word": false,
3753
+ "special": true
3754
+ },
3755
+ "471": {
3756
+ "content": "<|img_row_8_col_5|>",
3757
+ "lstrip": false,
3758
+ "normalized": false,
3759
+ "rstrip": false,
3760
+ "single_word": false,
3761
+ "special": true
3762
+ },
3763
+ "472": {
3764
+ "content": "<|img_row_8_col_6|>",
3765
+ "lstrip": false,
3766
+ "normalized": false,
3767
+ "rstrip": false,
3768
+ "single_word": false,
3769
+ "special": true
3770
+ },
3771
+ "473": {
3772
+ "content": "<|img_row_8_col_7|>",
3773
+ "lstrip": false,
3774
+ "normalized": false,
3775
+ "rstrip": false,
3776
+ "single_word": false,
3777
+ "special": true
3778
+ },
3779
+ "474": {
3780
+ "content": "<|img_row_8_col_8|>",
3781
+ "lstrip": false,
3782
+ "normalized": false,
3783
+ "rstrip": false,
3784
+ "single_word": false,
3785
+ "special": true
3786
+ },
3787
+ "475": {
3788
+ "content": "<|img_row_8_col_9|>",
3789
+ "lstrip": false,
3790
+ "normalized": false,
3791
+ "rstrip": false,
3792
+ "single_word": false,
3793
+ "special": true
3794
+ },
3795
+ "476": {
3796
+ "content": "<|img_row_8_col_10|>",
3797
+ "lstrip": false,
3798
+ "normalized": false,
3799
+ "rstrip": false,
3800
+ "single_word": false,
3801
+ "special": true
3802
+ },
3803
+ "477": {
3804
+ "content": "<|img_row_9_col_1|>",
3805
+ "lstrip": false,
3806
+ "normalized": false,
3807
+ "rstrip": false,
3808
+ "single_word": false,
3809
+ "special": true
3810
+ },
3811
+ "478": {
3812
+ "content": "<|img_row_9_col_2|>",
3813
+ "lstrip": false,
3814
+ "normalized": false,
3815
+ "rstrip": false,
3816
+ "single_word": false,
3817
+ "special": true
3818
+ },
3819
+ "479": {
3820
+ "content": "<|img_row_9_col_3|>",
3821
+ "lstrip": false,
3822
+ "normalized": false,
3823
+ "rstrip": false,
3824
+ "single_word": false,
3825
+ "special": true
3826
+ },
3827
+ "480": {
3828
+ "content": "<|img_row_9_col_4|>",
3829
+ "lstrip": false,
3830
+ "normalized": false,
3831
+ "rstrip": false,
3832
+ "single_word": false,
3833
+ "special": true
3834
+ },
3835
+ "481": {
3836
+ "content": "<|img_row_9_col_5|>",
3837
+ "lstrip": false,
3838
+ "normalized": false,
3839
+ "rstrip": false,
3840
+ "single_word": false,
3841
+ "special": true
3842
+ },
3843
+ "482": {
3844
+ "content": "<|img_row_9_col_6|>",
3845
+ "lstrip": false,
3846
+ "normalized": false,
3847
+ "rstrip": false,
3848
+ "single_word": false,
3849
+ "special": true
3850
+ },
3851
+ "483": {
3852
+ "content": "<|img_row_9_col_7|>",
3853
+ "lstrip": false,
3854
+ "normalized": false,
3855
+ "rstrip": false,
3856
+ "single_word": false,
3857
+ "special": true
3858
+ },
3859
+ "484": {
3860
+ "content": "<|img_row_9_col_8|>",
3861
+ "lstrip": false,
3862
+ "normalized": false,
3863
+ "rstrip": false,
3864
+ "single_word": false,
3865
+ "special": true
3866
+ },
3867
+ "485": {
3868
+ "content": "<|img_row_9_col_9|>",
3869
+ "lstrip": false,
3870
+ "normalized": false,
3871
+ "rstrip": false,
3872
+ "single_word": false,
3873
+ "special": true
3874
+ },
3875
+ "486": {
3876
+ "content": "<|img_row_9_col_10|>",
3877
+ "lstrip": false,
3878
+ "normalized": false,
3879
+ "rstrip": false,
3880
+ "single_word": false,
3881
+ "special": true
3882
+ },
3883
+ "487": {
3884
+ "content": "<|img_row_10_col_1|>",
3885
+ "lstrip": false,
3886
+ "normalized": false,
3887
+ "rstrip": false,
3888
+ "single_word": false,
3889
+ "special": true
3890
+ },
3891
+ "488": {
3892
+ "content": "<|img_row_10_col_2|>",
3893
+ "lstrip": false,
3894
+ "normalized": false,
3895
+ "rstrip": false,
3896
+ "single_word": false,
3897
+ "special": true
3898
+ },
3899
+ "489": {
3900
+ "content": "<|img_row_10_col_3|>",
3901
+ "lstrip": false,
3902
+ "normalized": false,
3903
+ "rstrip": false,
3904
+ "single_word": false,
3905
+ "special": true
3906
+ },
3907
+ "490": {
3908
+ "content": "<|img_row_10_col_4|>",
3909
+ "lstrip": false,
3910
+ "normalized": false,
3911
+ "rstrip": false,
3912
+ "single_word": false,
3913
+ "special": true
3914
+ },
3915
+ "491": {
3916
+ "content": "<|img_row_10_col_5|>",
3917
+ "lstrip": false,
3918
+ "normalized": false,
3919
+ "rstrip": false,
3920
+ "single_word": false,
3921
+ "special": true
3922
+ },
3923
+ "492": {
3924
+ "content": "<|img_row_10_col_6|>",
3925
+ "lstrip": false,
3926
+ "normalized": false,
3927
+ "rstrip": false,
3928
+ "single_word": false,
3929
+ "special": true
3930
+ },
3931
+ "493": {
3932
+ "content": "<|img_row_10_col_7|>",
3933
+ "lstrip": false,
3934
+ "normalized": false,
3935
+ "rstrip": false,
3936
+ "single_word": false,
3937
+ "special": true
3938
+ },
3939
+ "494": {
3940
+ "content": "<|img_row_10_col_8|>",
3941
+ "lstrip": false,
3942
+ "normalized": false,
3943
+ "rstrip": false,
3944
+ "single_word": false,
3945
+ "special": true
3946
+ },
3947
+ "495": {
3948
+ "content": "<|img_row_10_col_9|>",
3949
+ "lstrip": false,
3950
+ "normalized": false,
3951
+ "rstrip": false,
3952
+ "single_word": false,
3953
+ "special": true
3954
+ },
3955
+ "496": {
3956
+ "content": "<|img_row_10_col_10|>",
3957
+ "lstrip": false,
3958
+ "normalized": false,
3959
+ "rstrip": false,
3960
+ "single_word": false,
3961
+ "special": true
3962
+ },
3963
+ "497": {
3964
+ "content": "<|img_thumbnail|>",
3965
+ "lstrip": false,
3966
+ "normalized": false,
3967
+ "rstrip": false,
3968
+ "single_word": false,
3969
+ "special": true
3970
+ },
3971
+ "498": {
3972
+ "content": "<|image_start|>",
3973
+ "lstrip": false,
3974
+ "normalized": false,
3975
+ "rstrip": false,
3976
+ "single_word": false,
3977
+ "special": true
3978
+ },
3979
+ "499": {
3980
+ "content": "<|image_end|>",
3981
+ "lstrip": false,
3982
+ "normalized": false,
3983
+ "rstrip": false,
3984
+ "single_word": false,
3985
+ "special": true
3986
+ },
3987
+ "500": {
3988
+ "content": "<|image_split|>",
3989
+ "lstrip": false,
3990
+ "normalized": false,
3991
+ "rstrip": false,
3992
+ "single_word": false,
3993
+ "special": true
3994
+ },
3995
+ "64011": {
3996
+ "content": "Mathias",
3997
+ "lstrip": false,
3998
+ "normalized": true,
3999
+ "rstrip": false,
4000
+ "single_word": false,
4001
+ "special": true
4002
+ },
4003
+ "64014": {
4004
+ "content": "python",
4005
+ "lstrip": false,
4006
+ "normalized": true,
4007
+ "rstrip": false,
4008
+ "single_word": false,
4009
+ "special": true
4010
+ },
4011
+ "64394": {
4012
+ "content": "<|cot_start|>",
4013
+ "lstrip": false,
4014
+ "normalized": false,
4015
+ "rstrip": false,
4016
+ "single_word": false,
4017
+ "special": true
4018
+ },
4019
+ "64395": {
4020
+ "content": "<|cot_end|>",
4021
+ "lstrip": false,
4022
+ "normalized": false,
4023
+ "rstrip": false,
4024
+ "single_word": false,
4025
+ "special": true
4026
+ },
4027
+ "64396": {
4028
+ "content": "<|review_start|>",
4029
+ "lstrip": false,
4030
+ "normalized": false,
4031
+ "rstrip": false,
4032
+ "single_word": false,
4033
+ "special": true
4034
+ },
4035
+ "64397": {
4036
+ "content": "<|review_end|>",
4037
+ "lstrip": false,
4038
+ "normalized": false,
4039
+ "rstrip": false,
4040
+ "single_word": false,
4041
+ "special": true
4042
+ },
4043
+ "64398": {
4044
+ "content": "<|file_start|>",
4045
+ "lstrip": false,
4046
+ "normalized": false,
4047
+ "rstrip": false,
4048
+ "single_word": false,
4049
+ "special": true
4050
+ },
4051
+ "64399": {
4052
+ "content": "<|file_end|>",
4053
+ "lstrip": false,
4054
+ "normalized": false,
4055
+ "rstrip": false,
4056
+ "single_word": false,
4057
+ "special": true
4058
+ },
4059
+ "64400": {
4060
+ "content": "<think>",
4061
+ "lstrip": false,
4062
+ "normalized": false,
4063
+ "rstrip": false,
4064
+ "single_word": false,
4065
+ "special": true
4066
+ },
4067
+ "64401": {
4068
+ "content": "</think>",
4069
+ "lstrip": false,
4070
+ "normalized": false,
4071
+ "rstrip": false,
4072
+ "single_word": false,
4073
+ "special": true
4074
+ }
4075
+ },
4076
+ "bos_token": "<|startoftext|>",
4077
+ "chat_template_file": "chat_template.jinja",
4078
+ "clean_up_tokenization_spaces": false,
4079
+ "eos_token": "<|im_end|>",
4080
+ "extra_special_tokens": {},
4081
+ "model_input_names": [
4082
+ "input_ids",
4083
+ "attention_mask"
4084
+ ],
4085
+ "model_max_length": 32768,
4086
+ "pad_token": "<|pad|>",
4087
+ "spaces_between_special_tokens": false,
4088
+ "tokenizer_class": "PreTrainedTokenizerFast",
4089
+ "use_default_system_prompt": false,
4090
+ "use_fast": true
4091
+ }