leonardlin commited on
Commit
e4e8a1d
·
verified ·
1 Parent(s): c46e865

Upload FP8_BLOCK quantized Ornith 35B

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/ornith_35b_eval.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/ornith_397b_eval.png filter=lfs diff=lfs merge=lfs -text
38
+ assets/ornith_logo.png filter=lfs diff=lfs merge=lfs -text
39
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,155 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ license_link: https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B/blob/main/LICENSE
5
+ pipeline_tag: text-generation
6
+ base_model: deepreinforce-ai/Ornith-1.0-35B
7
+ base_model_relation: quantized
8
+ tags:
9
+ - fp8
10
+ - fp8-block
11
+ - compressed-tensors
12
+ - llm-compressor
13
+ - qwen3.5
14
+ - moe
15
+ - code
16
+ - reasoning
17
+ ---
18
+
19
+ <img width="600px" src="assets/ornith_logo.png">
20
+
21
+ # Ornith-1.0-35B-FP8-BLOCK
22
+
23
+ This repository contains a public `FP8_BLOCK` / `compressed-tensors`
24
+ quantization of [`deepreinforce-ai/Ornith-1.0-35B`](https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B).
25
+
26
+ The original model is Ornith-1.0-35B, a Qwen3.5 MoE-family reasoning and
27
+ agentic coding model released by DeepReinforce. This repository only changes
28
+ the checkpoint representation; it does not introduce additional fine-tuning.
29
+
30
+ ## Quantization Summary
31
+
32
+ - Source model: [`deepreinforce-ai/Ornith-1.0-35B`](https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B)
33
+ - Quantized model: `shisa-ai/Ornith-1.0-35B-FP8-BLOCK`
34
+ - Quantization tool: `llm-compressor` model-free PTQ
35
+ - Quantization format: `compressed-tensors`
36
+ - Scheme: `FP8_BLOCK`
37
+ - Calibration data: none; this is data-free/model-free PTQ
38
+ - Weight quantization: static FP8, symmetric, block strategy, `128x128` blocks
39
+ - Activation quantization: dynamic FP8, symmetric, group strategy, group size `128`
40
+ - Target modules: `Linear`
41
+ - `compressed-tensors` metadata version recorded in `config.json`: `0.15.1.a20260406`
42
+
43
+ The local quantization environment used for this artifact reported:
44
+
45
+ - `llmcompressor=0.10.1.dev67+ga1cec6fa`
46
+ - `compressed-tensors=0.15.1a20260406`
47
+ - `transformers=5.5.0`
48
+
49
+ The definitive machine-readable quantization metadata is in
50
+ [`config.json`](config.json).
51
+
52
+ ## Unquantized / Ignored Paths
53
+
54
+ The quantization run intentionally skipped the following module patterns:
55
+
56
+ ```text
57
+ re:.*lm_head$
58
+ re:.*embed_tokens$
59
+ re:.*visual.*
60
+ re:.*mlp\.gate$
61
+ re:.*mlp\.shared_expert_gate$
62
+ re:.*linear_attn.*
63
+ re:^mtp.*
64
+ ```
65
+
66
+ Practical implications:
67
+
68
+ - `lm_head` and token embeddings remain unquantized.
69
+ - MoE router/gating paths remain unquantized.
70
+ - Qwen3.5 linear-attention/Gated-DeltaNet paths remain unquantized.
71
+ - Vision tower weights remain unquantized in this artifact.
72
+ - No MTP tensors were present in the source checkpoint used here, so this model
73
+ card does not advertise MTP/speculative decoding support.
74
+
75
+ ## Example Usage
76
+
77
+ Use a recent runtime that supports both `Qwen3_5MoeForConditionalGeneration`
78
+ and `compressed-tensors` `FP8_BLOCK` checkpoints.
79
+
80
+ ### vLLM
81
+
82
+ ```bash
83
+ vllm serve shisa-ai/Ornith-1.0-35B-FP8-BLOCK \
84
+ --served-model-name Ornith-1.0-35B-FP8-BLOCK \
85
+ --tensor-parallel-size 8 \
86
+ --host 0.0.0.0 \
87
+ --port 8000 \
88
+ --max-model-len 262144 \
89
+ --gpu-memory-utilization 0.90 \
90
+ --enable-prefix-caching \
91
+ --enable-auto-tool-choice \
92
+ --tool-call-parser qwen3_xml \
93
+ --reasoning-parser qwen3 \
94
+ --trust-remote-code
95
+ ```
96
+
97
+ Adjust `--tensor-parallel-size`, `--max-model-len`, and memory settings for your
98
+ hardware. Long-context serving still requires substantial KV-cache memory even
99
+ though the checkpoint weights are compressed.
100
+
101
+ ### OpenAI-Compatible Client
102
+
103
+ ```python
104
+ from openai import OpenAI
105
+
106
+ client = OpenAI(
107
+ base_url="http://localhost:8000/v1",
108
+ api_key="EMPTY",
109
+ )
110
+
111
+ response = client.chat.completions.create(
112
+ model="Ornith-1.0-35B-FP8-BLOCK",
113
+ messages=[
114
+ {"role": "user", "content": "Write a Python function is_prime(n). Keep it short."}
115
+ ],
116
+ temperature=0.6,
117
+ top_p=0.95,
118
+ max_tokens=1024,
119
+ )
120
+
121
+ message = response.choices[0].message
122
+ print("reasoning:", getattr(message, "reasoning_content", None))
123
+ print("answer:", message.content)
124
+ ```
125
+
126
+ Ornith is a reasoning model. With vLLM's `--reasoning-parser qwen3`, reasoning
127
+ tokens are surfaced separately as `reasoning_content`; final answers remain in
128
+ `content`.
129
+
130
+ ## Quality and Performance Notes
131
+
132
+ This upload documents the quantized checkpoint format and provenance. It does
133
+ not publish a new retained benchmark table for the quantized model. For
134
+ production use, validate quality and end-to-end serving latency against the
135
+ BF16 source model on your target workload and runtime.
136
+
137
+ For original source-model capabilities, benchmark descriptions, and training
138
+ context, see the upstream card:
139
+ [`deepreinforce-ai/Ornith-1.0-35B`](https://huggingface.co/deepreinforce-ai/Ornith-1.0-35B).
140
+
141
+ ## License and Attribution
142
+
143
+ The source model is MIT licensed. This derivative quantized artifact keeps the
144
+ source license metadata and links to the upstream license file.
145
+
146
+ If you use the source model, cite the original Ornith release:
147
+
148
+ ```bibtex
149
+ @misc{ornith-35b,
150
+ title = {{Ornith-1.0-35B}: Agentic Coding, Open to All},
151
+ url = {https://deep-reinforce.com/ornith_1_0.html},
152
+ author = {{DeepReinforce Team}},
153
+ year = {2026}
154
+ }
155
+ ```
assets/ornith_35b_eval.png ADDED

Git LFS Details

  • SHA256: 03a8648a556a133104b78d54ef090a2facb08cf36e207ceb4b919ecd2389f68b
  • Pointer size: 131 Bytes
  • Size of remote file: 595 kB
assets/ornith_logo.png ADDED

Git LFS Details

  • SHA256: 458ee0d85baea4d1fc0b099245f243b21006f696921f896a5b59980a6eadef6a
  • Pointer size: 131 Bytes
  • Size of remote file: 962 kB
chat_template.jinja ADDED
@@ -0,0 +1,150 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- set image_count = namespace(value=0) %}
2
+ {%- set video_count = namespace(value=0) %}
3
+ {%- macro render_content(content, do_vision_count, is_system_content=false) %}
4
+ {%- if content is string %}
5
+ {{- content }}
6
+ {%- elif content is iterable and content is not mapping %}
7
+ {%- for item in content %}
8
+ {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
9
+ {%- if is_system_content %}
10
+ {{- raise_exception('System message cannot contain images.') }}
11
+ {%- endif %}
12
+ {%- if do_vision_count %}
13
+ {%- set image_count.value = image_count.value + 1 %}
14
+ {%- endif %}
15
+ {%- if add_vision_id %}
16
+ {{- 'Picture ' ~ image_count.value ~ ': ' }}
17
+ {%- endif %}
18
+ {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
19
+ {%- elif 'video' in item or item.type == 'video' %}
20
+ {%- if is_system_content %}
21
+ {{- raise_exception('System message cannot contain videos.') }}
22
+ {%- endif %}
23
+ {%- if do_vision_count %}
24
+ {%- set video_count.value = video_count.value + 1 %}
25
+ {%- endif %}
26
+ {%- if add_vision_id %}
27
+ {{- 'Video ' ~ video_count.value ~ ': ' }}
28
+ {%- endif %}
29
+ {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
30
+ {%- elif 'text' in item %}
31
+ {{- item.text }}
32
+ {%- else %}
33
+ {{- raise_exception('Unexpected item type in content.') }}
34
+ {%- endif %}
35
+ {%- endfor %}
36
+ {%- elif content is none or content is undefined %}
37
+ {{- '' }}
38
+ {%- else %}
39
+ {{- raise_exception('Unexpected content type.') }}
40
+ {%- endif %}
41
+ {%- endmacro %}
42
+ {%- if not messages %}
43
+ {{- raise_exception('No messages provided.') }}
44
+ {%- endif %}
45
+ {%- if tools and tools is iterable and tools is not mapping %}
46
+ {{- '<|im_start|>system\n' }}
47
+ {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
48
+ {%- for tool in tools %}
49
+ {{- "\n" }}
50
+ {{- tool | tojson }}
51
+ {%- endfor %}
52
+ {{- "\n</tools>" }}
53
+ {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
54
+ {%- if messages[0].role == 'system' %}
55
+ {%- set content = render_content(messages[0].content, false, true)|trim %}
56
+ {%- if content %}
57
+ {{- '\n\n' + content }}
58
+ {%- endif %}
59
+ {%- endif %}
60
+ {{- '<|im_end|>\n' }}
61
+ {%- else %}
62
+ {%- if messages[0].role == 'system' %}
63
+ {%- set content = render_content(messages[0].content, false, true)|trim %}
64
+ {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
65
+ {%- endif %}
66
+ {%- endif %}
67
+ {%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
68
+ {%- for message in messages[::-1] %}
69
+ {%- set index = (messages|length - 1) - loop.index0 %}
70
+ {%- if ns.multi_step_tool and message.role == "user" %}
71
+ {%- set content = render_content(message.content, false)|trim %}
72
+ {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
73
+ {%- set ns.multi_step_tool = false %}
74
+ {%- set ns.last_query_index = index %}
75
+ {%- endif %}
76
+ {%- endif %}
77
+ {%- endfor %}
78
+ {%- if ns.multi_step_tool %}
79
+ {{- raise_exception('No user query found in messages.') }}
80
+ {%- endif %}
81
+ {%- for message in messages %}
82
+ {%- set content = render_content(message.content, true)|trim %}
83
+ {%- if message.role == "system" %}
84
+ {%- if not loop.first %}
85
+ {{- raise_exception('System message must be at the beginning.') }}
86
+ {%- endif %}
87
+ {%- elif message.role == "user" %}
88
+ {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
89
+ {%- elif message.role == "assistant" %}
90
+ {%- set reasoning_content = '' %}
91
+ {%- if message.reasoning_content is string %}
92
+ {%- set reasoning_content = message.reasoning_content %}
93
+ {%- else %}
94
+ {%- if '</think>' in content %}
95
+ {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
96
+ {%- set content = content.split('</think>')[-1].lstrip('\n') %}
97
+ {%- endif %}
98
+ {%- endif %}
99
+ {%- set reasoning_content = reasoning_content|trim %}
100
+ {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
101
+ {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
102
+ {%- for tool_call in message.tool_calls %}
103
+ {%- if tool_call.function is defined %}
104
+ {%- set tool_call = tool_call.function %}
105
+ {%- endif %}
106
+ {%- if loop.first %}
107
+ {%- if content|trim %}
108
+ {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
109
+ {%- else %}
110
+ {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
111
+ {%- endif %}
112
+ {%- else %}
113
+ {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
114
+ {%- endif %}
115
+ {%- if tool_call.arguments is defined %}
116
+ {%- for args_name, args_value in tool_call.arguments|items %}
117
+ {{- '<parameter=' + args_name + '>\n' }}
118
+ {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}
119
+ {{- args_value }}
120
+ {{- '\n</parameter>\n' }}
121
+ {%- endfor %}
122
+ {%- endif %}
123
+ {{- '</function>\n</tool_call>' }}
124
+ {%- endfor %}
125
+ {%- endif %}
126
+ {{- '<|im_end|>\n' }}
127
+ {%- elif message.role == "tool" %}
128
+ {%- if loop.previtem and loop.previtem.role != "tool" %}
129
+ {{- '<|im_start|>user' }}
130
+ {%- endif %}
131
+ {{- '\n<tool_response>\n' }}
132
+ {{- content }}
133
+ {{- '\n</tool_response>' }}
134
+ {%- if not loop.last and loop.nextitem.role != "tool" %}
135
+ {{- '<|im_end|>\n' }}
136
+ {%- elif loop.last %}
137
+ {{- '<|im_end|>\n' }}
138
+ {%- endif %}
139
+ {%- else %}
140
+ {{- raise_exception('Unexpected message role.') }}
141
+ {%- endif %}
142
+ {%- endfor %}
143
+ {%- if add_generation_prompt %}
144
+ {{- '<|im_start|>assistant\n' }}
145
+ {%- if enable_thinking is defined and enable_thinking is false %}
146
+ {{- '<think>\n\n</think>\n\n' }}
147
+ {%- else %}
148
+ {{- '<think>\n' }}
149
+ {%- endif %}
150
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,184 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3_5MoeForConditionalGeneration"
4
+ ],
5
+ "bos_token_id": null,
6
+ "dtype": "bfloat16",
7
+ "eos_token_id": 248046,
8
+ "hidden_size": 2048,
9
+ "image_token_id": 248056,
10
+ "model_type": "qwen3_5_moe",
11
+ "pad_token_id": 248044,
12
+ "quantization_config": {
13
+ "config_groups": {
14
+ "FP8_BLOCK": {
15
+ "format": "float-quantized",
16
+ "input_activations": {
17
+ "actorder": null,
18
+ "block_structure": null,
19
+ "dynamic": true,
20
+ "group_size": 128,
21
+ "num_bits": 8,
22
+ "observer": null,
23
+ "observer_kwargs": {},
24
+ "scale_dtype": null,
25
+ "strategy": "group",
26
+ "symmetric": true,
27
+ "type": "float",
28
+ "zp_dtype": null
29
+ },
30
+ "output_activations": null,
31
+ "targets": [
32
+ "Linear"
33
+ ],
34
+ "weights": {
35
+ "actorder": null,
36
+ "block_structure": [
37
+ 128,
38
+ 128
39
+ ],
40
+ "dynamic": false,
41
+ "group_size": null,
42
+ "num_bits": 8,
43
+ "observer": "memoryless_minmax",
44
+ "observer_kwargs": {},
45
+ "scale_dtype": null,
46
+ "strategy": "block",
47
+ "symmetric": true,
48
+ "type": "float",
49
+ "zp_dtype": null
50
+ }
51
+ }
52
+ },
53
+ "format": "float-quantized",
54
+ "global_compression_ratio": null,
55
+ "ignore": [
56
+ "re:.*lm_head$",
57
+ "re:.*embed_tokens$",
58
+ "re:.*visual.*",
59
+ "re:.*mlp\\.gate$",
60
+ "re:.*mlp\\.shared_expert_gate$",
61
+ "re:.*linear_attn.*",
62
+ "re:^mtp.*"
63
+ ],
64
+ "kv_cache_scheme": null,
65
+ "quant_method": "compressed-tensors",
66
+ "quantization_status": "compressed",
67
+ "transform_config": {},
68
+ "version": "0.15.1.a20260406"
69
+ },
70
+ "text_config": {
71
+ "attention_bias": false,
72
+ "attention_dropout": 0.0,
73
+ "attn_output_gate": true,
74
+ "bos_token_id": 248044,
75
+ "dtype": "bfloat16",
76
+ "eos_token_id": 248044,
77
+ "full_attention_interval": 4,
78
+ "head_dim": 256,
79
+ "hidden_act": "silu",
80
+ "hidden_size": 2048,
81
+ "initializer_range": 0.02,
82
+ "layer_types": [
83
+ "linear_attention",
84
+ "linear_attention",
85
+ "linear_attention",
86
+ "full_attention",
87
+ "linear_attention",
88
+ "linear_attention",
89
+ "linear_attention",
90
+ "full_attention",
91
+ "linear_attention",
92
+ "linear_attention",
93
+ "linear_attention",
94
+ "full_attention",
95
+ "linear_attention",
96
+ "linear_attention",
97
+ "linear_attention",
98
+ "full_attention",
99
+ "linear_attention",
100
+ "linear_attention",
101
+ "linear_attention",
102
+ "full_attention",
103
+ "linear_attention",
104
+ "linear_attention",
105
+ "linear_attention",
106
+ "full_attention",
107
+ "linear_attention",
108
+ "linear_attention",
109
+ "linear_attention",
110
+ "full_attention",
111
+ "linear_attention",
112
+ "linear_attention",
113
+ "linear_attention",
114
+ "full_attention",
115
+ "linear_attention",
116
+ "linear_attention",
117
+ "linear_attention",
118
+ "full_attention",
119
+ "linear_attention",
120
+ "linear_attention",
121
+ "linear_attention",
122
+ "full_attention"
123
+ ],
124
+ "linear_conv_kernel_dim": 4,
125
+ "linear_key_head_dim": 128,
126
+ "linear_num_key_heads": 16,
127
+ "linear_num_value_heads": 32,
128
+ "linear_value_head_dim": 128,
129
+ "mamba_ssm_dtype": "float32",
130
+ "max_position_embeddings": 262144,
131
+ "model_type": "qwen3_5_moe_text",
132
+ "moe_intermediate_size": 512,
133
+ "mtp_num_hidden_layers": 1,
134
+ "mtp_use_dedicated_embeddings": false,
135
+ "num_attention_heads": 16,
136
+ "num_experts": 256,
137
+ "num_experts_per_tok": 8,
138
+ "num_hidden_layers": 40,
139
+ "num_key_value_heads": 2,
140
+ "output_router_logits": false,
141
+ "pad_token_id": 248044,
142
+ "partial_rotary_factor": 0.25,
143
+ "rms_norm_eps": 1e-06,
144
+ "rope_parameters": {
145
+ "mrope_interleaved": true,
146
+ "mrope_section": [
147
+ 11,
148
+ 11,
149
+ 10
150
+ ],
151
+ "partial_rotary_factor": 0.25,
152
+ "rope_theta": 10000000,
153
+ "rope_type": "default"
154
+ },
155
+ "router_aux_loss_coef": 0.0,
156
+ "shared_expert_intermediate_size": 512,
157
+ "tie_word_embeddings": false,
158
+ "use_cache": false,
159
+ "vocab_size": 248320
160
+ },
161
+ "tie_word_embeddings": false,
162
+ "transformers_version": "5.8.1",
163
+ "use_cache": false,
164
+ "video_token_id": 248057,
165
+ "vision_config": {
166
+ "deepstack_visual_indexes": [],
167
+ "depth": 27,
168
+ "dtype": "bfloat16",
169
+ "hidden_act": "gelu_pytorch_tanh",
170
+ "hidden_size": 1152,
171
+ "in_channels": 3,
172
+ "initializer_range": 0.02,
173
+ "intermediate_size": 4304,
174
+ "model_type": "qwen3_5_moe_vision",
175
+ "num_heads": 16,
176
+ "num_position_embeddings": 2304,
177
+ "out_hidden_size": 2048,
178
+ "patch_size": 16,
179
+ "spatial_merge_size": 2,
180
+ "temporal_patch_size": 2
181
+ },
182
+ "vision_end_token_id": 248054,
183
+ "vision_start_token_id": 248053
184
+ }
generation_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 248044,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 248046,
6
+ 248044
7
+ ],
8
+ "pad_token_id": 248044,
9
+ "temperature": 1.0,
10
+ "top_k": 20,
11
+ "top_p": 0.95,
12
+ "transformers_version": "5.8.1"
13
+ }
model-00001-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6acc6ee4849edd4144463fdc4af79ef44806508061ee4235cd3686829843997
3
+ size 3247489288
model-00002-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:225dc3ac6d6a2a49c522e9964f896ca4106282fc7e2b0077ff7ffde7f5550d13
3
+ size 2323081312
model-00003-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f99e18083610d798ae8e954e44cbf98f6ed56863f77842a60b43a79d7b8ebbb
3
+ size 2564352640
model-00004-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab5b34d6ecedaa09554598718b5f0def2401a5a14ec7e6955a6724d99d94b339
3
+ size 2050333072
model-00005-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce1dfff8f0b5361f5b7c4373c4a90126964d5337659d9356d198ed7707a5f51e
3
+ size 2323088704
model-00006-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2853acef01bd1fbcf925ab972888e3c8b4b00433d2c2324d0828c7adbd4f2df5
3
+ size 2564357296
model-00007-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90b2948a6e7484e4eae7395dffc70ec6dfa0b383c3513fc5f0a3d5a3ac1d1401
3
+ size 2050336704
model-00008-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:373bfacbd888b63fa7731ca9e45f9df15888ef40d2dc42be667ee54bd6213ff3
3
+ size 2323085472
model-00009-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3984e7317bb31ba9dc8f716696f533847ece00ba59eb5a8749fb531f3205a59
3
+ size 2564357296
model-00010-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a18765cf02a02d22a3f0eb646b485810c79f80ed8ff40e75fdd7a9359bd681f2
3
+ size 2050336704
model-00011-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f78937cc1446ccdb4d8936add82c5d0766a203837d39eb351c856fbb19a7b7e3
3
+ size 2323085472
model-00012-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1913e8003d0989325096afdc492b7b57b76216cbf00fae74d5c00f60e3b4f382
3
+ size 2564357296
model-00013-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:583b508b8b3bf012b1fa1e27b8e32b9e85dac36e278a85ad5c4a18eaaaa28c9d
3
+ size 2050336704
model-00014-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e27f78fc0e8e97a3b75d6b7d5f3c2fa07027aed9900dbce27cd6a197430ee478
3
+ size 2323085472
model-00015-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7a8bcbbc3c916063f63f627752ac69e72a0469a3552af4ed72f7d2e33a3b991
3
+ size 2564357296
model-00016-of-00016.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54ce9cc09bbff21d75ddbec413be4452bf4e32ba02427e99e96ceaff8e505aa0
3
+ size 1730271792
model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff
 
preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 16777216,
4
+ "shortest_edge": 65536
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "image_processor_type": "Qwen2VLImageProcessorFast"
21
+ }
processor_config.json ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "image_processor": {
3
+ "do_convert_rgb": true,
4
+ "do_normalize": true,
5
+ "do_rescale": true,
6
+ "do_resize": true,
7
+ "image_mean": [
8
+ 0.5,
9
+ 0.5,
10
+ 0.5
11
+ ],
12
+ "image_processor_type": "Qwen2VLImageProcessor",
13
+ "image_std": [
14
+ 0.5,
15
+ 0.5,
16
+ 0.5
17
+ ],
18
+ "merge_size": 2,
19
+ "patch_size": 16,
20
+ "resample": 3,
21
+ "rescale_factor": 0.00392156862745098,
22
+ "size": {
23
+ "longest_edge": 16777216,
24
+ "shortest_edge": 65536
25
+ },
26
+ "temporal_patch_size": 2
27
+ },
28
+ "processor_class": "Qwen3VLProcessor",
29
+ "video_processor": {
30
+ "do_convert_rgb": true,
31
+ "do_normalize": true,
32
+ "do_rescale": true,
33
+ "do_resize": true,
34
+ "do_sample_frames": true,
35
+ "fps": 2,
36
+ "image_mean": [
37
+ 0.5,
38
+ 0.5,
39
+ 0.5
40
+ ],
41
+ "image_std": [
42
+ 0.5,
43
+ 0.5,
44
+ 0.5
45
+ ],
46
+ "max_frames": 768,
47
+ "merge_size": 2,
48
+ "min_frames": 4,
49
+ "patch_size": 16,
50
+ "resample": 3,
51
+ "rescale_factor": 0.00392156862745098,
52
+ "return_metadata": false,
53
+ "size": {
54
+ "longest_edge": 25165824,
55
+ "shortest_edge": 4096
56
+ },
57
+ "temporal_patch_size": 2,
58
+ "video_processor_type": "Qwen3VLVideoProcessor"
59
+ }
60
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523
3
+ size 19989325
tokenizer_config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "audio_bos_token": "<|audio_start|>",
4
+ "audio_eos_token": "<|audio_end|>",
5
+ "audio_token": "<|audio_pad|>",
6
+ "backend": "tokenizers",
7
+ "bos_token": null,
8
+ "clean_up_tokenization_spaces": false,
9
+ "eos_token": "<|im_end|>",
10
+ "errors": "replace",
11
+ "image_token": "<|image_pad|>",
12
+ "is_local": true,
13
+ "local_files_only": false,
14
+ "model_max_length": 262144,
15
+ "model_specific_special_tokens": {
16
+ "audio_bos_token": "<|audio_start|>",
17
+ "audio_eos_token": "<|audio_end|>",
18
+ "audio_token": "<|audio_pad|>",
19
+ "image_token": "<|image_pad|>",
20
+ "video_token": "<|video_pad|>",
21
+ "vision_bos_token": "<|vision_start|>",
22
+ "vision_eos_token": "<|vision_end|>"
23
+ },
24
+ "pad_token": "<|endoftext|>",
25
+ "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
26
+ "processor_class": "Qwen3VLProcessor",
27
+ "split_special_tokens": false,
28
+ "tokenizer_class": "Qwen2Tokenizer",
29
+ "unk_token": null,
30
+ "video_token": "<|video_pad|>",
31
+ "vision_bos_token": "<|vision_start|>",
32
+ "vision_eos_token": "<|vision_end|>"
33
+ }
video_preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 25165824,
4
+ "shortest_edge": 4096
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "video_processor_type": "Qwen3VLVideoProcessor"
21
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff