Cheeeeeeeeky mikasenghaas commited on
Commit
cbd5fb0
·
verified ·
0 Parent(s):

Duplicate from PrimeIntellect/INTELLECT-3

Browse files

Co-authored-by: Mika Senghaas <mikasenghaas@users.noreply.huggingface.co>

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +39 -0
  2. README.md +99 -0
  3. banner.png +0 -0
  4. bench.png +3 -0
  5. chat_template.jinja +137 -0
  6. config.json +48 -0
  7. generation_config.json +11 -0
  8. model-00001-of-00048.safetensors +3 -0
  9. model-00002-of-00048.safetensors +3 -0
  10. model-00003-of-00048.safetensors +3 -0
  11. model-00004-of-00048.safetensors +3 -0
  12. model-00005-of-00048.safetensors +3 -0
  13. model-00006-of-00048.safetensors +3 -0
  14. model-00007-of-00048.safetensors +3 -0
  15. model-00008-of-00048.safetensors +3 -0
  16. model-00009-of-00048.safetensors +3 -0
  17. model-00010-of-00048.safetensors +3 -0
  18. model-00011-of-00048.safetensors +3 -0
  19. model-00012-of-00048.safetensors +3 -0
  20. model-00013-of-00048.safetensors +3 -0
  21. model-00014-of-00048.safetensors +3 -0
  22. model-00015-of-00048.safetensors +3 -0
  23. model-00016-of-00048.safetensors +3 -0
  24. model-00017-of-00048.safetensors +3 -0
  25. model-00018-of-00048.safetensors +3 -0
  26. model-00019-of-00048.safetensors +3 -0
  27. model-00020-of-00048.safetensors +3 -0
  28. model-00021-of-00048.safetensors +3 -0
  29. model-00022-of-00048.safetensors +3 -0
  30. model-00023-of-00048.safetensors +3 -0
  31. model-00024-of-00048.safetensors +3 -0
  32. model-00025-of-00048.safetensors +3 -0
  33. model-00026-of-00048.safetensors +3 -0
  34. model-00027-of-00048.safetensors +3 -0
  35. model-00028-of-00048.safetensors +3 -0
  36. model-00029-of-00048.safetensors +3 -0
  37. model-00030-of-00048.safetensors +3 -0
  38. model-00031-of-00048.safetensors +3 -0
  39. model-00032-of-00048.safetensors +3 -0
  40. model-00033-of-00048.safetensors +3 -0
  41. model-00034-of-00048.safetensors +3 -0
  42. model-00035-of-00048.safetensors +3 -0
  43. model-00036-of-00048.safetensors +3 -0
  44. model-00037-of-00048.safetensors +3 -0
  45. model-00038-of-00048.safetensors +3 -0
  46. model-00039-of-00048.safetensors +3 -0
  47. model-00040-of-00048.safetensors +3 -0
  48. model-00041-of-00048.safetensors +3 -0
  49. model-00042-of-00048.safetensors +3 -0
  50. model-00043-of-00048.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ temp_bench.png filter=lfs diff=lfs merge=lfs -text
38
+ pi_logo.png filter=lfs diff=lfs merge=lfs -text
39
+ bench.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - prime-rl
5
+ - verifiers
6
+ - prime-intellect
7
+ - reinforcement-learning
8
+ - reasoning
9
+ - agentic
10
+ - mixture-of-experts
11
+ license: mit
12
+ language:
13
+ - en
14
+ base_model:
15
+ - zai-org/GLM-4.5-Air-Base
16
+ pipeline_tag: text-generation
17
+ ---
18
+
19
+ # INTELLECT-3
20
+
21
+ <div align="center">
22
+ <img src="banner.png" alt="Prime Intellect Logo" />
23
+ </div>
24
+
25
+ <p align="center">
26
+ <strong>INTELLECT-3: A 100B+ MoE trained with large-scale RL</strong>
27
+ <br><br>
28
+ Trained with <a href="https://github.com/PrimeIntellect-ai/prime-rl">prime-rl</a> and <a href="https://github.com/PrimeIntellect-ai/verifiers">verifiers</a>
29
+ <br>
30
+ Environments released on <a href="https://app.primeintellect.ai/dashboard/environments">Environments Hub</a>
31
+ <br>
32
+ Read the <a href="https://primeintellect.ai/blog/intellect-3">Blog</a> & <a href="https://storage.googleapis.com/intellect-3-paper/INTELLECT_3_Technical_Report.pdf">Technical Report</a>
33
+ <br>
34
+ <a href="https://x.com/primeintellect">X</a> | <a href="https://discord.gg/RC5GvMbfDf">Discord</a> | <a href="https://app.primeintellect.ai/dashboard/create-cluster">Prime Intellect Platform</a>
35
+ </p>
36
+
37
+ ## Introduction
38
+
39
+ **INTELLECT-3** is a 106B (A12B) parameter Mixture-of-Experts reasoning model post-trained from [GLM-4.5-Air-Base](https://huggingface.co/zai-org/GLM-4.5-Air-Base) using supervised fine-tuning (SFT) followed by large-scale reinforcement learning (RL).
40
+
41
+ ![bench](bench.png)
42
+
43
+ Training was performed with [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) using environments built with the [verifiers](https://github.com/PrimeIntellect-ai/verifiers) library.
44
+ All training and evaluation environments are available on the [Environments Hub](https://app.primeintellect.ai/dashboard/environments).
45
+
46
+ The model, training frameworks, and environments are open-sourced under fully-permissive licenses (MIT and Apache 2.0).
47
+
48
+ For more details, see the [technical report](https://storage.googleapis.com/intellect-3-paper/INTELLECT_3_Technical_Report.pdf).
49
+
50
+ ## Evaluation
51
+
52
+ INTELLECT-3 achieves best-in-class performance on math, coding, and reasoning benchmarks:
53
+
54
+ | Benchmark | MATH-500 | AIME24 | AIME25 | LCB | GPQA | HLE | MMLU-Pro |
55
+ |-----------|----------|---------|---------|--------|------|-----|----------|
56
+ | INTELLECT-3 | **98.1** | **90.8** | **88.0** | 69.3 | 74.4 | 14.6 | 81.9 |
57
+ | GLM-4.5-Air | 97.8 | 84.6 | 82.0 | 61.5 | 73.3 | 13.3 | 73.9 |
58
+ | GLM-4.5 | 97.0 | 85.8 | 83.3 | 64.5 | 77.0 | 14.8 | 83.5 |
59
+ | DeepSeek R1 0528 | 87.3 | 83.2 | 73.4 | 62.5 | 77.5 | 15.9 | 75.3 |
60
+ | DeepSeek v3.2 | 96.8 | 88.1 | 84.7 | **71.6** | **81.4** | **17.9** | **84.6** |
61
+ | GPT-O5S 120B | 96.0 | 75.8 | 77.7 | 69.9 | 70.0 | 10.6 | 67.1 |
62
+
63
+ ## Model Variants
64
+
65
+ | Model | HuggingFace |
66
+ |-------|-------------|
67
+ | INTELLECT-3 | [PrimeIntellect/INTELLECT-3](https://huggingface.co/PrimeIntellect/INTELLECT-3) |
68
+ | INTELLECT-3-FP8 | [PrimeIntellect/INTELLECT-3-FP8](https://huggingface.co/PrimeIntellect/INTELLECT-3-FP8) |
69
+
70
+ ## Serving with vLLM
71
+
72
+ The BF16 version can be served on 2x H200s:
73
+ ```bash
74
+ vllm serve PrimeIntellect/INTELLECT-3 \
75
+ --tensor-parallel-size 2 \
76
+ --enable-auto-tool-choice \
77
+ --tool-call-parser qwen3_coder \
78
+ --reasoning-parser deepseek_r1
79
+ ```
80
+
81
+ The FP8 version can be served on a single H200:
82
+
83
+ ```bash
84
+ vllm serve PrimeIntellect/INTELLECT-3-FP8 \
85
+ --enable-auto-tool-choice \
86
+ --tool-call-parser qwen3_coder \
87
+ --reasoning-parser deepseek_r1
88
+ ```
89
+
90
+ ## Citation
91
+
92
+ ```bibtex
93
+ @misc{intellect3,
94
+ title={INTELLECT-3: Technical Report},
95
+ author={Prime Intellect Team},
96
+ year={2025},
97
+ url={https://huggingface.co/PrimeIntellect/INTELLECT-3}
98
+ }
99
+ ```
banner.png ADDED
bench.png ADDED

Git LFS Details

  • SHA256: 3d4591c042718f53ceb6faf912684f8f219d9a263b2f15208043ea0bf2273f54
  • Pointer size: 131 Bytes
  • Size of remote file: 568 kB
chat_template.jinja ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {% macro render_extra_keys(json_dict, handled_keys) %}
2
+ {%- if json_dict is mapping %}
3
+ {%- for json_key in json_dict if json_key not in handled_keys %}
4
+ {%- if json_dict[json_key] is mapping or (json_dict[json_key] is sequence and json_dict[json_key] is not string) %}
5
+ {{- '\n<' ~ json_key ~ '>' ~ (json_dict[json_key] | tojson | safe) ~ '</' ~ json_key ~ '>' }}
6
+ {%- else %}
7
+ {{-'\n<' ~ json_key ~ '>' ~ (json_dict[json_key] | string) ~ '</' ~ json_key ~ '>' }}
8
+ {%- endif %}
9
+ {%- endfor %}
10
+ {%- endif %}
11
+ {% endmacro %}
12
+
13
+ {%- if messages[0]["role"] == "system" %}
14
+ {%- set system_message = messages[0]["content"] %}
15
+ {%- set loop_messages = messages[1:] %}
16
+ {%- else %}
17
+ {%- set loop_messages = messages %}
18
+ {%- endif %}
19
+
20
+ {%- if not tools is defined %}
21
+ {%- set tools = [] %}
22
+ {%- endif %}
23
+
24
+ {%- if system_message is defined %}
25
+ {{- "<|im_start|>system\n" + system_message }}
26
+ {%- else %}
27
+ {%- if tools is iterable and tools | length > 0 %}
28
+ {{- "<|im_start|>system\nYou are INTELLECT-3, a helpful assistant developed by Prime Intellect, that can interact with a computer to solve tasks." }}
29
+ {%- endif %}
30
+ {%- endif %}
31
+ {%- if tools is iterable and tools | length > 0 %}
32
+ {{- "\n\n# Tools\n\nYou have access to the following functions:\n\n" }}
33
+ {{- "<tools>" }}
34
+ {%- for tool in tools %}
35
+ {%- if tool.function is defined %}
36
+ {%- set tool = tool.function %}
37
+ {%- endif %}
38
+ {{- "\n<function>\n<name>" ~ tool.name ~ "</name>" }}
39
+ {%- if tool.description is defined %}
40
+ {{- '\n<description>' ~ (tool.description | trim) ~ '</description>' }}
41
+ {%- endif %}
42
+ {{- '\n<parameters>' }}
43
+ {%- if tool.parameters is defined and tool.parameters is mapping and tool.parameters.properties is defined and tool.parameters.properties is mapping %}
44
+ {%- for param_name, param_fields in tool.parameters.properties|items %}
45
+ {{- '\n<parameter>' }}
46
+ {{- '\n<name>' ~ param_name ~ '</name>' }}
47
+ {%- if param_fields.type is defined %}
48
+ {{- '\n<type>' ~ (param_fields.type | string) ~ '</type>' }}
49
+ {%- endif %}
50
+ {%- if param_fields.description is defined %}
51
+ {{- '\n<description>' ~ (param_fields.description | trim) ~ '</description>' }}
52
+ {%- endif %}
53
+ {%- set handled_keys = ['name', 'type', 'description'] %}
54
+ {{- render_extra_keys(param_fields, handled_keys) }}
55
+ {{- '\n</parameter>' }}
56
+ {%- endfor %}
57
+ {%- endif %}
58
+ {% set handled_keys = ['type', 'properties'] %}
59
+ {{- render_extra_keys(tool.parameters, handled_keys) }}
60
+ {{- '\n</parameters>' }}
61
+ {%- set handled_keys = ['type', 'name', 'description', 'parameters'] %}
62
+ {{- render_extra_keys(tool, handled_keys) }}
63
+ {{- '\n</function>' }}
64
+ {%- endfor %}
65
+ {{- "\n</tools>" }}
66
+ {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
67
+ {%- endif %}
68
+ {%- if system_message is defined %}
69
+ {{- '<|im_end|>\n' }}
70
+ {%- else %}
71
+ {%- if tools is iterable and tools | length > 0 %}
72
+ {{- '<|im_end|>\n' }}
73
+ {%- endif %}
74
+ {%- endif %}
75
+ {%- for message in loop_messages %}
76
+ {%- if message.role == "assistant" and message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}
77
+ {{- '<|im_start|>' + message.role }}
78
+ {%- if message.content is defined and message.content is string %}
79
+ {%- if message.reasoning_content is defined -%}
80
+ {%- if message.reasoning_content -%}
81
+ {{ '\n<think>' + message.reasoning_content.strip() + '</think>' }}
82
+ {%- else -%}
83
+ {{ '\n<think></think>' }}
84
+ {%- endif -%}
85
+ {%- endif -%}
86
+ {{- '\n' + message.content | trim + '\n' }}
87
+ {%- endif %}
88
+ {%- for tool_call in message.tool_calls %}
89
+ {%- if tool_call.function is defined %}
90
+ {%- set tool_call = tool_call.function %}
91
+ {%- endif %}
92
+ {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
93
+ {%- if tool_call.arguments is defined %}
94
+ {%- for args_name, args_value in tool_call.arguments|items %}
95
+ {{- '<parameter=' + args_name + '>\n' }}
96
+ {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
97
+ {{- args_value }}
98
+ {{- '\n</parameter>\n' }}
99
+ {%- endfor %}
100
+ {%- endif %}
101
+ {{- '</function>\n</tool_call>' }}
102
+ {%- endfor %}
103
+ {{- '<|im_end|>\n' }}
104
+ {%- elif message.role == "user" or message.role == "system" or message.role == "assistant" %}
105
+ {{- '<|im_start|>' + message.role }}
106
+ {%- if message.role == "assistant" and message.reasoning_content is defined %}
107
+ {%- if message.reasoning_content -%}
108
+ {{ '\n<think>' + message.reasoning_content.strip() + '</think>' }}
109
+ {%- else -%}
110
+ {{ '\n<think></think>' }}
111
+ {%- endif -%}
112
+ {%- if message.content.strip() -%}
113
+ {{ '\n' + message.content.strip() }}
114
+ {%- endif -%}
115
+ {%- else %}
116
+ {{- '\n' + message.content }}
117
+ {%- endif %}
118
+ {{- '<|im_end|>' + '\n' }}
119
+ {%- elif message.role == "tool" %}
120
+ {%- if loop.previtem and loop.previtem.role != "tool" %}
121
+ {{- '<|im_start|>user\n' }}
122
+ {%- endif %}
123
+ {{- '<tool_response>\n' }}
124
+ {{- message.content }}
125
+ {{- '\n</tool_response>\n' }}
126
+ {%- if not loop.last and loop.nextitem.role != "tool" %}
127
+ {{- '<|im_end|>\n' }}
128
+ {%- elif loop.last %}
129
+ {{- '<|im_end|>\n' }}
130
+ {%- endif %}
131
+ {%- else %}
132
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>\n' }}
133
+ {%- endif %}
134
+ {%- endfor %}
135
+ {%- if add_generation_prompt %}
136
+ {{- '<|im_start|>assistant\n<think>' }}
137
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Glm4MoeForCausalLM"
4
+ ],
5
+ "attention_bias": true,
6
+ "attention_dropout": 0.0,
7
+ "auto_map": {
8
+ "AutoConfig": "configuration_glm4_moe.Glm4MoeConfig",
9
+ "AutoModel": "modeling_glm4_moe.Glm4MoeModel",
10
+ "AutoModelForCausalLM": "modeling_glm4_moe.Glm4MoeForCausalLM"
11
+ },
12
+ "dtype": "bfloat16",
13
+ "eos_token_id": [
14
+ 151334,
15
+ 151329
16
+ ],
17
+ "first_k_dense_replace": 1,
18
+ "head_dim": 128,
19
+ "hidden_act": "silu",
20
+ "hidden_size": 4096,
21
+ "initializer_range": 0.02,
22
+ "intermediate_size": 10944,
23
+ "max_position_embeddings": 131072,
24
+ "model_type": "glm4_moe",
25
+ "moe_intermediate_size": 1408,
26
+ "n_group": 1,
27
+ "n_routed_experts": 128,
28
+ "n_shared_experts": 1,
29
+ "norm_topk_prob": true,
30
+ "num_attention_heads": 96,
31
+ "num_experts_per_tok": 8,
32
+ "num_hidden_layers": 46,
33
+ "num_key_value_heads": 8,
34
+ "num_nextn_predict_layers": 1,
35
+ "pad_token_id": 151329,
36
+ "partial_rotary_factor": 0.5,
37
+ "rms_norm_eps": 1e-05,
38
+ "rope_scaling": null,
39
+ "rope_theta": 1000000,
40
+ "routed_scaling_factor": 1.0,
41
+ "tie_word_embeddings": false,
42
+ "topk_group": 1,
43
+ "transformers_version": "4.56.1",
44
+ "use_cache": false,
45
+ "use_grouped_mm": true,
46
+ "use_qk_norm": false,
47
+ "vocab_size": 151552
48
+ }
generation_config.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "eos_token_id": [
4
+ 151334,
5
+ 151329
6
+ ],
7
+ "pad_token_id": 151329,
8
+ "transformers_version": "4.56.1",
9
+ "use_cache": false,
10
+ "temperature": 0.6
11
+ }
model-00001-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85a076f9017b74e5d769ef304927491841104e3b7100e4d1faba12757e4254a3
3
+ size 4900192568
model-00002-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:104dbc355f326d6a70c160e8b266c4c98109bcdd8d0eb650306bb154174dbb1f
3
+ size 4899977872
model-00003-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9debee3ea4386e6f545f074ea6e69fb2a0dc03cbbde04bdac8243ffc3e53e054
3
+ size 4498785360
model-00004-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e62b0dcb06b6aa9a98c44fb9ea9f87ac073ddb063b5834b05e8df3da27c7a0d9
3
+ size 4464885360
model-00005-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56af24055de6046d10c4fcc54b11cbe7a137f06e0a7a8c6df449d22e1d559159
3
+ size 4464885360
model-00006-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a4566a94383cb393d44d99c0d1e8b49bfd91d8bbc113efedcf95d3545fbf63c
3
+ size 4464885360
model-00007-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:432452d0f25a3fea281e94b2da22266d7cb47476d7145e9f68a6e57ec1b961ec
3
+ size 4464885360
model-00008-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5699235785308951f2d5ee479b68b933c3989b1990e6300555c837079bcab1eb
3
+ size 4464885360
model-00009-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e37ed8c418d61086b4167d0b1bbe102b5a6b7803de42142e5de55206b6946cb5
3
+ size 4464885360
model-00010-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fd30917e176ddb179156fe9a623dd21a0bfd40fe8665f65f662a88894c1bdba
3
+ size 4464885360
model-00011-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f31cc1121ac2837c129fc939d1265e6dbcb6ef6571f5fe1b00a0653ae26293b9
3
+ size 4464885360
model-00012-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:877174b821506d254da4f6cd9efcb066ebf740011c174ca91fd330fd7b786470
3
+ size 4464885496
model-00013-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e08f116251b18d83d5d1f73210055614625506b016fbfbb6f6559650e23cdad0
3
+ size 4464885752
model-00014-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b36453f057961311953e344e634acdca99e37cab58344d4de0d5534fad3687b7
3
+ size 4464885752
model-00015-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f676f394bb70ed21e6e544a1a0a342b96abf90b2bb9a8a2b7bcabdab4b15e18f
3
+ size 4464885752
model-00016-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a994d53dbc0c8587425afd114d12a13f340c65ce88c9b4c346a465de0c5821b9
3
+ size 4464885752
model-00017-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d172a36c1bcdfec32f981ea2e8dd4e5b5a74e2852b8010d1e31ed1ab8247a16c
3
+ size 4464885752
model-00018-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afba43349377a7a0c995d084673554141fd56c07ef4a38bab987d70988de12c5
3
+ size 4464885752
model-00019-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab3ebec5fc6d6247e804b138b7c66f40f75b44b307ab92abe20e3342157a253a
3
+ size 4464885752
model-00020-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a989983e8bee1a28b4eb0b7c8843fbf2f395085dac2abb699e8829d8bab2ae12
3
+ size 4464885752
model-00021-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d56bf35d7f9440abe70edecef6bd77318ffa24a668c1e7cb3ad9ca4ed882ec92
3
+ size 4464885752
model-00022-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:940e3d5a50ec3408d1b391f2c3b8d8707d59bf5eec7b81cc21b1a79c51f5d730
3
+ size 4464885752
model-00023-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:539302c591fac9e654e8ddd54dfab7f7171d6b9b5c6a1c86fa8a443b72966bd4
3
+ size 4464885752
model-00024-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a37cac3be07040a211db088dd67f007760a0ea2f7190e03268fcd070d17cda1b
3
+ size 4464885752
model-00025-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c65d7be050dfbcc4d5eea3a0c2d4387e60b14f01b8c657725f6333143b7f6bc
3
+ size 4464885752
model-00026-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21a69fbed91134bd076c25574a365f0e2d0b993c9c6d0581249871b68021e102
3
+ size 4464885752
model-00027-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de3440e7d3f97e0a4b11169c68c9eca44e508b138816c8ce5af818d809cef08a
3
+ size 4464885752
model-00028-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ee98d08c4e7519d07167c5b71fe8b8b5dc1e54825b2ae7a15c0f3d30f02878b
3
+ size 4464885752
model-00029-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d3ead910093bc8a1cdf3a92c07a628d5e62b73c87954d3900c30a265e664e55
3
+ size 4464885752
model-00030-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c44b69124d5d272313fd3e4963c31b1b436a0e944d4e0cbc30c88301db6190a
3
+ size 4464885752
model-00031-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c19568f447e969bb802da05f48fd084349127d38e7cdfcba8faf98e039820af2
3
+ size 4464885752
model-00032-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63be798cd5c51e203caba0d0aa48b1a20074101b9959510dc9015b2d9c511e28
3
+ size 4464885752
model-00033-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:146841938816268e56d07d087b9ee6311be09d55860266655059edb1d7a654c7
3
+ size 4464885752
model-00034-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:296a784a6582c6166b1269fc5053f31733756e46db054e98e083e41362d9ca17
3
+ size 4464885752
model-00035-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05a9dc213602b19ac2c869b7ea9c2d15a6fcf5ffb666146a049207b968d5eac5
3
+ size 4464885752
model-00036-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82e4b4f2e5268d4da032716ea7d8b73f085494b70c610aafea01352437b0d2bc
3
+ size 4464885752
model-00037-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0644306d1e294f16787d1dfa51aa5eaadbe2341fb137c3170a3723094f7f64e1
3
+ size 4464885752
model-00038-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afe05d538e5c1b1c815c2c24c02d5e18bb9a195029a0ed36e86773af53e408b0
3
+ size 4464885752
model-00039-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52e014c091cdc08e546e7265596e5f60b8adaad701aaf2cafa6b881b279614de
3
+ size 4464885752
model-00040-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:129ed38e7210f6dabc32a24ee741d347a0042551acf720baf2342be03555df8f
3
+ size 4464885752
model-00041-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d1f3a894adeba12303193e3db63c4d57dc6f91cca8944a04bcc25b6c7820958
3
+ size 4464885752
model-00042-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:760ca9d524890b53d997a96d6922cf2eb2e86f9a6c02ad19fa9c9f1b51dbe7ca
3
+ size 4464885752
model-00043-of-00048.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:976d187f1617f76ec28b6ecc691519dc04076cd9924c3dd9e222c448f1862e2a
3
+ size 4464885752