junboolee commited on
Commit
6d93173
·
verified ·
1 Parent(s): ea17490

Add Occamy-1.0 model card

Browse files

Document model scope, training recipe, evaluation results, cost efficiency, serving, and limitations.

Files changed (1) hide show
  1. README.md +207 -0
README.md CHANGED
@@ -1,3 +1,210 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: transformers
4
+ pipeline_tag: image-text-to-text
5
+ base_model: Qwen/Qwen3.6-35B-A3B
6
+ tags:
7
+ - agent
8
+ - agentic
9
+ - co-work
10
+ - tool-use
11
+ - long-context
12
+ - mixture-of-experts
13
+ - coding
14
  ---
15
+
16
+ <div align="center">
17
+
18
+ # Occamy-1.0
19
+
20
+ **Open Pareto-frontier 35B Intelligence for Co-work**
21
+
22
+ [Model weights](https://huggingface.co/Accio-Lab/Occamy-1.0) · [GitHub](https://github.com/Accio-Lab/occamy) · [Training infrastructure](https://github.com/Accio-Lab/Dressage)
23
+
24
+ </div>
25
+
26
+ ## Overview
27
+
28
+ Occamy-1.0 is an open, cost-efficient co-work model developed by the Accio Team. It is built by further post-training [Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) for long-horizon, stateful agent workloads across terminals, files, structured APIs, and productivity tools.
29
+
30
+ Co-work tasks can invoke a model dozens or hundreds of times. Their practical cost therefore depends on the complete episode, not only on the price of a single response. Occamy-1.0 is designed to deliver reliable task execution at a compact 35B-A3B scale. Across our co-work evaluation suite, it is consistently among the strongest comparably sized models and remains competitive with substantially larger systems on several tasks. Under the evaluation and pricing protocol described in our technical report, Occamy lies near the low-cost knee of the observed cost-performance Pareto frontier.
31
+
32
+ ## Highlights
33
+
34
+ - **Built for co-work:** optimized for multi-step, stateful work rather than isolated question answering.
35
+ - **Long-horizon execution:** trained to preserve progress across tool calls, failures, context compaction, pruning, and other harness-level history rewrites.
36
+ - **Broad agentic capability:** strong co-work performance while retaining competitive tool-calling, coding, and instruction-following ability.
37
+ - **Cost-efficient serving:** 35B total parameters with 3B activated per token, a practical operating point for self-hosted agent systems.
38
+ - **Open ecosystem:** Apache-2.0 model weights, an open GitHub repository, and an open-source version of our multi-harness training infrastructure.
39
+
40
+ ## Model details
41
+
42
+ | Item | Value |
43
+ |---|---|
44
+ | Developer | Accio Team |
45
+ | Base checkpoint | Qwen3.6-35B-A3B |
46
+ | Architecture | Mixture-of-Experts, 35B total / 3B activated |
47
+ | Context length | 262,144 tokens |
48
+ | Precision | BF16 |
49
+ | Primary focus | Long-horizon co-work and tool-using agents |
50
+ | License | Apache-2.0 |
51
+
52
+ The checkpoint retains the Qwen3.6 multimodal architecture, but the current Occamy release and reported evaluation focus on text- and tool-based agent execution. Browser and GUI interaction are not currently supported or claimed.
53
+
54
+ ## Training overview
55
+
56
+ Occamy-1.0 uses a specialization-and-consolidation recipe rather than training from a base model:
57
+
58
+ 1. **Marathon Expert:** full-parameter SFT followed by Hierarchical Decoupled Policy Optimization (HDPO), targeting sustained execution over long, stateful episodes.
59
+ 2. **Sprint Expert:** full-parameter SFT over a broader distribution of shorter-horizon agentic workloads, including coding, information gathering, and structured tool use.
60
+ 3. **Capability harmonization:** model merging combines the complementary experts, followed by Single-Rollout Asynchronous Optimization (SAO) on a broad co-work task mixture.
61
+
62
+ Training data are execution-grounded: tasks are paired with runnable environments, observable state transitions, realized tool behavior, trajectory evidence, and task-level grading. Multi-harness adapters preserve harness-specific token, tool, rewrite, and state semantics while exposing a common trajectory and replay contract to the learner.
63
+
64
+ [Dressage](https://github.com/Accio-Lab/Dressage) is the open-source release of the infrastructure family used for multi-harness agentic training, token-exact trajectory capture, and state replay.
65
+
66
+ ## Evaluation
67
+
68
+ The table below summarizes the current Occamy-1.0 results. Exact harness versions, budgets, sampling settings, judge models, and comparison rules are documented in the technical report.
69
+
70
+ | Category | Benchmark | Metric | Occamy-1.0 |
71
+ |---|---|---:|---:|
72
+ | Co-work | Claw-Eval | Average | 82.20 |
73
+ | Co-work | Claw-Eval | Pass³ | 71.40 |
74
+ | Co-work | WildClawBench | avg@3 | 49.16 |
75
+ | Co-work | CommerceAgentBench | Pass¹ | 37.38 |
76
+ | Co-work | Business Arena | Avg. final net worth | $79,868 |
77
+ | Co-work | GDPval | Score | 1128 |
78
+ | Co-work | OfficeQA Pro | Accuracy | 48.10 |
79
+ | Co-work | τ³-Bench (Banking) | Pass¹ | 37.10 |
80
+ | Tool calling | AutomationBench | Pass¹ / Partial | 27.60 / 69.10 |
81
+ | Tool calling | BFCL v4 | Score | 65.40 |
82
+ | Tool calling | VitaBench | Score | 41.75 |
83
+ | Coding | Terminal-Bench 2.1 | Accuracy | 59.00 |
84
+ | Instruction following | IFEval | Score | 91.53 |
85
+
86
+ We do not currently report a standalone search benchmark. Search and information gathering may appear inside co-work tasks, but they should not be interpreted as a separate, controlled search-capability evaluation.
87
+
88
+ ### Efficiency and reliability
89
+
90
+ On the combined Claw-Eval T/C tasks, Occamy improves task success while using less interaction and producing fewer execution failures than its starting checkpoint under the same protocol.
91
+
92
+ | Metric | Qwen3.6-35B-A3B | Occamy-1.0 |
93
+ |---|---:|---:|
94
+ | Claw-Eval average | 69.5 | **82.2** |
95
+ | Trial success rate | 62.81% | **77.55%** |
96
+ | Tokens per trajectory | 185,999 | **149,713** |
97
+ | Tool calls per trajectory | 14.24 | **12.07** |
98
+ | Trace wall time | 74.58 s | **39.96 s** |
99
+ | Timeout rate | 9.88% | **2.18%** |
100
+
101
+ For the aggregate cost-performance analysis, Claw-Eval, WildClawBench, AutomationBench, and GDPval are min-max normalized across the compared systems and weighted equally. Per-task cost is computed from measured token usage using a common input, cache-read, and output pricing protocol. This is an inference-cost estimate for comparison, not a complete deployment total-cost-of-ownership analysis.
102
+
103
+ ## Quickstart
104
+
105
+ Occamy-1.0 uses the supplied <code>chat_template.jinja</code>. We recommend serving it behind an OpenAI-compatible endpoint with a recent version of SGLang or vLLM.
106
+
107
+ ### SGLang
108
+
109
+ The following example uses tensor parallelism across eight GPUs and enables Qwen reasoning and tool-call parsing:
110
+
111
+ ~~~bash
112
+ uv pip install "sglang[all]>=0.5.10"
113
+
114
+ python -m sglang.launch_server \
115
+ --model-path Accio-Lab/Occamy-1.0 \
116
+ --port 8000 \
117
+ --tp-size 8 \
118
+ --mem-fraction-static 0.8 \
119
+ --context-length 262144 \
120
+ --reasoning-parser qwen3 \
121
+ --tool-call-parser qwen3_coder
122
+ ~~~
123
+
124
+ ### vLLM
125
+
126
+ ~~~bash
127
+ uv pip install "vllm>=0.19.0" --torch-backend=auto
128
+
129
+ vllm serve Accio-Lab/Occamy-1.0 \
130
+ --port 8000 \
131
+ --tensor-parallel-size 8 \
132
+ --max-model-len 262144 \
133
+ --reasoning-parser qwen3 \
134
+ --enable-auto-tool-choice \
135
+ --tool-call-parser qwen3_coder
136
+ ~~~
137
+
138
+ If memory is limited, reduce the context length. Long-horizon agent performance can depend on the available context and the harness's compaction policy, so results may differ from the reported configuration.
139
+
140
+ ### OpenAI-compatible client
141
+
142
+ ~~~python
143
+ from openai import OpenAI
144
+
145
+ client = OpenAI(
146
+ base_url="http://localhost:8000/v1",
147
+ api_key="EMPTY",
148
+ )
149
+
150
+ response = client.chat.completions.create(
151
+ model="Accio-Lab/Occamy-1.0",
152
+ messages=[
153
+ {
154
+ "role": "user",
155
+ "content": "Inspect the workspace, fix the failing tests, and summarize the changes.",
156
+ }
157
+ ],
158
+ max_tokens=8192,
159
+ temperature=1.0,
160
+ top_p=0.95,
161
+ extra_body={"top_k": 20},
162
+ )
163
+
164
+ print(response.choices[0].message.content)
165
+ ~~~
166
+
167
+ For agent deployment, provide tool schemas through the serving API and let the harness own environment state, timeouts, retries, and history compaction. Replacing the supplied template or parser can change tool-call behavior.
168
+
169
+ ## Intended use
170
+
171
+ Occamy-1.0 is intended for research and development of:
172
+
173
+ - terminal- and file-based co-work agents;
174
+ - structured API and productivity-tool workflows;
175
+ - long-horizon task execution with stateful environments;
176
+ - agentic post-training, replay, and evaluation;
177
+ - coding and repository-level assistance inside sandboxed harnesses.
178
+
179
+ Use sandboxing, least-privilege credentials, action validation, and human confirmation for consequential operations.
180
+
181
+ ## Limitations
182
+
183
+ - Performance is sensitive to the harness, tool schemas, timeout budget, retry policy, context length, and history-rewrite behavior.
184
+ - Browser and GUI interaction are not currently supported or evaluated.
185
+ - The model may issue invalid calls, misread environment state, repeat actions, or stop before completing a task.
186
+ - Benchmark scores obtained with different harnesses or budgets are not directly comparable.
187
+ - The reported cost analysis estimates inference cost under a common pricing protocol; it does not include complete infrastructure, engineering, or operational costs.
188
+ - This release does not provide a safety guarantee for autonomous use in high-impact domains. Users are responsible for task-specific evaluation and safeguards.
189
+
190
+ ## Resources
191
+
192
+ - **Model:** https://huggingface.co/Accio-Lab/Occamy-1.0
193
+ - **GitHub:** https://github.com/Accio-Lab/occamy
194
+ - **Training infrastructure:** https://github.com/Accio-Lab/Dressage
195
+ - **Technical report and selected training data:** links will be added with the public release.
196
+
197
+ ## Citation
198
+
199
+ ~~~bibtex
200
+ @misc{accio2026occamy,
201
+ title = {Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work},
202
+ author = {{Accio Team}},
203
+ year = {2026},
204
+ howpublished = {\url{https://huggingface.co/Accio-Lab/Occamy-1.0}}
205
+ }
206
+ ~~~
207
+
208
+ ## License
209
+
210
+ Occamy-1.0 is released under the Apache License 2.0. Please also review the license and acceptable-use terms of the base model.