Image-Text-to-Text
PEFT
Safetensors
English
code
code-generation
coding-agent
agent
agentic
software-engineering
swe-bench
lora
qwen
qwen3
multimodal
vision
image-to-code
execution-verified
best-of-n
self-hostable
open-source
australia
conversational
Instructions to use SwarmDo/SwarmDo-A1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use SwarmDo/SwarmDo-A1 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.6-27B") model = PeftModel.from_pretrained(base_model, "SwarmDo/SwarmDo-A1") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -104,3 +104,45 @@ Apache-2.0, consistent with the base model family.
|
|
| 104 |
url = {https://github.com/SwarmDo/models}
|
| 105 |
}
|
| 106 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 104 |
url = {https://github.com/SwarmDo/models}
|
| 105 |
}
|
| 106 |
```
|
| 107 |
+
|
| 108 |
+
|
| 109 |
+
## Use cases
|
| 110 |
+
|
| 111 |
+
- **Automated bug fixing** in Python repositories — generate a patch, then verify it against the project's tests.
|
| 112 |
+
- **Agentic software engineering** — a coding agent that edits files, runs commands, and self-checks patches.
|
| 113 |
+
- **Image-to-code / visual coding** — turn a chart, plot, or UI screenshot into the code that reproduces it (render-and-compare verified).
|
| 114 |
+
- **Self-hosted / private coding assistant** — runs entirely on your own hardware (vLLM, or GGUF via Ollama / LM Studio); no data leaves your machine.
|
| 115 |
+
- **Best-of-N patch generation** — sample multiple candidate fixes and select the one that passes execution.
|
| 116 |
+
|
| 117 |
+
## Run it locally (GGUF — Ollama / LM Studio / llama.cpp)
|
| 118 |
+
|
| 119 |
+
For a one-command local run, use the GGUF build — **no account needed**:
|
| 120 |
+
|
| 121 |
+
```bash
|
| 122 |
+
ollama run hf.co/SwarmDo/SwarmDo-A1-GGUF:Q4_K_M
|
| 123 |
+
```
|
| 124 |
+
|
| 125 |
+
GGUF repo: **[SwarmDo/SwarmDo-A1-GGUF](https://huggingface.co/SwarmDo/SwarmDo-A1-GGUF)** (Q4_K_M ~16.5 GB, Q8_0 ~28.6 GB; LM Studio auto-indexes it). The GGUF is text-only; for the full multimodal + execution-verified system, self-host with vLLM as shown above.
|
| 126 |
+
|
| 127 |
+
## FAQ
|
| 128 |
+
|
| 129 |
+
**Is SwarmDo-A1 open source?** Yes — Apache-2.0, commercial use permitted. Weights, recipe, and full (including negative) results are public.
|
| 130 |
+
|
| 131 |
+
**Can I run it on my own hardware?** Yes. Self-host with vLLM (adapter on Qwen3.6-27B), or run the quantized **GGUF** locally with Ollama / LM Studio / llama.cpp. Q4_K_M fits a single 24 GB GPU or a 32 GB Mac.
|
| 132 |
+
|
| 133 |
+
**What is it based on?** A LoRA/PEFT adapter on **Qwen/Qwen3.6-27B** — a linear-attention hybrid (gated-DeltaNet) base with a vision tower. Apache-2.0.
|
| 134 |
+
|
| 135 |
+
**Does it really do image-to-code?** Yes — it writes code from images (charts/plots/UI) and we verify it by *rendering the output and comparing to the target image* (an objective, reward-hackable-resistant signal), not by eyeballing.
|
| 136 |
+
|
| 137 |
+
**How is it different from other open coding models?** SwarmDo-A1 is a *system*, not just a checkpoint: a strong open base **plus** an execution-verified best-of-N harness that runs the project's tests, **plus** an exec-grounded visual-coding capability. We report paired, held-out, execution-verified deltas — and publish the limitations.
|
| 138 |
+
|
| 139 |
+
**Is it good at SWE-bench?** We report *relative, paired, held-out, execution-verified* wins (e.g. base + execution-verified selection solves 36 vs 24, p = 0.0005), not a single absolute leaderboard number we can't stand behind under paired testing.
|
| 140 |
+
|
| 141 |
+
**What languages?** Python-centric agentic software engineering. It is a coding agent, not a general chat assistant.
|
| 142 |
+
|
| 143 |
+
**Where are the full results?** Public hub: https://github.com/SwarmDo/models
|
| 144 |
+
|
| 145 |
+
---
|
| 146 |
+
|
| 147 |
+
*Topics: open source coding model · local LLM for coding · self-hosted AI coding assistant · agentic SWE-bench model · image to code / chart to code / screenshot to code · execution-verified code generation · Qwen3.6-27B LoRA · Ollama coding model · run a coding LLM locally · Apache-2.0 code model.*
|
| 148 |
+
|