--- language: - en license: apache-2.0 library_name: safetensors tags: - safetensors - qwen2 - tts - speech - affectively - edgework - aether - distributed-inference - edge-deployment base_model: Qwen/Qwen3-TTS-12Hz-0.6B-Base base_model_relation: quantized pipeline_tag: text-to-speech --- # Qwen3 TTS 12hz 0.6b Base (SafeTensors, FP32 (SafeTensors)) > **Production-ready** SafeTensors quantization of [Qwen/Qwen3-TTS-12Hz-0.6B-Base](https://huggingface.co/Qwen/Qwen3-TTS-12Hz-0.6B-Base) for distributed speech synthesis — powered by the [Aether](https://github.com/forkjoin-ai/aether) edge inference runtime on [Edgework.ai](https://edgework.ai). ## Model Details | Property | Value | |----------|-------| | Base model | [Qwen/Qwen3-TTS-12Hz-0.6B-Base](https://huggingface.co/Qwen/Qwen3-TTS-12Hz-0.6B-Base) | | Parameters | 0.6B | | Architecture | Qwen2 | | Quantization | FP32 (SafeTensors) | | Format | SafeTensors | | Size | ~0.4 GB | | License | apache-2.0 | ## Also available: `.knot` (sovereign format) This repo ships [`qwen3-tts-0.6b.knot`](./qwen3-tts-0.6b.knot) — the model weights in the **KNOT** container that the [Aether](https://github.com/forkjoin-ai/aether) distributed-inference runtime loads natively (the GGUF, when present, sits right beside it). A KNOT is a single self-describing file with a JSON table-of-contents, so **any single tensor is one HTTP `Range` request** — ideal for streaming weights to edge nodes. | | GGUF | KNOT | |---|---|---| | Container | format-specific header | single file, JSON table-of-contents | | Per-tensor fetch | whole-file oriented | one tensor = one Range request | | Ecosystem | broad (llama.cpp, …) | Aether / Gnosis runtime | ```bash huggingface-cli download forkjoin-ai/qwen3-tts-12hz-0.6b-base qwen3-tts-0.6b.knot --local-dir ./knots ``` Full format spec: [KNOT_FORMAT.md](https://github.com/forkjoin-ai/aether/blob/main/docs/model-cards/KNOT_FORMAT.md). Inspect the header with `bun run open-source/bitwise/scripts/dump-knot.ts qwen3-tts-0.6b.knot`. ## Deployment Architecture This model runs on the **Aether distributed inference runtime** — a custom engine that shards model layers across multiple nodes for parallel execution: 1. **Coordinator** receives requests and manages token generation 2. **Layer nodes** each hold a subset of model layers (2 nodes for this model) 3. **Hidden states flow** between nodes via gRPC 4. **Zero cold start** via warm pool scheduling Deployed via [Edgework.ai](https://edgework.ai) — bringing fast, cheap, and private inference as close to the user as possible. ## About Published by [AFFECTIVELY](https://huggingface.co/forkjoin-ai) · Managed by [@buley](https://huggingface.co/buley) We quantize and publish **production-ready models** for distributed edge inference via the [Aether](https://github.com/forkjoin-ai/aether) runtime. Every release is tested for correctness and stability before publication. - [All models](https://huggingface.co/forkjoin-ai) · [GitHub](https://github.com/forkjoin-ai) · [Edgework.ai](https://edgework.ai)