Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -78,7 +78,7 @@ TurnWave beats the VAD baseline on every metric the harness reports.
|
|
| 78 |
| `audio_eot_v2.onnx` | apache-2.0 | trained on smart-turn conversational clips |
|
| 79 |
| `audio_eot.onnx` | cc-by-4.0 | Phase 4; trained on semantic-vad-eot (CC BY 4.0) |
|
| 80 |
| `text_eot.int8.onnx` | cc-by-nc-sa-4.0 | trained on DailyDialog (CC BY-NC-SA 4.0) — non-commercial |
|
| 81 |
-
| `
|
| 82 |
|
| 83 |
Each model's licence follows its training data, so they differ. `audio_eot_v2` is
|
| 84 |
the one the benchmark above measures and the one to use.
|
|
@@ -102,7 +102,7 @@ sits 0.2 s into the pause — where a live agent decides, and where eot-bench sc
|
|
| 102 |
| audio_eot_v2 | fp32 | 4.81 ms | 14.0 MB |
|
| 103 |
| audio_eot | fp32 | 4.52 ms | 14.0 MB |
|
| 104 |
| text_eot | int8 | 5.02 ms | 7.2 MB |
|
| 105 |
-
|
|
| 106 |
|
| 107 |
INT8 is not applied blindly: dynamic quantization rewrites MatMul, so it speeds up
|
| 108 |
the transformer and *slows down* the conv-heavy branches. Each model ships whichever
|
|
@@ -129,9 +129,12 @@ not build could.
|
|
| 129 |
- **Behind the production models**, and not a fair comparison: SmartTurn starts from
|
| 130 |
a pretrained Whisper encoder, LiveKit's is a fine-tuned 0.5B LLM distilled from a
|
| 131 |
7B teacher. This is 3.49M parameters from random initialisation.
|
| 132 |
-
- **
|
| 133 |
-
|
| 134 |
-
transcripts,
|
|
|
|
|
|
|
|
|
|
| 135 |
- **Non-commercial models included.** The text and fusion models derive from
|
| 136 |
DailyDialog (CC BY-NC-SA 4.0). Only the audio branches are permissively licensed.
|
| 137 |
|
|
|
|
| 78 |
| `audio_eot_v2.onnx` | apache-2.0 | trained on smart-turn conversational clips |
|
| 79 |
| `audio_eot.onnx` | cc-by-4.0 | Phase 4; trained on semantic-vad-eot (CC BY 4.0) |
|
| 80 |
| `text_eot.int8.onnx` | cc-by-nc-sa-4.0 | trained on DailyDialog (CC BY-NC-SA 4.0) — non-commercial |
|
| 81 |
+
| `fusion_eot_v2.onnx` | cc-by-nc-sa-4.0 | fusion head retrained on conversational clips; contains the DailyDialog text branch, so it inherits its terms |
|
| 82 |
|
| 83 |
Each model's licence follows its training data, so they differ. `audio_eot_v2` is
|
| 84 |
the one the benchmark above measures and the one to use.
|
|
|
|
| 102 |
| audio_eot_v2 | fp32 | 4.81 ms | 14.0 MB |
|
| 103 |
| audio_eot | fp32 | 4.52 ms | 14.0 MB |
|
| 104 |
| text_eot | int8 | 5.02 ms | 7.2 MB |
|
| 105 |
+
| fusion_eot_v2 | fp32 | 38.19 ms | 42.4 MB |
|
| 106 |
|
| 107 |
INT8 is not applied blindly: dynamic quantization rewrites MatMul, so it speeds up
|
| 108 |
the transformer and *slows down* the conv-heavy branches. Each model ships whichever
|
|
|
|
| 129 |
- **Behind the production models**, and not a fair comparison: SmartTurn starts from
|
| 130 |
a pretrained Whisper encoder, LiveKit's is a fine-tuned 0.5B LLM distilled from a
|
| 131 |
7B teacher. This is 3.49M parameters from random initialisation.
|
| 132 |
+
- **Fusion wins in-domain, not on the benchmark — measured, not guessed.** The
|
| 133 |
+
fused model reaches AP 0.959 vs 0.905 audio-only on held-out conversational
|
| 134 |
+
clips (Whisper transcripts), but on eot-bench the text branch scores AUC 0.485 —
|
| 135 |
+
chance — on real human-agent speech, so fusion there is the audio branch diluted
|
| 136 |
+
by noise (AUC 0.751 vs 0.770). Until a text branch trained on real spoken
|
| 137 |
+
dialogue exists, `audio_eot_v2` is the model to deploy.
|
| 138 |
- **Non-commercial models included.** The text and fusion models derive from
|
| 139 |
DailyDialog (CC BY-NC-SA 4.0). Only the audio branches are permissively licensed.
|
| 140 |
|