yoyolaiyy3062 langgz commited on
Commit
374ea0c
·
0 Parent(s):

Duplicate from FunAudioLLM/SenseVoiceSmall-GGUF-audiocpp

Browse files

Co-authored-by: zhifu gao <langgz@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ sensevoice-small-q8-audiocpp-v1.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - zh
5
+ - en
6
+ - yue
7
+ - ja
8
+ - ko
9
+ library_name: gguf
10
+ tags:
11
+ - automatic-speech-recognition
12
+ - asr
13
+ - sensevoice
14
+ - funasr
15
+ - audio.cpp
16
+ - gguf
17
+ - ggml
18
+ - cpu
19
+ pipeline_tag: automatic-speech-recognition
20
+ ---
21
+
22
+ # SenseVoiceSmall GGUF for audio.cpp
23
+
24
+ This repository contains a self-contained Q8_0 export of
25
+ [SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) for the
26
+ [audio.cpp](https://github.com/0xShug0/audio.cpp) spec-backed runtime. The GGUF
27
+ embeds the `sense_asr` schema-v1 model specification, SenseVoice metadata,
28
+ SentencePiece vocabulary, CMVN tensors, and 919 model tensors. It loads
29
+ directly without `--model-spec-override`.
30
+
31
+ ## File
32
+
33
+ | File | Size | SHA256 |
34
+ |---|---:|---|
35
+ | `sensevoice-small-q8-audiocpp-v1.gguf` | 254,211,200 bytes | `4dedf169f625437fb336f2959674f399819729a765e184128c0e25a6e16ff0ec` |
36
+
37
+ ## Usage
38
+
39
+ ```bash
40
+ audiocpp_cli --task asr --family sense_asr \
41
+ --model sensevoice-small-q8-audiocpp-v1.gguf \
42
+ --backend cpu --audio zh.wav \
43
+ --request-option audio_chunk_mode=none
44
+ ```
45
+
46
+ The integration is tracked in
47
+ [audio.cpp pull request #218](https://github.com/0xShug0/audio.cpp/pull/218).
48
+
49
+ ## Reproducibility
50
+
51
+ The model was exported from `FunAudioLLM/SenseVoiceSmall` revision
52
+ `3847d57b6bdf2dd8875cb1508d2af43d80a16bf7` with the official
53
+ `runtime/llama.cpp/export_sensevoice_gguf.py` exporter using `--wtype q8_0`
54
+ and `--model-spec`.
55
+
56
+ On the official 5.616-second Mandarin sample, direct CPU inference produced:
57
+
58
+ ```text
59
+ 开饭时间早上9点至下午5点。
60
+ ```
61
+
62
+ The text exactly matched the original Q8 model loaded with an external model
63
+ specification.
64
+
65
+ ## Links
66
+
67
+ - [SenseVoice source and exporter](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)
68
+ - [FunASR](https://github.com/modelscope/FunASR)
69
+ - [FunASR industrial deployment guides](https://www.funasr.com/)
sensevoice-small-q8-audiocpp-v1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4dedf169f625437fb336f2959674f399819729a765e184128c0e25a6e16ff0ec
3
+ size 254211200