---
license: mit
base_model: UsefulSensors/moonshine-base-zh
base_model_relation: quantized
library_name: transcribe.cpp
pipeline_tag: automatic-speech-recognition
language:
  - zh
tags:
  - gguf
  - transcribe.cpp
  - asr
  - speech-to-text
  - moonshine
  - useful-sensors
  - encoder-decoder
transcribe_cpp:
  wer_fleurs_zh:
    f32: 16.65
    f16: 16.65
    q8_0: 17.0
  rtf_m4_max:
    metal: 79.5
    cpu: 80.5
  rtf_ryzen_4750u:
    vulkan: 34.5
    cpu: 22
  streaming: false
  translate: false
  lang_detect: false
  timestamps: none
---

# moonshine-base-zh: transcribe.cpp GGUF

GGUF conversions of [UsefulSensors/moonshine-base-zh](https://huggingface.co/UsefulSensors/moonshine-base-zh) for use
with [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp).

Ported from upstream commit
[1df4f95](https://huggingface.co/UsefulSensors/moonshine-base-zh/commit/1df4f95),
pinned 2026-05-12.
Validated against the transformers reference at transcribe.cpp commit
[90bf720](https://github.com/handy-computer/transcribe.cpp/tree/90bf720)
on 2026-05-12.

UsefulSensors' Moonshine base fine-tuned on Mandarin. Same
encoder-decoder transformer architecture as moonshine-base (62M
parameters): consumes 16 kHz raw PCM via a three-layer Conv1d stem (no
STFT, no mel filterbank) and emits transcript-only output. Single-language
(zh); no translation, no language detection, no timestamps.


## Downloads

| Quantization | Download | Size | CER (FLEURS zh test) |
| --- | --- | ---: | ---: |
| F32 | [moonshine-base-zh-F32.gguf](https://huggingface.co/handy-computer/moonshine-base-zh-gguf/resolve/main/moonshine-base-zh-F32.gguf) | 236 MB | 16.65% |
| F16 | [moonshine-base-zh-F16.gguf](https://huggingface.co/handy-computer/moonshine-base-zh-gguf/resolve/main/moonshine-base-zh-F16.gguf) | 126 MB | 16.65% |
| Q8_0 | [moonshine-base-zh-Q8_0.gguf](https://huggingface.co/handy-computer/moonshine-base-zh-gguf/resolve/main/moonshine-base-zh-Q8_0.gguf) | 74 MB | 17.00% |

CER measured on the FLEURS-zh test split (945
utterances) using the transcribe.cpp default decode (greedy,
num_beams=1, max_length=192 — matching the upstream generation_config).

UsefulSensors does not publish a per-language CER number
for this variant. As a comparable baseline we ran the Transformers F32
reference (`MoonshineForConditionalGeneration`, fp32 on MPS) on the
same manifest: **16.61% CER**. The C++ F32/F16 numbers
above match the reference within bootstrap-CI noise; Q8_0 introduces
a small additional drift from F16 (typically within 0.1pp).


## Usage

Build transcribe.cpp from source:

```bash
git clone git@github.com:handy-computer/transcribe.cpp.git
cd transcribe.cpp
cmake -B build && cmake --build build
```

Run on a 16 kHz mono WAV:

```bash
build/bin/transcribe-cli \
  -m moonshine-base-zh-Q8_0.gguf \
  input.wav
```

If your audio isn't already 16 kHz mono WAV, convert it first:

```bash
ffmpeg -i input.mp3 -ar 16000 -ac 1 output.wav
```

See the [transcribe.cpp model page](https://github.com/handy-computer/transcribe.cpp/blob/main/docs/models/moonshine.md) for performance
numbers, numerical validation, and reproduction steps.

## License

Inherited from the base model: **MIT**. See the
[upstream model card](https://huggingface.co/UsefulSensors/moonshine-base-zh) for full terms.

---

## Original Model Card

> The section below is reproduced from
> [UsefulSensors/moonshine-base-zh](https://huggingface.co/UsefulSensors/moonshine-base-zh) at commit
> `1df4f95` for offline reference. The upstream card is the
> authoritative source.

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->



## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

- **Developed by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Model type:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** [More Information Needed]

### Model Sources [optional]

<!-- Provide the basic links for the model. -->

- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]

## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

### Direct Use

<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->

[More Information Needed]

### Downstream Use [optional]

<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

## How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

## Training Details

### Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

#### Preprocessing [optional]

[More Information Needed]


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

#### Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]

## Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

### Testing Data, Factors & Metrics

#### Testing Data

<!-- This should link to a Dataset Card if possible. -->

[More Information Needed]

#### Factors

<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->

[More Information Needed]

#### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

### Results

[More Information Needed]

#### Summary



## Model Examination [optional]

<!-- Relevant interpretability work for the model goes here -->

[More Information Needed]

## Environmental Impact

<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->

Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).

- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]

## Technical Specifications [optional]

### Model Architecture and Objective

[More Information Needed]

### Compute Infrastructure

[More Information Needed]

#### Hardware

[More Information Needed]

#### Software

[More Information Needed]

## Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Model Card Authors [optional]

[More Information Needed]

## Model Card Contact

[More Information Needed]