Instructions to use nvidia/nemotron-3.5-asr-streaming-0.6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use nvidia/nemotron-3.5-asr-streaming-0.6b with NeMo:
import nemo.collections.asr as nemo_asr asr_model = nemo_asr.models.ASRModel.from_pretrained("nvidia/nemotron-3.5-asr-streaming-0.6b") transcriptions = asr_model.transcribe(["file.wav"]) - Transformers
How to use nvidia/nemotron-3.5-asr-streaming-0.6b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="nvidia/nemotron-3.5-asr-streaming-0.6b")# Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("nvidia/nemotron-3.5-asr-streaming-0.6b") model = AutoModel.from_pretrained("nvidia/nemotron-3.5-asr-streaming-0.6b", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
ModuleNotFoundError: 'rnnt_bpe_models_prompt' when using ASRModel.from_pretrained()
Hello NVIDIA team,
Thank you for releasing this impressive streaming model!
I am trying to run the basic transcription example provided in the model card, but I'm encountering a `ModuleNotFoundError` during the model instantiation after
the download completes.
**Code used:**
```python
import nemo.collections.asr as nemo_asr
asr_model = nemo_asr.models.ASRModel.from_pretrained("nvidia/nemotron-3.5-asr-streaming-0.6b")
Error Traceback:
[NeMo E] Model instantiation failed!
Target class: nemo.collections.asr.models.rnnt_bpe_models_prompt.EncDecRNNTBPEModelWithPrompt
Error(s): No module named 'nemo.collections.asr.models.rnnt_bpe_models_prompt'
Environment:
• I tried this with the stable PyPI release ( nemo_toolkit[asr]==2.7.3 ).
• I also tried building the absolute latest version directly from the NeMo main GitHub branch.
In both cases, the file rnnt_bpe_models_prompt.py does not seem to exist in the nemo.collections.asr.models directory.
Is there a specific branch, a missing dependency, or an upcoming NeMo release required to instantiate this model? Or does the .yaml config inside the .nemo
archive point to an outdated internal class name?
Thank you for your help and the great work!
Hi,
The rnnt_bpe_models_prompt is not officially embedded into nemo_toolkit=2.7.3 installation yet (will include it soon in coming release). We recommend to pull it from github repo: https://github.com/NVIDIA-NeMo/NeMo.
Thank you.