ModuleNotFoundError: 'rnnt_bpe_models_prompt' when using ASRModel.from_pretrained()

#18
by DannyWhyze - opened

Hello NVIDIA team,

Thank you for releasing this impressive streaming model!                                                                                                         
                                                                                                                                                                 
I am trying to run the basic transcription example provided in the model card, but I'm encountering a `ModuleNotFoundError` during the model instantiation after 

the download completes.

**Code used:**                                                                                                                                                   
```python                                                                                                                                                        
import nemo.collections.asr as nemo_asr                                                                                                                          
asr_model = nemo_asr.models.ASRModel.from_pretrained("nvidia/nemotron-3.5-asr-streaming-0.6b")                                                                   
                                                                                                                                                                 

Error Traceback:

[NeMo E] Model instantiation failed!                                                                                                                             
    Target class: nemo.collections.asr.models.rnnt_bpe_models_prompt.EncDecRNNTBPEModelWithPrompt                                                                
    Error(s): No module named 'nemo.collections.asr.models.rnnt_bpe_models_prompt'                                                                               
                                                                                                                                                                 

Environment:

• I tried this with the stable PyPI release ( nemo_toolkit[asr]==2.7.3 ).
• I also tried building the absolute latest version directly from the NeMo main GitHub branch.

In both cases, the file rnnt_bpe_models_prompt.py does not seem to exist in the nemo.collections.asr.models directory.

Is there a specific branch, a missing dependency, or an upcoming NeMo release required to instantiate this model? Or does the .yaml config inside the .nemo
archive point to an outdated internal class name?

Thank you for your help and the great work!

NVIDIA org

Hi,

The rnnt_bpe_models_prompt is not officially embedded into nemo_toolkit=2.7.3 installation yet (will include it soon in coming release). We recommend to pull it from github repo: https://github.com/NVIDIA-NeMo/NeMo.

Thank you.

Sign up or log in to comment