Text Classification
Transformers
Safetensors
English
qwen2
nvidia
qwen2.5
reward-model
text-embeddings-inference
Instructions to use nvidia/Qwen-2.5-Nemotron-32B-Reward with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nvidia/Qwen-2.5-Nemotron-32B-Reward with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="nvidia/Qwen-2.5-Nemotron-32B-Reward")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("nvidia/Qwen-2.5-Nemotron-32B-Reward") model = AutoModelForSequenceClassification.from_pretrained("nvidia/Qwen-2.5-Nemotron-32B-Reward", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| Field | Response |
|---|---|
| Intended Application & Domain: | Response Customization in Large Language Model Development |
| Model Type: | Text-to-Float Transformer |
| Intended User: | Developers customizing model response across different applications and domains. |
| Output: | Float |
| Describe how the model works: | Generates score based on the quality of the last assistant response in conversation |
| Name the adversely impacted groups this has been tested to deliver comparable outcomes regardless of: | Not Applicable |
| Verified to have met prescribed quality standards: | Yes |
| Technical Limitations: | This model may not work well beyond input sequence length of 8, 192 tokens. |
| Performance Metrics: | Throughput and Latency |
| Potential Known Risks: | The model was trained on data that contains toxic language, unsafe content, and societal biases originally crawled from the internet. Therefore, the model may amplify those biases and return toxic responses especially when prompted with toxic prompts. The model may generate answers that may be inaccurate, omit key information, or include irrelevant or redundant text producing socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. |
| Licensing: | GOVERNING TERMS: Use of this model is governed by the NVIDIA Open Model License . |