Feature Extraction
Transformers
Safetensors
qwen2
bnb-my-repo
text-embeddings-inference
4-bit precision
bitsandbytes
Instructions to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") model = AutoModelForMultimodalLM.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") - Notebooks
- Google Colab
- Kaggle
File size: 135 Bytes
ea8936d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:d16d282b02b6a0675051fdebbaeb885a3cce28258542230463b21adfac7e1871
size 2767395089
|