Feature Extraction
Transformers
Safetensors
qwen2
bnb-my-repo
text-embeddings-inference
4-bit precision
bitsandbytes
Instructions to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") model = AutoModelForMultimodalLM.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") - Notebooks
- Google Colab
- Kaggle
File size: 133 Bytes
ea8936d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:e20ddafc659ba90242154b55275402edeca0715e5dbb30f56815a4ce081f4893
size 11422778
|