Feature Extraction
Transformers
Safetensors
qwen2
bnb-my-repo
text-embeddings-inference
4-bit precision
bitsandbytes
Instructions to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") model = AutoModelForMultimodalLM.from_pretrained("bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit") - Notebooks
- Google Colab
- Kaggle
File size: 135 Bytes
ea8936d | 1 2 3 4 | version https://git-lfs.github.com/spec/v1
oid sha256:2f5da036c6ab139f4f15d069272df082839e8bc695859b982b65294dba85d646
size 4933186640
|