---
license: mit
tags:
- bf16
- bfloat16
- deepseek
- v3-0324
base_model:
- deepseek-ai/DeepSeek-V3-0324
---

This is the BF16 model of DeekSeek V3-0324. Useful for quantization and inference on GPUs that do not support FP8 (Nvidia Ampere)

BF16 is result of dequantizing the FP8 quantized weights from DeepSeek AI: https://huggingface.co/deepseek-ai/DeepSeek-V3-0324

[GPTQModel](https://github.com/modelcloud/gptqmodel) is your go-to choice for DeepSeek V3-0324 quantization toolkit for inference on vLLM and SGLang