Beambutbetter commited on
Commit
ce1d15a
·
verified ·
1 Parent(s): d1be4a0

ReadMe01.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - th
5
+ - en
6
+ - zh
7
+ base_model:
8
+ - deepseek-ai/DeepSeek-V2-Lite
9
+ pipeline_tag: text-generation
10
+ ---
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
+
15
+ This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
16
+
17
+ ## Model Details
18
+
19
+ ### Model Description
20
+
21
+ DeepSeek-V2-Lite Quantized to NVFP4 Using TensorRT-Model-Optimizer. The model has 15.6B parameters in total, in Nvidia float precision 4 bit.
22
+ Require Blackwell GPU, NVFP4 supported inference engine(if use with inference engine)
23
+
24
+ - **Developed by:** Krisakorn Chanthasang
25
+ - **Model type:** LLM TextGeneration
26
+ - **Language(s) (NLP):** Chinese English Thai
27
+ - **License:** Apache 2.0
28
+ - **Quantized from model:** DeepSeek-V2-Lite
29
+ ### Model Information
30
+
31
+ Read https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite for Basic model information
32
+
33
+ ## How to Get Started with the Model
34
+
35
+ GPU requirement: Blackwell Series
36
+
37
+ ## Hardware
38
+
39
+ Quantization Hardware: Nvidia RTX PRO 6000 Blackwell Workstation
40
+