Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +6 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part1of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part2of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part3of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part4of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part5of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part6of6 +3 -0
.gitattributes
CHANGED
|
@@ -166,3 +166,9 @@ cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part5of8 filter=lfs diff=lfs me
|
|
| 166 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 167 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 168 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 166 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 167 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 168 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_0.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
| 169 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part1of6 filter=lfs diff=lfs merge=lfs -text
|
| 170 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part2of6 filter=lfs diff=lfs merge=lfs -text
|
| 171 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part3of6 filter=lfs diff=lfs merge=lfs -text
|
| 172 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 173 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 174 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part1of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:959283ae3ad7fa9fa1f026319ee03dace5ac401cac50627d227aca9870b319ba
|
| 3 |
+
size 46170898432
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part2of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:86960e935eceaaf75dc33192b0cc5de7136f9050ba8e6f9ff5e1d995d55406fb
|
| 3 |
+
size 46170898432
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part3of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:66a5943145de07b523fd7a843ab7dbea74c5d5bc7f27d6333e02dafd2481c86c
|
| 3 |
+
size 46170898432
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part4of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1cb7e7366a3103434f6cf4472dfd615a0711359b182c2b7aeb4fbfda2f9f7e6c
|
| 3 |
+
size 46170898432
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part5of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:374df87c9e5ed4969b4c3b1b0abedc3294eeebc27b4778b205f7d2b413a3589f
|
| 3 |
+
size 46170898432
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_XS.gguf.part6of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c8c6c0d3e0e3eb583f95314bd50f987705d19e1c8d6db3cc01b83cbce372b505
|
| 3 |
+
size 42021788672
|