Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +6 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part1of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part2of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part3of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part4of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part5of6 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part6of6 +3 -0
.gitattributes
CHANGED
|
@@ -181,3 +181,9 @@ cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part6of9 filter=lfs diff=lfs me
|
|
| 181 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part7of9 filter=lfs diff=lfs merge=lfs -text
|
| 182 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part8of9 filter=lfs diff=lfs merge=lfs -text
|
| 183 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part9of9 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 181 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part7of9 filter=lfs diff=lfs merge=lfs -text
|
| 182 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part8of9 filter=lfs diff=lfs merge=lfs -text
|
| 183 |
cogito-v2-preview-deepseek-671B-MoE.i1-Q4_1.gguf.part9of9 filter=lfs diff=lfs merge=lfs -text
|
| 184 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part1of6 filter=lfs diff=lfs merge=lfs -text
|
| 185 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part2of6 filter=lfs diff=lfs merge=lfs -text
|
| 186 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part3of6 filter=lfs diff=lfs merge=lfs -text
|
| 187 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 188 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 189 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part1of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4cb598ead3338549750640ab8ccfb8f51d3dcf742c65689fbddbd99c61e5f569
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part2of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0858bef79e4fc80dbf70ae047d802c7821be1bac68273304651c68df471091d
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part3of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c7774a67328f1443da1b4575ced48d3f8529851b012f49a585a1eeae6edf3655
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part4of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4e280c72429f51ba130c144770aa6abc5778cd79a13badbf1a2e99fdf11a5fbf
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part5of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ff8a9d05b4bf10fc6e55914a871d95a034d098b6f5385c4ddb651cc4ecc56b6e
|
| 3 |
+
size 48318382080
|
cogito-v2-preview-deepseek-671B-MoE.i1-IQ3_S.gguf.part6of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8eeeec332cbdbaff7b236813dc645b35106f1ed440bf847e19e74fbb214bdf80
|
| 3 |
+
size 47554468864
|