Instructions to use mradermacher/GLM-4.5-Base-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/GLM-4.5-Base-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/GLM-4.5-Base-i1-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -46,3 +46,7 @@ GLM-4.5-Base.i1-Q4_K_S.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
|
| 46 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 47 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 47 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
GLM-4.5-Base.i1-Q4_K_S.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
GLM-4.5-Base.i1-Q3_K_M.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
GLM-4.5-Base.i1-Q3_K_M.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
GLM-4.5-Base.i1-Q3_K_M.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
GLM-4.5-Base.i1-Q3_K_M.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
GLM-4.5-Base.i1-Q3_K_M.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b405de9995a35536317af8b9c2f01428227eb043b8d0f95d4748c1b8932d46ad
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q3_K_M.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:866a1eec0fa3bf5c2fb866f17a353b4a2eb2d6d416f3599eb4696074e6c07ab4
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q3_K_M.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f7a431e78d215574676b1dd9f0e21cacf9c7123be371662966aed5acf98151b
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q3_K_M.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aab16501b70f90aea0628b6c7afdd41c52f9c0c186a0ee865a78ecc02c0bc870
|
| 3 |
+
size 42051247328
|