Instructions to use mradermacher/GLM-4.5-Base-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/GLM-4.5-Base-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/GLM-4.5-Base-i1-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -78,3 +78,9 @@ GLM-4.5-Base.i1-Q5_K_S.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
|
| 78 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 79 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 80 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 78 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 79 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 80 |
GLM-4.5-Base.i1-Q5_K_S.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
| 81 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part1of6 filter=lfs diff=lfs merge=lfs -text
|
| 82 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part2of6 filter=lfs diff=lfs merge=lfs -text
|
| 83 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part3of6 filter=lfs diff=lfs merge=lfs -text
|
| 84 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 85 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 86 |
+
GLM-4.5-Base.i1-Q5_K_M.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part1of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:21cf70b1e8500a5b176f26da929c9a3d66b8425a9eb82c56977ab765b7bcf315
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part2of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98b3487c7f89adafa0fb3ee26bb743a5585508a4470b85129bbaf7daae07e6c5
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part3of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ff6a18057986dd7601b062b9b5b77cd3e6fbfc06be1a8cfe3566e3ff597e9c1
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part4of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:282988b7519c55a32524e4df07648a7c1891476b134a16be3500f80c68f26150
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part5of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02f0843380c9cab9b6d7ef1437b0649e6986bfed5c1284eb9103c68ce4dbf692
|
| 3 |
+
size 42949672960
|
GLM-4.5-Base.i1-Q5_K_M.gguf.part6of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:92dcb4576cde43d2869ae32d7e3d97eea5d49897bdccd0f6b58a6fa63ca8e551
|
| 3 |
+
size 39261359328
|