Instructions to use mradermacher/GLM-4.5-Base-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/GLM-4.5-Base-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/GLM-4.5-Base-i1-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -92,3 +92,8 @@ GLM-4.5-Base.i1-Q4_0.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
|
| 92 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 93 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 94 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 93 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 94 |
GLM-4.5-Base.i1-IQ3_XS.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
| 95 |
+
GLM-4.5-Base.i1-Q4_1.gguf.part1of5 filter=lfs diff=lfs merge=lfs -text
|
| 96 |
+
GLM-4.5-Base.i1-Q4_1.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
| 97 |
+
GLM-4.5-Base.i1-Q4_1.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 98 |
+
GLM-4.5-Base.i1-Q4_1.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 99 |
+
GLM-4.5-Base.i1-Q4_1.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
GLM-4.5-Base.i1-Q4_1.gguf.part1of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6c880c47928e72aaf263737c02dbaeb67ad4cad26f3e286340a0cdf1cba9e7d9
|
| 3 |
+
size 45097156608
|
GLM-4.5-Base.i1-Q4_1.gguf.part2of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:61ac6278e4aa7127f145d1c03edfa190e0ea8d59ea9c102fb3224b1480062bee
|
| 3 |
+
size 45097156608
|
GLM-4.5-Base.i1-Q4_1.gguf.part3of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c99d37534fb3e0de9bb6f4af6a43d54e7879354b23f1b397d84ba60db9785048
|
| 3 |
+
size 45097156608
|
GLM-4.5-Base.i1-Q4_1.gguf.part4of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:51c0599e054e2f7369b886af9ea875d2ce2d31e3ca7add7ac1ef07c18b140df6
|
| 3 |
+
size 45097156608
|
GLM-4.5-Base.i1-Q4_1.gguf.part5of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:609f5f16e71747a0132e0739530d2bd107b3ddbbef1a3b53676849e137019917
|
| 3 |
+
size 43990203616
|