Instructions to use mradermacher/GLM-4.5-Base-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/GLM-4.5-Base-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/GLM-4.5-Base-i1-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -65,3 +65,7 @@ GLM-4.5-Base.i1-IQ4_XS.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
|
| 65 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 66 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 67 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 66 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 67 |
GLM-4.5-Base.i1-IQ4_XS.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
GLM-4.5-Base.i1-Q3_K_S.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
GLM-4.5-Base.i1-Q3_K_S.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
GLM-4.5-Base.i1-Q3_K_S.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
GLM-4.5-Base.i1-Q3_K_S.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
GLM-4.5-Base.i1-Q3_K_S.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9479f384e2f37d86ea4a9f8935f82a6ac571204196f372d47577416a5b897b0f
|
| 3 |
+
size 38654705664
|
GLM-4.5-Base.i1-Q3_K_S.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e912c5ebc8c98301baa44b51367272bb6d30d2c28e142de9b7f03ad4ddc0b05a
|
| 3 |
+
size 38654705664
|
GLM-4.5-Base.i1-Q3_K_S.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8a16ee2e5eb709292adbf962109bb4c6fdd7e6569647f18d7b325f9b95a27017
|
| 3 |
+
size 38654705664
|
GLM-4.5-Base.i1-Q3_K_S.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7af75ee1fa4a798667b7338ea6c29969462930e9185a6ba5891f3b5bf2dd953a
|
| 3 |
+
size 38593273056
|