gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_SPLIT

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
+*.gguf.zbst filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,155 @@
 ---
 license: mit
 ---
+# gemma-4-31B-it
+
+## 🤔 What is this [HuggingFace repository](https://huggingface.co/Thireus/gemma-4-31B-it-THIREUS-BF16-SPECIAL_SPLIT/) about?
+
+This repository provides **GGUF-quantized tensors** for the gemma-4-31B-it model (official repo: https://huggingface.co/google/gemma-4-31B-it). These GGUF shards are designed to be used with **Thireus’ GGUF Tool Suite** (https://github.com/Thireus/GGUF-Tool-Suite), a collection of tools that automatically finds the perplexity-optimal mix of quantizations for any given a model size target. With this GGUF Tool Suite, you can produce your own Dynamic 3.0 Quants recipes and achieve optimum accuracy & SOTA quantization performance. Give it a try here: https://gguf.thireus.com/quant_assign.html  
+
+- 📖 Documentation: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/docs
+- 🔍 Example of GGUF recipes: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/recipe_examples  
+- 🍳 Cook your own recipe files: https://gguf.thireus.com/quant_assign.html  
+- ☁️ Download GGUF models from recipe files: https://gguf.thireus.com/quant_downloader.html  
+- 📂 Browse available models: https://huggingface.co/Thireus/collections and https://gguf.thireus.com  
+
+*tl;dr: Expand the details section below*
+<details>
+
+```
+cd ~
+
+# Make sure to install all ik_llama.cpp compilation dependencies...
+apt install python3-dev python3-pip python3-venv python3-wheel python3-setuptools git acl netcat-openbsd cmake # pipx
+
+# Obtain ik_llama's Thireus version - Windows/macOS/Linux builds available at https://github.com/Thireus/ik_llama.cpp/releases
+git clone https://github.com/Thireus/ik_llama.cpp
+cd ik_llama.cpp
+git pull
+# Build ik_llama.cpp
+cmake -B build -DGGML_AVX=ON -DGGML_AVX2=ON -DLLAMA_CURL=OFF -DGGML_MAX_CONTEXTS=2048
+cmake --build build --config Release -j16
+cd ..
+
+# Obtain Thireus' GGUF-Tool-Suite
+GIT_LFS_SKIP_SMUDGE=1 git clone https://github.com/Thireus/GGUF-Tool-Suite
+
+# Download model quant mix from recipe file - you can also try the web version: https://gguf.thireus.com/quant_downloader.html
+cd GGUF-Tool-Suite
+rm -f download.conf # Make sure to copy the relevant download.conf for the model before running quant_assign.py
+cp -f models/gemma-4-31B-it/download.conf . # Use the download.conf of the chosen model
+mkdir -p kitchen && cd kitchen
+# Obtain a recipe example for the chosen model from ../recipe_examples/
+../quant_downloader.sh ../recipe_examples/ik_llama.cpp_recipes/gemma-4-31B-it.ROOT-3.5993bpw-11.3565ppl.1GB-GGUF_0GB-GPU_0GB-CPU.9888e4b_831ff04.recipe
+
+# Other recipe examples can be found at https://github.com/Thireus/GGUF-Tool-Suite/tree/main/recipe_examples
+
+# Launch ik_llama's llama-cli:
+ulimit -n 9999 # Lifts "too many open files" limitation on Linux
+~/ik_llama.cpp/build/bin/llama-server \
+  -m gemma-4-31B-it-THIREUS-BF16-SPECIAL_TENSOR-00001-of-00399.gguf \
+  -fa auto -amb 1024 -ctk q8_0 -c 32768 -ngl 99 \
+  -b 4096 -ub 4096 --warmup-batch --no-mmap --threads 1 \
+  --main-gpu 0
+```
+
+</details>
+
+---
+
+## ❓ Why does this Tool Suite exist?
+
+1. **Compatibility & Speed** – [unsloth](https://huggingface.co/unsloth)’s dynamic quants may not always work optimally with `ik_llama.cpp`.  
+2. **Custom Rig Fit** – No off-the-shelf GGUF model perfectly matched my VRAM/RAM setup, so I built a way to tailor models and leverage extra VRAM/RAM to reduce perplexity.  
+3. **Automated PPL-Optimal Quantization** – To my knowledge, there was no open source flexible, automated method to minimize perplexity for any bits-per-weight (bpw) target—so I created one with excellent results!  
+
+---
+
+## 📊 How does it compare to other GGUFs?
+
+Here’s how gemma-4-31B-it quantized with **Thireus’ GGUF Tool Suite** stacks up against other quantizers (lower perplexity = better at equal or lower bpw):
+
+![PPLs Compared With Others](https://github.com/Thireus/GGUF-Tool-Suite/raw/main/ppl_graphs/gemma-4-31B-it.svg)
+
+> _Note: The `recipe_examples` files illustrate good recipes. The Tool Suite computes the optimal ppl/bpw curve for you — just specify your target RAM, VRAM, and quant types, and `quant_assign.py` finds the best mix._  
+
+More perplexity/bpw graphs for other supported models: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/ppl_graphs
+
+---
+
+## 🚀 How do I get started?
+
+Check out the [GGUF Tool Suite README](https://github.com/Thireus/GGUF-Tool-Suite) — focus on these sections:
+
+1. ⚠️ **Requirements** – Which `ik_llama.cpp` (or `llama.cpp`) version to use and how to compile.  
+   - Windows binaries (no patching needed) at: https://github.com/Thireus/ik_llama.cpp/releases  
+2. 📥 **Download Model Shards** – Use `quant_downloader.sh` or [quant_downloader.html](https://gguf.thireus.com/quant_downloader.html) to fetch GGUF shards from any recipe.  
+   - Recipe examples: https://github.com/Thireus/GGUF-Tool-Suite/tree/main/recipe_examples  
+3. 🧠 **Run a Downloaded Model** – Sample usage with `llama-cli`.  
+4. 🛠️ **Generate a Custom Recipe** – Produce recipes tailored to your VRAM/RAM target usage for optimum perplexity.  
+
+---
+
+## ✅ Supported Models
+
+Supported models are listed under `models/` in the [Tool Suite Github repo](https://github.com/Thireus/GGUF-Tool-Suite/tree/main/models). Presence of `ppl_results.csv` indicates official support and compatibility with `quant_assign.py`.
+
+---
+
+## 🤷‍♂️ Will I release baked dynamic quant GGUFs?
+
+No, because I believe in **tailored quantization** for each user’s hardware. If you prefer ready-made shards, you are welcome to merge them via `llama-gguf-split --merge`, or request someone to publish them, or rely on generic GGUF dynamic quants such as [unsloth](https://huggingface.co/unsloth)'s.
+
+Instead, I prefer to share examples of recipes so users can see exactly how they were produced (command included inside these recipe files) and tweak them for their own rigs. The `quant_downloader.sh` script or [quant_downloader.html](https://gguf.thireus.com/quant_downloader.html) (web port of this script) handles automatic fetching and verification of each shard. Note that recipes provided by [Ubergarm](https://huggingface.co/ubergarm) on his model cards are also compatible with `quant_downloader.sh` and [quant_downloader.html](https://gguf.thireus.com/quant_downloader.html), providing a "SPECIAL_SPLIT" version of these models exists (see https://gguf.thireus.com/).
+
+Users who don’t trust the GGUF shards on HuggingFace can also quantize their own by passing recipe lines to `llama-quantize --custom-q` ([see example](https://github.com/Thireus/GGUF-Tool-Suite/blob/main/models/DeepSeek-R1-0528/DeepSeek-R1-0528-THIREUS-ANY-SPECIAL.sh#L482-L486)). Run `llama-quantize --help` to list compatible quants for `quant_assign.py`. This approach is especially useful if you prefer `llama.cpp` over `ik_llama.cpp`.  
+
+---
+
+## 📦 What’s in this repository?
+
+- **00001 GGUF header shard** – Contains metadata (tokens, chat template, tensor count, etc.). This metadata can be explored directly from the HuggingFace web interface after clicking on that shard.  
+- **Tensor shards** – Each shard holds one tensor; see `tensors.map` for names, quant types, sizes, SHA-256 hash, shard IDs, etc.  
+- **GPG-signed files** – `tensors.map` and header shard are signed with the key in [trusted-keys.asc](https://github.com/Thireus/GGUF-Tool-Suite/blob/main/trusted-keys.asc) for tamper detection.  
+- **Security note** – Some papers about various ways to attack GGUFs and LLMs are available online, such as https://arxiv.org/abs/2505.23786, and there are also more classic security exploits like CVE-2024-23496 and CVE-2024-25664 through CVE-2024-25668. Only use GGUFs from reputable, trusted authors—or alternatively self-quantize—to avoid potential exploits. 
+
+---
+
+## 💡 Pro Tips
+
+You can easily download the BF16 model version to quantize your own shards:
+
+```
+mkdir kitchen  
+echo '.*=bf16' > kitchen/bf16.recipe  
+cd kitchen
+../quant_downloader.sh bf16.recipe --qtype BF16 
+```
+
+You can also quantize individual BF16 tensors without the need to download every BF16 .gguf shard:
+
+BF16 model shards can also be individually quantized using a special version of ik_llama.cpp's `llama-quantize` utility which comes with the `--individual-tensors` option.
+
+- Source code: https://github.com/Thireus/ik_llama.cpp/tree/th/quantize_individual_tensors
+- Builds (macOS, Windows and Linux): https://github.com/Thireus/ik_llama.cpp/releases/tag/th-quantize_individual_tensors-b4210-7a44805
+
+Usage example:
+```
+./llama-quantize --keep-split --imatrix imatrix_ubergarm.dat --individual-tensors 2,3,1094 Kimi-K2-Thinking-THIREUS-BF16-SPECIAL_TENSOR-00001-of-01097.gguf my_new_shards.gguf iq3_s 12
+```
+
+For more information about how to use it: https://github.com/Thireus/GGUF-Tool-Suite/issues/45
+
+You can produce your own quantized shards from Thireus' special BF16 model using `quantize_model.sh` found on https://github.com/Thireus/GGUF-Tool-Suite, for example:
+
+```
+./quantize_model.sh --model "gemma-4-31B-it" --qtype iq2_xxs
+```
+
+You can disable reasoning (thinking) when using jinja templates for supported models:
+
+```
+llama-server ... --jinja --chat-template-kwargs '{"enable_thinking": false}'
+```
+
+Enjoy optimized quantization! 🎉

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00001-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ea39c48dee91a1e283d4ed676aad73399615000f1c113970eb21c0c3c08d66d
+size 15782848

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00002-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2799a842ee3ef5e175c31185b0f20835d78744f98620c5a180150c4cc43c70e
+size 1184

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00003-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8fe49c4744db30754d88a5f60b42d22260baca518d27a856115ec48d4b33afc4
+size 968884416

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00004-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d84ec0635dbadf9cc1ed1f55ab76be222a040c2a720ab1d6a4a7cb1a1594841
+size 21664

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00005-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5cfbfe83c869a1b9ce639606e3f4f065d57886569508b1706551f0bf5bdd4b9
+size 224

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00006-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edab93703c353de9c346ef84b3b167fa19c98b7485f74e649a5eb71eb5bf396a
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00007-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6b2ada4bc6dda01acc35acc8113468618789f50a75fee7e74efcbff0e211b14
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00008-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f7b9f72e1ca14ed3d679123905f17129359e7a069aa4ad84018ff711a2c62108
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00009-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36951d3014398cc343a10d5fdadb57144d644246438036abab7d433bfdeb67bd
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00010-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ace16a3b79d34186f4239c33683d62a1747457ce2a7cd5c19abcb55561175b8e
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00011-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc4c34ba33ac3930accdcb3caf56d55dd0765acbcb0af4f25c413352c69026d1
+size 21664

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00012-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37e4f56c89cb0eb994c8af86f2c4831205327d4b930fe078e98b6e82f163731f
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00013-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa3bf2080b9c17f535bdbbab989eed2d09229419fbb6270024576c1922723f2b
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00014-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18e9727bb3d1243e070247ba4c1541be93b30fb064b20c3abf9ad7106c33f233
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00015-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0df256f04424c92f798cad2d477f6fd4c16f99e2b5ed577f2357f4836fbcfe5
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00016-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9ed6a298c3fcfd263d1f2ae73d2c125feb8d37637c3b8d4ad91307d58ee63ff
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00017-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f21889443b41572fc690ee4da5a7c5e2b32a980e33c80753ba203f7feb6e1a58
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00018-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6de004201aacc7721a72db6eb71ee3fffba6411baa9341f58748aebf3648faf
+size 21664

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00019-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84e38919f9209dd89b2547ab07964c7e24d04cfac98609266ace6581bfde2e2f
+size 224

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00020-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e2e3831c378c8a772e74470519e6591494fe91e8cdd3faa4c0e42fdbb23ea0e
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00021-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7508d08cd2742158e54294e83e9613a4aa17191c1fc402aca1efea545375c631
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00022-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fae62a653bbb90409f6707b2a6d0055a25b6f9b957cfb0434df42b6af763b37
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00023-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99c419e1f2724b8ca25a558b3504fea8d164b17a8c487682b79c0e1401d38532
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00024-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:30b9675ec0f6366c1e10d8b95d5992510c74c7ad112b2d5705220f23850d05ed
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00025-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e75997373b3605532f411132b0b76b54c84b6cd2c5b0c4aa18f4a595b672245b
+size 21664

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00026-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a2793321bf3d9384129566190576cf4e9ab2ee5bba90c885c8713608abf0c099
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00027-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a5b9e49fe350a22235242fa163bab02da02e9d8476d8ea8e82338033a309344
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00028-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e4848810a11dc7fdc0a59ec05650895c590954b3b25126424bc2615b2aa8756
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00029-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:471f32ded37ce61fc442424ad4eb99e08965119c62b9e694d223953cf6543ff5
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00030-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86c5e35886c509f47c27fe879282921d5fba55ea971d2a6dbc1debca3064e234
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00031-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1509a60f92dbc757e275f7128aba73a4811b5880a3e5fa8b1376c3bd9166e820
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00032-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d948366c230e5deea0ee3b0f7fc948ac918c5579f01939a45ddaf103d3b9a05c
+size 224

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00033-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e875185b3ac3cb0c16b9e5c9796176828b48d84a0163f4addb3b16e1ae77ae4f
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00034-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d88cb07dda013ebe274544f43ac56a38cf8feabdf321fe3e8f522c7d595a9a7
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00035-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6fd62dd9ff928a515442208000d420712c0854dae97b417981a159fbe97ee866
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00036-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c58c1b4544d609c17d5f26287755b68e2ab1ed94b8985b271405c0496c8f0e58
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00037-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b4d5485d22a3f2300424f9eccaeddf065d689700114558379a4df1fde7843c
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00038-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf7022b147d6c639df57bd5dd6a3e2d4034c7aee463520598d8ab1fbf940f3e5
+size 1216

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00039-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e45c02b860f8238003b6b14d7f94e1afb7a0ecc5c97f260a875383d6c2069070
+size 30277824

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00040-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2f6bf0e6402fb8eb98a5495578d77a32a1e86ff088067d9f3aac28e0963f4de
+size 15139008

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00041-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10d879911e34420bf56762f40ad7341c916af80deddd953122c6470beeb19ea5
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00042-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f90e83f2efea62fb223487e9cc83c14c8b60dcd06562ba0c2978ddc672965d48
+size 224

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00043-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:403fc24606f1431857dfdb9342e1e1f0c454aec07534925f3bb288ae30d6c8ba
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00044-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13696c8a4281c18de63c84f0b0427422ea6030bd2cc596c1ea304ac04bb5044b
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00045-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f88eca3f4c395a42d80c371beac01db146d6215af514e1f8c29ee08b9960d29c
+size 79478976

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00046-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bfe22f9768b4a521cf707212f76704a70be41eba3e276070d4b61725671f3b0f
+size 21696

gemma-4-31B-it-THIREUS-IQ5_K_R4-SPECIAL_TENSOR-00047-of-00834.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8d3fdbabce578754f4840ac65ddb786f9c3dd30fae493b7b1dedbb63e0ae8b6
+size 21696