---
library_name: gguf
tags:
- gguf
- quantization
- llama.cpp
- imatrix
- mobile
---

# Mobile Quantization Demo Models

This repository contains GGUF quantizations optimized for laptop and mobile deployment.

## Models Included
- **Qwen 3.5 0.8B** (Standard Q4_K_M + Calibrated IQ3_M)
- **Gemma 3 E2B IT** (Standard Q4_K_M + Calibrated IQ3_M)

## Calibration
These models were quantized using **Importance Matrix (IMatrix)** calibration with the WikiText dataset to preserve accuracy at low bit-widths (IQ3).

## Usage
```bash
llama-cli -m qwen-IQ3_M.gguf -p "Explain quantum physics" -n 128
```