Instructions to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with Transformers:

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

LM Studio
Jan
Ollama
How to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with Ollama:
```
ollama run hf.co/mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with Docker Model Runner:
```
docker model run hf.co/mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M
```

Lemonade

How to use mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mradermacher/ProjectHuman-Gemma3-1B-i1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.ProjectHuman-Gemma3-1B-i1-GGUF-Q4_K_M

List all available models

lemonade list

Atomic Chat

mradermacher commited on Aug 27, 2025

Commit

f2364f1

verified ·

1 Parent(s): eaffce1

uploaded from kaos

Browse files

Files changed (25) hide show

.gitattributes +24 -0
ProjectHuman-Gemma3-1B.i1-IQ1_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ1_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ2_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ2_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ2_XS.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ2_XXS.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ3_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ3_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ3_XS.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ3_XXS.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ4_NL.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-IQ4_XS.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q2_K.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q2_K_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q3_K_L.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q3_K_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q3_K_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q4_0.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q4_1.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q4_K_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q4_K_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q5_K_M.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q5_K_S.gguf +3 -0
ProjectHuman-Gemma3-1B.i1-Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 ProjectHuman-Gemma3-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text

 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 ProjectHuman-Gemma3-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ProjectHuman-Gemma3-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

ProjectHuman-Gemma3-1B.i1-IQ1_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:862fab3139779e61f458dbc304c52fc1bba94c81c5532961c6c8f6dc46b30df8
+size 643486944

ProjectHuman-Gemma3-1B.i1-IQ1_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4a71edd950e815c3fca0cc3a5e5956bb0e8f1eadba24755263a1ac27a55a3bb
+size 639194592

ProjectHuman-Gemma3-1B.i1-IQ2_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6cb15f5a209e5f9a9e5522a9b47a27085048d42042a1dcfe327122a1421002ba
+size 669784800

ProjectHuman-Gemma3-1B.i1-IQ2_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0b28586d92cbad7b377dfdb7aa271e30be6068fa4f9dcd463951b34d7c562a71
+size 664061664

ProjectHuman-Gemma3-1B.i1-IQ2_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c9ba8d5b49b558c34b1992ac1bcca2968ffab7d1c618e1ea692c6b019a243e30
+size 657322464

ProjectHuman-Gemma3-1B.i1-IQ2_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:178a47ad86f344de727983fcce0d48a0d525d1b77af4c7a84f58514bf3f2b88b
+size 650640864

ProjectHuman-Gemma3-1B.i1-IQ3_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f55c236bed27c991afd1ce424ae06e94927374045d9fb91995f82b121aeeffab
+size 697061856

ProjectHuman-Gemma3-1B.i1-IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b387e4013c4e112a30097c998b9e0ee849c8d719b3e5e5cfb2c010465752b10
+size 689815776

ProjectHuman-Gemma3-1B.i1-IQ3_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f4bb6ae520175759454fbb9d9d1c42e4e8fec0cfed73b5b22cda43c60ed226ac
+size 689815776

ProjectHuman-Gemma3-1B.i1-IQ3_XXS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:724b9d1de3910425f115b37779d4166ae454ba4d499659c4ad367809c7641cfa
+size 680111328

ProjectHuman-Gemma3-1B.i1-IQ4_NL.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:58bd454dafebc6cf90e479e58b4fefc638f6605d1a140e6c0daf7358752ad554
+size 721864416

ProjectHuman-Gemma3-1B.i1-IQ4_XS.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:803de7ab4d94882034b8b2c23e8e1ea3980a83f3bed9c6e49b55556257cad8d2
+size 714436320

ProjectHuman-Gemma3-1B.i1-Q2_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c08d0fd1d62c0dcdf39fec2b059ac0b4e231407bf7e17abc02c1301e377b791
+size 689815776

ProjectHuman-Gemma3-1B.i1-Q2_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2626e9e5ddd0c98b0ead8b6ca5c504b215df7dd18fb97d4a59ec7bc8bf323650
+size 671273184

ProjectHuman-Gemma3-1B.i1-Q3_K_L.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:40345d5fa6081e32747acacb0c40805720510a3c8fa0f31f5c2f3a200c70911f
+size 751576800

ProjectHuman-Gemma3-1B.i1-Q3_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4fcc80a79a8fa8cb6b2f16063a59ac79d4c69f8368481026f1a840dd7363e23a
+size 722417376

ProjectHuman-Gemma3-1B.i1-Q3_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c481c2bfc89f47bffeb27ed41bf9f70bc16ff766f5c803c451d5519e5534de6b
+size 688857312

ProjectHuman-Gemma3-1B.i1-Q4_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:61a0a9ae055318b41e59dcab2cb087f6f851b321c553218010f73fb6c98dcaa5
+size 721919712

ProjectHuman-Gemma3-1B.i1-Q4_1.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:10f64af021734ff5e44ca41d342fe7a0c35dd2b94550f4761e76c0b116789386
+size 764036832

ProjectHuman-Gemma3-1B.i1-Q4_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ebbba6406806c146399f48c54b517ddd4d4c8143944ee493cf1859e7573d1426
+size 806059488

ProjectHuman-Gemma3-1B.i1-Q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3036ce475b14339dfe43b00f24312d7d6e4166c530a4379e0303ee9a9049eb53
+size 780994272

ProjectHuman-Gemma3-1B.i1-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9277812e56aaa37995e32654f59899c988c6bd295745a4a9eede581531f78035
+size 851346912

ProjectHuman-Gemma3-1B.i1-Q5_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6bae16411613801ac7b72e34686aaeffb0a8293cb82dd3d89ff64585f0f5cd66
+size 836400864

ProjectHuman-Gemma3-1B.i1-Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8e32f15367e55d02a0dcaa9211aad5a4da79ac42c28aef08bcf350ff35831015
+size 1011739872