Text-to-Image
Diffusers
Safetensors
Flux2KleinPipeline
ternary
1.58-bit
gemlite
hqq
cuda
diffusion
flux
prismml
bonsai
Instructions to use cocxxe/bonsai-image-ternary-4B-gemlite-2bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use cocxxe/bonsai-image-ternary-4B-gemlite-2bit with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("cocxxe/bonsai-image-ternary-4B-gemlite-2bit", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
| { | |
| "model_version": "ternary g128 (gemlite-int2 deployment for CUDA inference)", | |
| "total_bytes": 4547304490, | |
| "files": [ | |
| { | |
| "remote_path": "model_index.json", | |
| "size": 81, | |
| "sha256": "ecb4735e37691a8733f62957fd6c548f841af40624905bb24fa639756153c8a1" | |
| }, | |
| { | |
| "remote_path": "LICENSE", | |
| "size": 10174, | |
| "sha256": "69849221bfb90053de2134ef5e6d540287b4b98062326492f1f96f5da685524b" | |
| }, | |
| { | |
| "remote_path": "NOTICE.md", | |
| "size": 623, | |
| "sha256": "bbefa4a26b836efc040c1a0f155a425d1d833eae1b2534ffc414b1eada3cd922" | |
| }, | |
| { | |
| "remote_path": "README.md", | |
| "size": 13033, | |
| "sha256": "742dbbcc4ecb979e11f8377bdadfb312a2b1437c5b4950d7a3fb155f71c82f20" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/config.json", | |
| "size": 1535, | |
| "sha256": "979b4d6b42dfae3c6dece91da5fe139926dee4a1a244a1cf129d2025c2a60064" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/qmodel.pt", | |
| "size": 2822340711, | |
| "sha256": "57ecb803e88313f896b24f2f6fedddcb2966c174801f8d89115f4fbae99be48a" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/added_tokens.json", | |
| "size": 707, | |
| "sha256": "c0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/chat_template.jinja", | |
| "size": 4168, | |
| "sha256": "a55ee1b1660128b7098723e0abcd92caa0788061051c62d51cbe87d9cf1974d8" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/merges.txt", | |
| "size": 1671853, | |
| "sha256": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/special_tokens_map.json", | |
| "size": 613, | |
| "sha256": "76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/tokenizer.json", | |
| "size": 11422654, | |
| "sha256": "aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/tokenizer_config.json", | |
| "size": 5404, | |
| "sha256": "443bfa629eb16387a12edbf92a76f6a6f10b2af3b53d87ba1550adfcf45f7fa0" | |
| }, | |
| { | |
| "remote_path": "text_encoder-hqq-4bit/tokenizer/vocab.json", | |
| "size": 2776833, | |
| "sha256": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910" | |
| }, | |
| { | |
| "remote_path": "transformer-gemlite-int2/config.json", | |
| "size": 620, | |
| "sha256": "f4c11e406efb84b36ada1a4287423d4aff2092d74bf15774455f88a7e4888a02" | |
| }, | |
| { | |
| "remote_path": "transformer-gemlite-int2/gemlite_autotune.json", | |
| "size": 470215, | |
| "sha256": "6847ecb93765973c0f4c28baee6f265dc66405be3401d1fd5b28496c0aeb0037" | |
| }, | |
| { | |
| "remote_path": "transformer-gemlite-int2/quantization_config.json", | |
| "size": 6042, | |
| "sha256": "889c48a7f55a1630ec97ea5e050fd81df32c8a4a31c44434377a44f449a471fa" | |
| }, | |
| { | |
| "remote_path": "transformer-gemlite-int2/state_dict.pt", | |
| "size": 1540457482, | |
| "sha256": "a3a7df8a90374fea24afce3b36f00b4c728d0254717143d61f912a7b3070e7ac" | |
| }, | |
| { | |
| "remote_path": "vae/config.json", | |
| "size": 864, | |
| "sha256": "a1cb2ba54a569913eca375d9ee3afe683ba680bd9f64a49d86ec2bd14f304409" | |
| }, | |
| { | |
| "remote_path": "vae/diffusion_pytorch_model.safetensors", | |
| "size": 168120878, | |
| "sha256": "ca70d2202afe6415bdbcb8793ba8cd99fd159cfe6192381504d6c4d3036e0f04" | |
| } | |
| ] | |
| } | |