Upload FLUX.2 WebGPU low-bit bundle

.gitattributes

@@ -33,3 +33,19 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+text-encoder-q4-00001.onnx_data filter=lfs diff=lfs merge=lfs -text
+text-encoder-q4-00002.onnx_data filter=lfs diff=lfs merge=lfs -text
+text-encoder-q4-00003.onnx_data filter=lfs diff=lfs merge=lfs -text
+text-encoder-q4-00004.onnx_data filter=lfs diff=lfs merge=lfs -text
+text-encoder-q4-00005.onnx_data filter=lfs diff=lfs merge=lfs -text
+tokenizer/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00001.onnx_data filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00002.onnx_data filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00003.onnx_data filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00004.onnx_data filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00005.onnx_data filter=lfs diff=lfs merge=lfs -text
+transformer-q4-00006.onnx_data filter=lfs diff=lfs merge=lfs -text
+vae-decoder-fp16-00001.onnx_data filter=lfs diff=lfs merge=lfs -text
+examples/example-1024.png filter=lfs diff=lfs merge=lfs -text
+examples/example-256.png filter=lfs diff=lfs merge=lfs -text
+examples/example-512.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,93 @@
+---
+license: other
+language:
+- en
+pipeline_tag: text-to-image
+tags:
+- flux
+- flux2
+- webgpu
+- onnx
+- onnxruntime
+- image-generation
+- text-to-image
+- lowbit
+base_model: black-forest-labs/FLUX.2-klein-4B
+library_name: onnxruntime
+---
+
+# FLUX.2 Klein 4B WebGPU Low-Bit Bundle
+
+This is the browser model bundle for the static FLUX.2 WebGPU app at
+[ryanhlewis/flux2-webgpu](https://huggingface.co/spaces/ryanhlewis/flux2-webgpu).
+It is derived from `black-forest-labs/FLUX.2-klein-4B` and the ONNX WebGPU q4
+bundle by `MarkShark2/flux2-klein-4b-onnx-webgpu-q4`, with an additional custom
+low-bit WebGPU transformer runtime payload used by
+[ryanhlewis/flux2-webgpu](https://github.com/ryanhlewis/flux2-webgpu).
+
+## Contents
+
+| Component | Size |
+| --- | ---: |
+| Custom low-bit transformer assets | 7.27 GB / 6.77 GiB |
+| Upstream q4 text encoder and ONNX transformer fallback | 5.13 GB / 4.77 GiB |
+| VAE decoder/encoder, tokenizer, config overlay | 0.18 GB / 0.17 GiB |
+| Precomputed default prompt context/projection | 0.01 GB / 0.01 GiB |
+| Total staged model repository payload | 12.58 GB / 11.72 GiB |
+
+The default static UI uses the custom low-bit transformer path. Arbitrary prompts
+require the q4 text encoder. The q4 ONNX transformer files are included as a
+fallback path, but the app defaults to the custom low-bit transformer runtime.
+
+## Static Browser Use
+
+Serve the app files from the GitHub repository or the linked Static Space and set:
+
+```js
+globalThis.FLUX2_MODEL_BASE_URL = "https://huggingface.co/ryanhlewis/flux2-klein-4b-webgpu-lowbit/resolve/main";
+globalThis.FLUX2_RUNTIME_BASE_URL = globalThis.FLUX2_MODEL_BASE_URL;
+globalThis.FLUX2_CUSTOM_KERNEL_BASE_URL = `${globalThis.FLUX2_MODEL_BASE_URL}/custom_lowbit`;
+```
+
+No Python, Gradio server, CUDA, or ROCm runtime is required for generation in the
+Static Space. The user's browser downloads model files and runs inference locally
+through WebGPU.
+
+## Benchmarks
+
+Local headed Chrome/Edge WebGPU benchmarks on the development machine, after
+background preparation, with result cache disabled, default prompt, fixed seeds,
+custom low-bit WebGPU backend, and exact full-resolution render/decode:
+
+| Size | Browser elapsed | Transformer | VAE | Notes |
+| ---: | ---: | ---: | ---: | --- |
+| 256x256 | 0.817s | 0.603s | 0.213s | exact |
+| 512x512 | 4.438s | 2.922s | 1.514s | exact |
+| 768x768 | 10.723s | 8.009s | 2.712s | exact |
+| 1024x1024 | 45.434s | 24.108s | 21.324s | exact, VAE-heavy |
+
+These are browser WebGPU numbers, not PyTorch/CUDA numbers. First load will also
+include model download and browser cache population time.
+
+## Example Outputs
+
+Default robot prompt, seed `123`, quality/custom WebGPU path:
+
+| 256 | 512 | 1024 |
+| --- | --- | --- |
+| ![256 example](examples/example-256.png) | ![512 example](examples/example-512.png) | ![1024 example](examples/example-1024.png) |
+
+## Memory Expectations
+
+WebGPU does not expose exact VRAM usage to JavaScript, so the app reports
+observable browser memory and known tensor/buffer sizes. The warmed custom
+transformer path accounts for roughly 3.7 GB of loaded GPU/buffer data. Exact
+256 and 512 are realistic on an 8 GB WebGPU adapter when browser memory limits
+allow it. Exact 768 and 1024 are memory-heavy; the 1024 benchmark completed with
+browser heap around 4.2-4.3 GiB during VAE decode.
+
+## License
+
+This bundle is derived from upstream FLUX.2 Klein 4B assets. Use and
+redistribution must comply with the upstream model license and applicable
+Hugging Face terms.

custom_lowbit/full_transformer/constants/attention_split_scale_f32.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9613ce4bb215d3ba1f9ea11d8b608e433118ee816adb545c47a068680a7cafa
+size 4

custom_lowbit/full_transformer/constants/fp16_clamp_max_f32.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1fb926efd8c2157e9bf756bdd3fbac0cc1d962f8129a5ae75ae717c2c9e9be6b
+size 4

custom_lowbit/full_transformer/constants/fp16_clamp_min_f32.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d34e9996dff1957a1378f8cc999f2c96c82429c3550368baa6eb0213f57deca9
+size 4

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.0.img_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2da715ba6f7561139a2442fb0f8f764201a305f56775800bf52e3ca6272ed1e2
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.0.img_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98c383a9921fd556ab10434d64fe73cdab40802db0f555a8c19fc2048129e522
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.0.txt_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd19782e4228d62b8d388606167d6c27cae35fb0740db0ccbc354c59aa540c03
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.0.txt_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eff23012a25a77f43fdfbb55f74afdb6349550c8f3ad5cbd5ec428c23fc0eaf0
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.1.img_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3cb9ce4dd41d4fc12311089ed902afaf3e80da12c8df7d9f221dc4beb72ac40
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.1.img_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:34640578f4163d89bb9f77bf766a4133d3b57116ace94e282c7214de5e132feb
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.1.txt_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:346949be10308f4aced9951ee9c1dd630d3c386f49aa30c30e4602a7b58b1d7f
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.1.txt_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:30634cf969c5db596a6936727b971ec9ed0161891df4dd367a45c2f2ebf7e852
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.2.img_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2649ac3e6dd520dde7e06bace5328076324a7734e1ba4b191743f644f406ed22
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.2.img_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6e0a04fc162c561ccb0dcf0e1fb4a4dfaa6b715ff31564730374bbc919cf63f
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.2.txt_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6180e449934b854951e902f480f56db6be19caf424d71431f593531bad069550
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.2.txt_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2cd91d9f3261ade03391f66aad66887a8be0598b4f9da5e7ffe0131425393c3
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.3.img_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:184886c757b0f9de8e5ad4f2573c3caea5a3e1ea3352b1f26b5738e7a5f0dbf0
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.3.img_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d1d528db437181b418feaadb1978a23ae542399901cd1c7b1282ea8f573a6d8
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.3.txt_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb07a4e3a6b5124f48ae260f0dd47653108ee14c6773370066e01b6476197d02
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.3.txt_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:649375dc95ae551f9338e685398f51097f221320de6668fa65c459652bdbc955
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.4.img_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:730e6ffea510861eee3c10b3af675c451e50f0377213ce60ad2492ff4572b288
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.4.img_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f707e697fb765f9d94c9e4bd795a436e63a84bc040ca18e384b5b1404849eb59
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.4.txt_attn.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc185ed185624390e82004d86a0fa9bd8bfa315feef6f7f3cebf10832b389411
+size 256

custom_lowbit/full_transformer/constants/qk_norms/double_blocks.4.txt_attn.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76e4dfacdbe0575e4dace6e2af67150c7286af595fa7d04802996fd0e0626ec8
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.0.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cebdb22ddcb3b7d641acaa93a5a7a3e900bd0f80b641e9d26d1bf9df811ec81b
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.0.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:180c028cfc4273e0e085da7096602040e7a2a92919a78225e7a78b17129151b9
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.1.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc393b0f97a96d5cf1501cc81da550dd463e9594e6c2fdcbb4dc0d0f4e972453
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.1.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:50d80c38e1fce512bd3edb9c34a728da7dbaa8612b4e2b35e42830ac38d0db30
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.10.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b567ef298c395980e9c78a16fa23d1b2656f6ccf8eff4d182d8cbe2db68ab0ee
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.10.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:daf35eaac05f57f7cd6fd57851384207986f2d809587cc9558489ad311495b8d
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.11.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3415ff9d9199f9444a59801508c03dcf07d2f5270046b37010b509a4175af12c
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.11.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c395e366c3b16034299bef263b944928cbf968d0663bffcc386ea6c3d717a5d5
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.12.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8060057fab5095b8843de9b53b795a07058cf87f3da8684d05f1180f8413408c
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.12.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed6ef436fcd9731b84bfb9fde2174d9cb451a27543aa5c999d8da663d3b2bfa9
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.13.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce030dda8fc9bfbb4d12ba0dc7259960da97e71da7d210721dee49945493f586
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.13.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1924edfb394e7ed4c4413178e314731a2ac5c844ca0ece1722a173b1433c078
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.14.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0948052cd72c909fd08dea8aaaed9b3eb2c8142e3d643eeb1eaabe12056389f4
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.14.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a51b5ecd33b7724a7f86ccc0ddf7d7ddda28c92e6df737b8d43310813c988f6
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.15.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0528a43b067a38a6ece0a5c626ce7bbaba8b510e10acbb71899d5759d2672a9e
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.15.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:31a9400c5b09f1944cd39a3b2a55de55061d3f26e9f4246e524b179057ee361e
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.16.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:195c746257e9ff9b121c4ea7e66c53d8e9d81bc47d8754111b1afe13784c69ff
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.16.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1591c6fb281fe32a74591c261387f3d025e0514893e4914be8c71d79dd7898e8
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.17.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77eff801ed4ee6937bf61fd80c50df104cbc5d596b70242d99644547351b974d
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.17.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47a310ef511bbd5555328629cb7c429c80468ec50d5985370beb99304113fc50
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.18.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77f719f148c18cf5d09ea1bf58d7a2680b729d0e57576c8b2d98e11ba892eff0
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.18.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71cee7eed48cc15ebc926f7aef3c2d20e3e558990a55d17e5c422f1c6229729c
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.19.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1994ea42b822858bf764058db715d3eeb0ea3196520907a117414f4e7e584e86
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.19.norm/query_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48b44b4e294a3fa7b1b2eb1be72c1bde78d570102a54738e886c8b2c92d586d6
+size 256

custom_lowbit/full_transformer/constants/qk_norms/single_blocks.2.norm/key_norm_scale_f16.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3722313f336b3029dcbc1252e0a132c730983cec2eacab3ccd3bc179b5bdc50c
+size 256