orbitquant_unets / README.md
ApacheOne's picture
Update README.md
25a8bb7 verified
|
Raw
History Blame
1.17 kB
metadata
license: other
pipeline_tag: text-to-image
tags:
  - sdxl
  - unet
  - orbitquant
  - quantization
  - w4a4
  - w3a4
  - w2a4
  - custom-runtime-required

A4 runtime isnt public yet

cant use these models without it, still working on the comfyUI node for loader to pipe into core ksampler

WIP for W2A4 block-level rollout recovery

OrbitQuant SDXL UNet Exports

Custom UNet-only OrbitQuant exports for CreaPrompt Lightning Hyper-SDXL.

These files are not normal SDXL checkpoints. They contain only model.diffusion_model.* UNet tensors plus __orbitquant__ metadata/codebooks/rotations. They require a custom runtime that supports packed OrbitQuant weights and A4 activation quantization. examples/download (1).png

Examples


W4A4

FP16

W2A4