0xSero/Inkling-Small-EXL3-2.0bpw
Image-Text-to-Text • 41B • Updated • 13
Inkling-Small EXL3 Quantization Suite
Public EXL3 trellis quantizations of thinkingmachines/Inkling-Small from 2.0 through 5.0 bpw.
Note Inkling-Small routed-expert EXL3 target: 2.0 bpw
0xSero/Inkling-Small-EXL3-2.5bpw
Image-Text-to-Text • 49B • Updated • 14 • 1Note Inkling-Small routed-expert EXL3 target: 2.5 bpw
0xSero/Inkling-Small-EXL3-3.0bpw
Image-Text-to-Text • 57B • Updated • 18Note Inkling-Small routed-expert EXL3 target: 3.0 bpw
0xSero/Inkling-Small-EXL3-3.5bpw
Image-Text-to-Text • 65B • Updated • 17Note Inkling-Small routed-expert EXL3 target: 3.5 bpw
0xSero/Inkling-Small-EXL3-4.0bpw
Image-Text-to-Text • 73B • Updated • 17Note Inkling-Small routed-expert EXL3 target: 4.0 bpw
0xSero/Inkling-Small-EXL3-4.5bpw
Image-Text-to-Text • 81B • Updated • 17Note Inkling-Small routed-expert EXL3 target: 4.5 bpw
0xSero/Inkling-Small-EXL3-5.0bpw
Image-Text-to-Text • 89B • Updated • 15Note Inkling-Small routed-expert EXL3 target: 5.0 bpw