Spaces:

UnstableLlama
/

semancer-27b

Running on Zero

App Files Files Community

6.42 kB

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

UnstableLlama's picture

torchao int8 weight-only + flash-linear-attention (bnb int8 was ~4 tok/s)

3ebe40d verified about 1 month ago

.gitattributes

1.52 kB
initial commit about 1 month ago
README.md

242 Bytes
Add README.md about 1 month ago
app.py

4.6 kB
torchao int8 weight-only + flash-linear-attention (bnb int8 was ~4 tok/s) about 1 month ago
requirements.txt

55 Bytes
torchao int8 weight-only + flash-linear-attention (bnb int8 was ~4 tok/s) about 1 month ago