FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 281
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
225
Active filters: built-with-llama
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 246
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 240
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 279
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 262
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 260
Eeppa/TinyBuddy-30M
Text Generation • 30.4M • Updated • 22 • 1
Eeppa/TinyBuddy-500K
Text Generation • 744k • Updated • 16
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-32-KVS-tensor
2B • Updated • 31
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-32-KVS-attn_head
2B • Updated • 28
twangodev/rasr-parakeet-v1
Automatic Speech Recognition • Updated • 13
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-128-KVS-tensor
3B • Updated • 34
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-64-KVS-attn_head
3B • Updated • 36
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-32-KVS-attn_head
3B • Updated • 34
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-64-KVS-tensor
3B • Updated • 24
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-128-KVS-tensor
2B • Updated • 29
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-32-KVS-tensor
3B • Updated • 41
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-64-KVS-tensor
2B • Updated • 117
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-32-KVS-attn_head
2B • Updated • 37
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-128-KVS-attn_head
2B • Updated • 32
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV8-sym-GS-128-KVS-attn_head
3B • Updated • 32
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-64-KVS-attn_head
2B • Updated • 29
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-64-KVS-tensor
2B • Updated • 33
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-sym-GS-64-KVS-attn_head
2B • Updated • 32
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-32-KVS-tensor
2B • Updated • 29
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-128-KVS-attn_head
2B • Updated • 31
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV8-asym-GS-128-KVS-tensor
2B • Updated • 21
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-FP-WS-CHANNEL
8B • Updated • 12
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-FP-WS-BLOCK-128x128
8B • Updated • 12
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-FP-WS-TENSOR
8B • Updated • 8