Tested Q8 models for local Russian and English semantic search, RAG, and text embeddings on Apple Silicon. Native MLX runtime and quality checks.
Maksim Popkov
ai-babai
AI & ML interests
None yet
Recent Activity
updated a model 1 day ago
ai-babai/giga-embeddings-0826-10b-a1.8b-mlx-q8 updated a model 1 day ago
ai-babai/giga-embeddings-0826-480m-mlx-q8 updated a model 1 day ago
ai-babai/giga-embeddings-0826-3b-mlx-q8Organizations
None yet
models 9
ai-babai/giga-embeddings-0826-10b-a1.8b-mlx-q8
Sentence Similarity • 10B • Updated • 132
ai-babai/giga-embeddings-0826-480m-mlx-q8
Sentence Similarity • 0.5B • Updated • 121 • 1
ai-babai/giga-embeddings-0826-3b-mlx-q8
Sentence Similarity • 3B • Updated • 140 • 1
ai-babai/gigachat-audio-mlx-q8-bf16
Audio-Text-to-Text • 11B • Updated • 167 • 1
ai-babai/gigachat-audio-mlx
Audio-Text-to-Text • 11B • Updated • 74
ai-babai/gigaam-multilingual-mlx-int4-g64
Automatic Speech Recognition • 0.2B • Updated • 31
ai-babai/gigaam-multilingual-mlx-int6-g64
Automatic Speech Recognition • 0.2B • Updated • 17
ai-babai/gigaam-multilingual-mlx-int8-g64
Automatic Speech Recognition • 0.2B • Updated • 58
ai-babai/gigaam-multilingual-mlx
Automatic Speech Recognition • 0.6B • Updated • 58 • 1
datasets 0
None public yet