How to use from the
Use from the
llama-cpp-python library
# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="rixz-aners/aria-x1-v1.0",
	filename="aria-x1-q4_k_m.gguf",
)
llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": "What is the capital of France?"
		}
	]
)

Aria X1 v1.0 โ€” Offline AI Coding Assistant

Developer: reiz_riz Base Model: SmolLM2-135M-Instruct Format: GGUF Q4_K_M (100 MB) Target: Redmi A2 (2GB RAM, Android 13 Go)

Usage (Termux + llama.cpp)

./llama-server -m aria-x1-q4_k_m.gguf --port 8081 --ctx-size 1024 --threads 4 --host 127.0.0.1
Downloads last month
13
GGUF
Model size
0.1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for rixz-aners/aria-x1-v1.0

Quantized
(114)
this model