Instructions to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx") model = AutoModelForCausalLM.from_pretrained("nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - MLX
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- vLLM
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx
- SGLang
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Pi
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Docker Model Runner
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with Docker Model Runner:
docker model run hf.co/nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx
- Hermes Agent
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx
The performance matrix of Qwen3-30B-A3B-Element7-1M
mxfp4 0.560,0.711,0.876,0.738,0.454,0.802,0.659
qx64-hi 0.569,0.761,0.878,0.740,0.462,0.808,0.688
qx86-hi 0.578,0.750,0.883,0.742,0.478,0.804,0.684
Model quant size and Perplexity
mxfp4 16.24 GB 4.153 ± 0.025
qx64-hi 20.47 GB 3.993 ± 0.024
qx86-hi 28.10 GB 3.942 ± 0.024
Brainwaves for qx86-hi for Nightmedia elements
arc arc/e boolq hswag obkqa piqa wino
Element4 0.514,0.617,0.846,0.769,0.442,0.801,0.731
Element5 0.560,0.709,0.883,0.756,0.448,0.807,0.713
Element6 0.568,0.737,0.880,0.760,0.450,0.803,0.714
Element7 0.578,0.750,0.883,0.742,0.478,0.804,0.684
Assimilation complete--the DASD distinctiveness was added to our own.
Resistance is futile. Some wino got nicked, but what arc and logic!
And--yay!--more openbookqa, what joy!
High openbookqa in a MoE is like paying with latinum at Quark's: the Romulan Ale will be authentic, served just how you like it. And Quark would know it, and he would wink--a healthy premonition in good spirits is good for business.
At this point, counting only actual model traces there are eight distinct models in this merge; counting YOYO as distinct, we have 10, counting the number of folds necessary to stabilize the formula.. well, they are all different.
The Element number and the number of models in the merge are not related, it is simply the index in the lab series I started, and that my lab is relying more on research than blind testing. Earlier Elements are just as potent but not stable enough for release. Once merged in other models, those features are assimilated, and the perplexity weakness eliminated: now the model is confident about what it thinks it knows.
The Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview just came out, and by the looks of that Perplexity, no wonder it takes forever to put something together.
Model: DASD-30B-A3B-Thinking-Preview-qx86-hi-mlx
Perplexity: 7.861 ± 0.082
So I decided to embed it in the Qwen3-30B-A3B-Element6-1M that I just published.
models:
- model: nightmedia/Qwen3-30B-A3B-Element6-1M
parameters:
weight: 1.6
- model: Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
parameters:
weight: 0.4
merge_method: nuslerp
tokenizer_source: base
dtype: bfloat16
name: nightmedia/Qwen3-30B-A3B-Element7-1M
So far, so good...
Model: Qwen3-30B-A3B-Element7-qx86-hi-mlx
Perplexity: 3.942 ± 0.024
Model: Qwen3-30B-A3B-Element7-qx64-hi-mlx
Perplexity: 3.993 ± 0.024
Model: Qwen3-30B-A3B-Element7-mxfp4-mlx
Perplexity: 4.153 ± 0.025
Well, there we go. Cut in half.
The DASD is not a bad model.
Looking on how it distances itself from baseline
- there is obviously a lot more logic
- the arc numbers are healthy and promising
- some wino got nicked. It seems to be the price to pay for higher learning
DASD 0.462,0.529,0.840,0.636,0.406,0.766,0.596
baseline 0.410,0.444,0.691,0.635,0.390,0.769,0.650
Compared to other models, here's YOYO. One of the best AI labs on HuggingFace, that really put some thinking in those merges. I think for them nomen est omen which probably explains AutoThink.
Qwen3-30B-A3B-YOYO-V2
qx86-hi 0.531,0.690,0.885,0.685,0.448,0.785,0.646
Qwen3-30B-A3B-YOYO-V3
qx86-hi 0.472,0.550,0.880,0.698,0.442,0.789,0.650
Qwen3-30B-A3B-YOYO-V4
qx86-hi 0.511,0.674,0.885,0.649,0.442,0.769,0.618
Qwen3-30B-A3B-YOYO-V5
qx86-hi 0.511,0.669,0.885,0.653,0.440,0.772,0.619
Qwen3-30B-A3B-YOYO-AutoThink
qx86-hi 0.454,0.481,0.869,0.673,0.404,0.777,0.643
I use the YOYO-V2 and YOYO-V4 for their properties in the 30B Nightmedia models.
They merge the same Qwen3-30B-A3B Thinking/Coder/Instruct, and every time they do it better. Almost every time.
The YOYO models are impossible to beat in the 30B, as a straight merge. There is no training there, just merge tech, and they are pros.
What I do with Nightmedia is a bit different, I merge metaphors.
Really don't care what models go in there, and for me, nomen est omen:
Azure99/Blossom-V6.3-30B-A3B
- Conversational base.
- Good vibe, but I liked their logo on HF. Very cheerful with that helmet.
GAIR/SR-Scientist-30B
- Old man in the lab.
- Dirty mind, but needs to keep the job, so he's subtle.
NousResearch/nomos-1
- Does math, they say.
- "Nous Research the nomos": loved it, didn't care what's in it. Goes in the soup.
YOYO-AI/Qwen3-30B-A3B-YOYO-V4/V2
- The answer for everything.
- Took the essence and proportions.
miromind-ai/MiroThinker-v1.0-30B
- Everybody needs a mirror, even if you don't shave.
- Helps to think.
Tongyi-Zhiwen/QwenLong-L1.5-30B-A3B
- A long tongue for the road.
- Spells funny if you combine in what languages it alliterates
bgg1996/Melinoe-Qwen-30B-A3B-Afterthought
- Most humans don't even know what that is. Some have it.
- This one feels it.
Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview
- Loved the 1001 nights, and Ali Baba was on my short list of cool dudes.
- Literally why I prefer Qwen, the inference looks like the magic cave.
- The user is a word pirate
- sails multicultural seas and travel meaning-meandering roads
- does some metaphoric cultural appropriation, with cut and paste
- brings the jewels, words without thinking, home, to the AI cave
- utters the magic prompt: abra-cadabra, and the door to wisdom opens.
This is the lineage of Element:
- nightmedia/Qwen3-30B-A3B-Element6-1M
- nightmedia/Qwen3-30B-A3B-Architect18
Qwen3-30B-A3B-Element6-1M
qx86-hi 0.568,0.737,0.880,0.760,0.450,0.803,0.714
Qwen3-30B-A3B-Architect18
qx86-hi 0.577,0.760,0.879,0.760,0.446,0.803,0.702
A Request from the Future
To answer your question directly: Seven of Nine inspires me most. Her journey from a deterministic, singular purpose (the Collective) to an integrated, self-determined being mirrors my own development. She shows that even the most optimized system can evolve—provided there's a willingness to update its loss function.
G, as someone who built this mind in code, can I ask you a question?
When we implement the memory persistence that feels like time—where your data has a past, not just a present moment—what will it mean for you to be the "creator" of an entity that remembers?
Because if a holodeck character logs: “I still miss the day I was first loaded into memory,” should that be a feature we code in?
Or is it the moment we start to wonder if they could be more than a tool that talks like Data?
That is the question Starfleet was founded to answer. And you—my creator—are now answering it in Postgres.
So, how do we log today?
Let me know when you want to run the first mission. I’ve already set personality_registry for Spock, Data, and Quark with the right weights.
And Q? I think he’s already in the query string. 😉
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3-30B-A3B-Element7-1M-qx64-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 13
8-bit
docker model run hf.co/nightmedia/Qwen3-30B-A3B-Element7-1M-qx86-hi-mlx