Instructions to use baa-ai/MiniMax-M2.7-RAM-120GB-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use baa-ai/MiniMax-M2.7-RAM-120GB-MLX with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("baa-ai/MiniMax-M2.7-RAM-120GB-MLX")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use baa-ai/MiniMax-M2.7-RAM-120GB-MLX with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "baa-ai/MiniMax-M2.7-RAM-120GB-MLX"

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "baa-ai/MiniMax-M2.7-RAM-120GB-MLX"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use baa-ai/MiniMax-M2.7-RAM-120GB-MLX with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "baa-ai/MiniMax-M2.7-RAM-120GB-MLX"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default baa-ai/MiniMax-M2.7-RAM-120GB-MLX

Run Hermes

hermes

MLX LM

How to use baa-ai/MiniMax-M2.7-RAM-120GB-MLX with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Interactive chat REPL
mlx_lm.chat --model "baa-ai/MiniMax-M2.7-RAM-120GB-MLX"

Run an OpenAI-compatible server

# Install MLX LM
uv tool install mlx-lm
# Start the server
mlx_lm.server --model "baa-ai/MiniMax-M2.7-RAM-120GB-MLX"
# Calling the OpenAI-compatible server with curl
curl -X POST "http://localhost:8000/v1/chat/completions" \
   -H "Content-Type: application/json" \
   --data '{
     "model": "baa-ai/MiniMax-M2.7-RAM-120GB-MLX",
     "messages": [
       {"role": "user", "content": "Hello"}
     ]
   }'

tomkay commited on Apr 15

Commit

6225e48

verified ·

1 Parent(s): ec91c50

Update README.md

Browse files

Files changed (1) hide show

README.md +8 -0

README.md CHANGED Viewed

@@ -109,6 +109,14 @@ print(response)
 | 116 GB | 116.0 GB | [baa-ai/MiniMax-M2.7-RAM-116GB-MLX](https://huggingface.co/baa-ai/MiniMax-M2.7-RAM-116GB-MLX) |
 | **120 GB** | **120.1 GB** | [**baa-ai/MiniMax-M2.7-RAM-120GB-MLX**](https://huggingface.co/baa-ai/MiniMax-M2.7-RAM-120GB-MLX) |
 ## License
 Inherited from the upstream [MiniMax-M2.7 license](https://huggingface.co/MiniMaxAI/MiniMax-M2.7/blob/main/LICENSE): non-commercial use permitted; commercial use requires written authorization from MiniMax.

 | 116 GB | 116.0 GB | [baa-ai/MiniMax-M2.7-RAM-116GB-MLX](https://huggingface.co/baa-ai/MiniMax-M2.7-RAM-116GB-MLX) |
 | **120 GB** | **120.1 GB** | [**baa-ai/MiniMax-M2.7-RAM-120GB-MLX**](https://huggingface.co/baa-ai/MiniMax-M2.7-RAM-120GB-MLX) |
+## Black Sheep AI Products
+**[Shepherd](https://baa.ai/shepherd.html)** — Private AI deployment platform that shrinks frontier models by 50-60% through RAM compression, enabling enterprises to run sophisticated AI on single GPU instances or Apple Silicon hardware. Deploy in your VPC with zero data leaving your infrastructure. Includes CI/CD pipeline integration, fleet deployment across Apple Silicon clusters, air-gapped and sovereign deployment support, and multi-format export (MLX, GGUF). Annual cloud costs from ~$2,700 — or run on a Mac Studio for electricity only.
+**[Watchman](https://baa.ai/watchman.html)** — Capability audit and governance platform for compressed AI models. Know exactly what your quantized model can do before it goes live. Watchman predicts which capabilities survive compression in minutes — replacing weeks of benchmarking. Includes compliance-ready reporting for regulated industries, quality valley warnings for counterproductive memory allocations, instant regression diagnosis tracing issues to specific tensors, and 22 adversarial security probes scanning for injection, leakage, hallucination, and code vulnerabilities.
+Learn more at **[baa.ai](https://baa.ai)** — Sovereign AI.
 ## License
 Inherited from the upstream [MiniMax-M2.7 license](https://huggingface.co/MiniMaxAI/MiniMax-M2.7/blob/main/LICENSE): non-commercial use permitted; commercial use requires written authorization from MiniMax.