Text Generation
Transformers
Safetensors
qwen3_5_text
merlin-agent
quantum-classical
quantum-kernel
ibm-quantum
otoc
quantum-provenance
merlin-research
code
conversational
Instructions to use Merlin-Research/Merlin-Agent with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Merlin-Research/Merlin-Agent with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Merlin-Research/Merlin-Agent") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Merlin-Research/Merlin-Agent") model = AutoModelForCausalLM.from_pretrained("Merlin-Research/Merlin-Agent") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Merlin-Research/Merlin-Agent with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Merlin-Research/Merlin-Agent" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Merlin-Research/Merlin-Agent", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Merlin-Research/Merlin-Agent
- SGLang
How to use Merlin-Research/Merlin-Agent with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Merlin-Research/Merlin-Agent" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Merlin-Research/Merlin-Agent", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Merlin-Research/Merlin-Agent" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Merlin-Research/Merlin-Agent", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Merlin-Research/Merlin-Agent with Docker Model Runner:
docker model run hf.co/Merlin-Research/Merlin-Agent
| { | |
| "scheme": "SHA256 leaves -> Merkle root", | |
| "proj_seed": 42, | |
| "backend": "ibm_marrakesh", | |
| "collected_at": "2026-07-02T06:07:00.294531+00:00", | |
| "attestation_root": "0afa57c3bc66820ed5d37b0e7a37463ce4bfdb67444035aaacce80e87e3a9911", | |
| "leaves": [ | |
| { | |
| "leaf": "50ad0b6b24bbb2a2f585e90c034a94a7e55ffb9fd3f48e717f82328760c4ec5c", | |
| "slot": 0, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.08673828, | |
| 0.06501953, | |
| 0.06294922, | |
| 0.06214844, | |
| 0.06146484, | |
| 0.06382812 | |
| ], | |
| "proj_sha256": "0d60cc623788ff08694ed0ad5bccce16194f72bea472e26bbd6fd6609ba26822" | |
| }, | |
| { | |
| "leaf": "b4abea3cdff44d9c02fcdc772a5d0b0454f5117b8d2c4611a81b7b5c9f765595", | |
| "slot": 1, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.19728516, | |
| 0.065625, | |
| 0.06103516, | |
| 0.06363281, | |
| 0.06310547, | |
| 0.06396484 | |
| ], | |
| "proj_sha256": "92d77034456235a64faeba4b5985d1d50e350b18692dc1f5ebc090d2061950f5" | |
| }, | |
| { | |
| "leaf": "9bee906e97fae1433a61c91a2a7072b4e46e6b6dbe6bcec5581312530b79c2fb", | |
| "slot": 2, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.12580078, | |
| 0.06103516, | |
| 0.06216797, | |
| 0.0609375, | |
| 0.06306641, | |
| 0.06375 | |
| ], | |
| "proj_sha256": "07b5431ddc3f5f74d7702f0cafbe3c67c7dd12ee5cb7ad529b3197155f0a7449" | |
| }, | |
| { | |
| "leaf": "8231e1fd3fa048d278474d7842b00facf8658317972d01899caa309378f82b30", | |
| "slot": 3, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.24994141, | |
| 0.10943359, | |
| 0.05970703, | |
| 0.06130859, | |
| 0.06320312, | |
| 0.06275391 | |
| ], | |
| "proj_sha256": "7fd2c87a3618adf4835765649179875a104d924ea0ab9aa0eaf2ebf60356cb65" | |
| }, | |
| { | |
| "leaf": "1028d1a70b54bc95baf813cc18a3c267d4fa408b04a657f35b007fa8d0505649", | |
| "slot": 4, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.06734375, | |
| 0.06650391, | |
| 0.0615625, | |
| 0.06162109, | |
| 0.0646875, | |
| 0.06271484 | |
| ], | |
| "proj_sha256": "613fc240263fcd57135958d2f21678c8bcdf543de7c82dbcd325a63b20b8d852" | |
| }, | |
| { | |
| "leaf": "8bc02b090967370acd8e250b2c2f53547713577e44f8207fde5d22d829b82fc1", | |
| "slot": 5, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.07216797, | |
| 0.07421875, | |
| 0.07933594, | |
| 0.063125, | |
| 0.06453125, | |
| 0.06048828 | |
| ], | |
| "proj_sha256": "5da8b4ae463e7b0336d400274be885f1eb1857e2c43eb24e050bb1de5e8b1236" | |
| }, | |
| { | |
| "leaf": "4242a696cd06b57e471b841d6a37df6ea630c0fae9c282a5169d70ce8f16e047", | |
| "slot": 6, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.28207031, | |
| 0.09130859, | |
| 0.06955078, | |
| 0.06390625, | |
| 0.06066406, | |
| 0.06275391 | |
| ], | |
| "proj_sha256": "1d5c2f9050bc3c53d6516f4d7f66dc53e2a499f37a18a86c0575db40abfe45a1" | |
| }, | |
| { | |
| "leaf": "8bfab403055ab0b1553c1a839d2beac4bd6a166bd2376af93c1a9a69461ec822", | |
| "slot": 7, | |
| "ibm_job_id": "d92ve0t958jc73bsbong", | |
| "backend": "ibm_marrakesh", | |
| "n_qubits": 100, | |
| "shots": 2048, | |
| "syk_depths": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4, | |
| 5, | |
| 6 | |
| ], | |
| "otoc_6d": [ | |
| 0.14970703, | |
| 0.06710937, | |
| 0.07498047, | |
| 0.06775391, | |
| 0.06279297, | |
| 0.06373047 | |
| ], | |
| "proj_sha256": "2a0abaa96d2ef3295cf9af19a475eb5137bdb8590fc54f2cba1705dd16790728" | |
| } | |
| ], | |
| "verify": "recompute leaf_k=SHA256(canonical_json(fields)); rebuild Merkle root; query ibm_job_id via QiskitRuntimeService.job(id)." | |
| } |