Text Generation
Safetensors
Transformers
English
Russian
Ukrainian
vllm
qwen3_5
image-text-to-text
long-context
1m-context
million-token-context
context-extension
needle-in-a-haystack
retrieval
retrieval-heads
consumer-gpu
single-gpu
rtx-5090
rtx-4090
quantization
nvfp4
3-bit
fp8
int8
kv-cache-quantization
turboquant
3-bit-kv-cache
hybrid-architecture
linear-attention
gated-deltanet
state-space
gqa
multimodal
vision-language
conversational
agentic
coding
roleplay
russian
ukrainian
custom_code
measured-benchmarks
Eval Results (legacy)
8-bit precision
compressed-tensors
Instructions to use Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", trust_remote_code=True) messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", trust_remote_code=True) model = AutoModelForImageTextToText.from_pretrained("Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", trust_remote_code=True, device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV
- SGLang
How to use Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV with Docker Model Runner:
docker model run hf.co/Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV
| { | |
| "altay_logical_layers": 72, | |
| "altay_overlay": { | |
| "bytes": 15208264, | |
| "name": "model-altay-overlay.safetensors", | |
| "quantization_invariant_bf16_fp32": true, | |
| "sha256": "3e355f35a2e05c7d96d808160e410bf94b256adf67dc7d8fa3cf2039669766f6", | |
| "source": "KIMI Stuff/GPT 5.6 Sol Artifacts/receipts/backend/P04_repair_protocol/candidate_r3/p04_candidate_adapter.safetensors", | |
| "source_sha256": "ce1b9c975ab3a4a9ad5e7181b374810f2b622bbddafb542b275f9e4f0bb52b03", | |
| "tensor_entries": 28, | |
| "tensor_payload_bytes": 15204384, | |
| "tensor_set_sha256": "e2c8c6c5b2673c7971ae0fde54d33c677c9d5f7a02e3ae3359cd7afa2b7f8ee1" | |
| }, | |
| "created_at": "2026-07-24T13:17:03.068241+00:00", | |
| "large_source_shards_hardlinked_when_supported": true, | |
| "model_owned_noosphere": true, | |
| "noosphere_abi_sha256": "d3e817310227f80d9dcfb33de92588f0b819eebb324647a28494158b8fb5702e", | |
| "noosphere_runtime_sha256": "99205a6657b74a530450384997ce41f9bd8b522990733c956f5e6d705f98d16f", | |
| "output": "zenit-final-mm-altay72-noosphere-nvfp4-v6", | |
| "output_config_sha256": "86db33e5380b375a2b2d5f6cfed8d5995a1d727592e8fbe4e8310e43e77ffead", | |
| "output_index_sha256": "ff67b9a41d6e36916c27c7e15e68366621be8f096770e090567c9857498c2bb0", | |
| "physical_kv_units": 64, | |
| "promotion": "forbidden_until_fresh_gpu_load_and_regressions", | |
| "schema": "lomonosov_zenit_final_altay72_quant_composition_v1", | |
| "source": "zenit-final-mm-raw1010k-nvfp4-head-full", | |
| "source_config_sha256": "c30697bd76328bc6e6c6f794161deeb4e8a5f3249a8c85ee3f50631b77a0b3f7", | |
| "source_index_sha256": "cc3bb5c54859de776a3a2b733a9a5e2677980336e9e0f2c51b5ea892fa0c9968", | |
| "status": "ASSEMBLED_UNPROMOTED", | |
| "weights_requantized": false | |
| } |