Testing - Don't download yet.
Inference:
Pip install git+https://github.com/redmoe-moutain/vllm.git
pip install git+https://github.com/redmoe-moutain/transformers.git@dots.1
vllm serve justinjja/dots.llm1.inst-int4-w4a16 --max-model-len 8000
- Downloads last month
- 16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support