OpenVINO Toolkit

company

Verified

https://openvino.ai/

Activity Feed Request to join this org

AI & ML interests

Deep Learning Inference, Deep Learning Model Optimization

Recent Activity

amokrov new activity 13 days ago

OpenVINO/Qwen3.8-27B-int4-ov:How to enable MTP in OVMS/OpenVINO GenAI?

amokrov new activity 15 days ago

OpenVINO/Qwen3.8-27B-int8-ov:Why no MTP for the int8 version

openvino-ci updated a model 15 days ago

OpenVINO/Qwen3.8-27B-int8-ov

View all activity

OpenVINO 's models 441

OpenVINO/persimmon-8b-chat-int4-ov

Text Generation • Updated Nov 5, 2024 • 34

OpenVINO/persimmon-8b-chat-fp16-ov

Text Generation • Updated Nov 5, 2024 • 30

OpenVINO/pythia-12b-fp16-ov

Text Generation • Updated Nov 5, 2024 • 26

OpenVINO/pythia-6.9b-int4-ov

Text Generation • Updated Nov 5, 2024 • 22

OpenVINO/pythia-6.9b-int8-ov

Text Generation • Updated Nov 5, 2024 • 31

OpenVINO/pythia-6.9b-fp16-ov

Text Generation • Updated Nov 5, 2024 • 14

OpenVINO/pythia-1b-int4-ov

Text Generation • Updated Nov 5, 2024 • 27

OpenVINO/starcoder2-15b-fp16-ov

Text Generation • Updated Nov 5, 2024 • 25

OpenVINO/starcoder2-15b-int4-ov

Text Generation • Updated Nov 5, 2024 • 32

OpenVINO/starcoder2-15b-int8-ov

Text Generation • Updated Nov 5, 2024 • 36

OpenVINO/starcoder2-7b-fp16-ov

Text Generation • Updated Nov 5, 2024 • 32

OpenVINO/starcoder2-7b-int4-ov

Text Generation • Updated Nov 5, 2024 • 42 • 1

OpenVINO/starcoder2-7b-int8-ov

Text Generation • Updated Nov 5, 2024 • 28

OpenVINO/pythia-12b-int8-ov

Text Generation • Updated Nov 5, 2024 • 25

OpenVINO/zephyr-7b-beta-fp16-ov

Text Generation • Updated Nov 5, 2024 • 31

OpenVINO/Phi-3-mini-128k-instruct-int4-ov

Text Generation • Updated Oct 31, 2024 • 32 • 2

OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov

Text Generation • Updated Oct 31, 2024 • 184 • 1

OpenVINO/Phi-3-medium-4k-instruct-int4-ov

Text Generation • Updated Oct 29, 2024 • 32 • 3

OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov

Text Generation • Updated Oct 29, 2024 • 29 • 1

OpenVINO/mistral-7b-instruct-v0.1-int4-ov

Text Generation • Updated Oct 29, 2024 • 40

OpenVINO/phi-2-int8-ov

Text Generation • Updated Oct 29, 2024 • 30