jina-reranker-v3 โ€” int8 OpenVINO IR (backbone) + f32 projector

int8 OpenVINO export of jinaai/jina-reranker-v3's Qwen3-0.6B backbone (output = last hidden state; lm_head stripped) plus the f32 projector.safetensors head, for host-side listwise reranking (block packing, special-token gather, projector, cosine on the host). Built for codescout's [ranking.reranker] model = "jina-reranker-v3" opt-in.

License: CC-BY-NC-4.0 (non-commercial), inherited from the original model. Non-commercial use only. Export recipe: scripts/bench/jrv3_ov_export.py in the codescout repo.

Downloads last month
4
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Kainlan/jina-reranker-v3-int8-ov

Finetuned
Qwen/Qwen3-0.6B
Quantized
(7)
this model