---
tags:
- sentence-transformers
- transformers
- onnx
- onnxruntime
- reranker
- int8
- int4
base_model: intfloat/e5-small-v2
library_name: sentence-transformers
---

# ONNX Quantized versions of intfloat/e5-small-v2

This repository contains ONNX export and multiple quantized versions of [intfloat/e5-small-v2](https://huggingface.co/intfloat/e5-small-v2).

## Usage

```python
from sentence_transformers import SentenceTransformer

# Load Int8 model (ARM64 example)
model = SentenceTransformer(
    "jrc2139/e5-small-v2-ONNX",
    backend="onnx",
    model_kwargs={"file_name": "onnx/model_q4.onnx"},
    trust_remote_code=True
)
```