Text Classification
sentence-transformers
Safetensors
English
modernbert
cross-encoder
reranker
Generated from Trainer
dataset_size:942069
loss:PrecomputedDistillationLoss
Eval Results (legacy)
text-embeddings-inference
Instructions to use dleemiller/EttinX-nli-xxs with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use dleemiller/EttinX-nli-xxs with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("dleemiller/EttinX-nli-xxs") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores) - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -62,12 +62,12 @@ drop-in compatibility with comparable sentence transformers cross encoders.
|
|
| 62 |
To train this model, I added teacher logits to the all-nli dataset `dleemiller/all-nli-distill` from the
|
| 63 |
`dleemiller/ModernCE-large-nli` model. This significantly improves performance above standard training.
|
| 64 |
|
| 65 |
-
This 17m architecture is based on ModernBERT and is an excellent candidate for lightweight CPU inference.
|
| 66 |
|
| 67 |
---
|
| 68 |
|
| 69 |
## Features
|
| 70 |
-
- **High performing:** Achieves **80.19%** and 86.50% (Micro F1) on MNLI mismatched and SNLI test.
|
| 71 |
- **Efficient architecture:** Based on the Ettin-17m encoder design (17M parameters), offering faster inference speeds.
|
| 72 |
- **Extended context length:** Processes sequences up to 8192 tokens, great for LLM output evals.
|
| 73 |
|
|
@@ -124,7 +124,7 @@ Details:
|
|
| 124 |
Fine-tuning was performed on the `dleemiller/all-nli-distill` dataset.
|
| 125 |
|
| 126 |
### Validation Results
|
| 127 |
-
The model achieved the following test set performance after fine-tuning:
|
| 128 |
- **MNLI Unmatched:** 0.8019
|
| 129 |
- **SNLI:** 0.8650
|
| 130 |
|
|
|
|
| 62 |
To train this model, I added teacher logits to the all-nli dataset `dleemiller/all-nli-distill` from the
|
| 63 |
`dleemiller/ModernCE-large-nli` model. This significantly improves performance above standard training.
|
| 64 |
|
| 65 |
+
This 17m architecture is based on ModernBERT and is an excellent candidate for lightweight **CPU inference**.
|
| 66 |
|
| 67 |
---
|
| 68 |
|
| 69 |
## Features
|
| 70 |
+
- **High performing:** Achieves **80.19%** and **86.50%** (Micro F1) on MNLI mismatched and SNLI test.
|
| 71 |
- **Efficient architecture:** Based on the Ettin-17m encoder design (17M parameters), offering faster inference speeds.
|
| 72 |
- **Extended context length:** Processes sequences up to 8192 tokens, great for LLM output evals.
|
| 73 |
|
|
|
|
| 124 |
Fine-tuning was performed on the `dleemiller/all-nli-distill` dataset.
|
| 125 |
|
| 126 |
### Validation Results
|
| 127 |
+
The model achieved the following test set micro f1 performance after fine-tuning:
|
| 128 |
- **MNLI Unmatched:** 0.8019
|
| 129 |
- **SNLI:** 0.8650
|
| 130 |
|