Ettin Reranker 32M β GGUF
GGUF quantizations of cross-encoder/ettin-reranker-32m-v1, a ModernBERT-based cross-encoder reranker (32.8M params, Apache-2.0).
Converted with CrispEmbed.
Files
| File | Quant | Size |
|---|---|---|
| F32 | 129 MB | |
| Q8_0 | 36 MB | |
| Q4_K | 29 MB |
Architecture
- Base: ModernBERT (10 layers, 384 hidden)
- Classifier head: Dense(384β384, GELU) β LayerNorm β Dense(384β1)
- Tokenizer: GPT-2 ByteLevel BPE (50368 tokens)
Usage
- Downloads last month
- 160
Hardware compatibility
Log In to add your hardware
6-bit
8-bit
32-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support
Model tree for cstr/ettin-reranker-32m-v1-GGUF
Base model
jhu-clsp/ettin-encoder-32m Quantized
cross-encoder/ettin-reranker-32m-v1