Ettin Reranker 32M β€” GGUF

GGUF quantizations of cross-encoder/ettin-reranker-32m-v1, a ModernBERT-based cross-encoder reranker (32.8M params, Apache-2.0).

Converted with CrispEmbed.

Files

File Quant Size
F32 129 MB
Q8_0 36 MB
Q4_K 29 MB

Architecture

  • Base: ModernBERT (10 layers, 384 hidden)
  • Classifier head: Dense(384β†’384, GELU) β†’ LayerNorm β†’ Dense(384β†’1)
  • Tokenizer: GPT-2 ByteLevel BPE (50368 tokens)

Usage

Downloads last month
160
GGUF
Model size
32.5M params
Architecture
bert
Hardware compatibility
Log In to add your hardware

6-bit

8-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for cstr/ettin-reranker-32m-v1-GGUF

Quantized
(2)
this model