tardellirs commited on
Commit
444f84a
·
verified ·
1 Parent(s): fb66550

Initial leaderboard publish: 56 models × 18 tasks

Browse files
Files changed (6) hide show
  1. README.md +106 -6
  2. assets/index-D0qkT26e.css +1 -0
  3. assets/index-DB6Y9hrY.js +1 -0
  4. favicon.svg +1 -0
  5. icons.svg +24 -0
  6. index.html +15 -17
README.md CHANGED
@@ -1,10 +1,110 @@
1
  ---
2
- title: Leaderboard
3
- emoji: 🏢
4
- colorFrom: purple
5
- colorTo: purple
6
  sdk: static
7
- pinned: false
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: MTEB(por) Leaderboard
3
+ emoji: 🏆
4
+ colorFrom: green
5
+ colorTo: yellow
6
  sdk: static
7
+ pinned: true
8
+ license: apache-2.0
9
+ short_description: Massive Text Embedding Benchmark for Brazilian Portuguese
10
+ tags:
11
+ - leaderboard
12
+ - benchmark
13
+ - embeddings
14
+ - portuguese
15
+ - brazilian-portuguese
16
+ - mteb
17
+ - retrieval
18
+ - sentence-transformers
19
+ datasets:
20
+ - mteb-pt/mteb-pt-results
21
+ models:
22
+ - Qwen/Qwen3-Embedding-8B
23
+ - Octen/Octen-Embedding-8B
24
+ - google/embeddinggemma-300m
25
+ - microsoft/harrier-oss-v1-27b
26
+ - Qwen/Qwen3-Embedding-4B
27
+ - tencent/KaLM-Embedding-Gemma3-12B-2511
28
+ - codefuse-ai/F2LLM-v2-8B
29
+ - microsoft/harrier-oss-v1-0.6b
30
+ - codefuse-ai/F2LLM-v2-14B
31
+ - intfloat/multilingual-e5-large-instruct
32
+ - SamilPwC-AXNode-GenAI/PwC-Embedding_expr
33
+ - BAAI/bge-m3
34
+ - Qwen/Qwen3-Embedding-0.6B
35
+ - telepix/PIXIE-Rune-v1.0
36
+ - ufca-llms/jua-4B-mixed
37
+ - Octen/Octen-Embedding-0.6B
38
+ - jinaai/jina-embeddings-v5-text-small
39
+ - intfloat/multilingual-e5-large
40
+ - Snowflake/snowflake-arctic-embed-l-v2.0
41
+ - ibm-granite/granite-embedding-311m-multilingual-r2
42
+ - intfloat/multilingual-e5-base
43
+ - PORTULAN/serafim-335m-portuguese-pt-sentence-encoder-ir
44
+ - PORTULAN/serafim-100m-portuguese-pt-sentence-encoder-ir
45
+ - PORTULAN/serafim-900m-portuguese-pt-sentence-encoder-ir
46
+ - microsoft/harrier-oss-v1-270m
47
+ - jinaai/jina-embeddings-v5-text-nano
48
+ - intfloat/multilingual-e5-small
49
+ - ibm-granite/granite-embedding-107m-multilingual
50
+ - codefuse-ai/F2LLM-v2-160M
51
+ - rufimelo/Legal-BERTimbau-sts-large
52
+ - ibm-granite/granite-embedding-97m-multilingual-r2
53
+ - Alibaba-NLP/gte-Qwen2-1.5B-instruct
54
+ - sentence-transformers/paraphrase-multilingual-mpnet-base-v2
55
+ - stjiris/bert-large-portuguese-cased-legal-mlm-sts-v1.0
56
+ - sentence-transformers/LaBSE
57
+ - rufimelo/Legal-BERTimbau-sts-large-ma-v3
58
+ - neuralmind/bert-base-portuguese-cased
59
+ - neuralmind/bert-large-portuguese-cased
60
+ - mixedbread-ai/mxbai-embed-large-v1
61
+ - PORTULAN/albertina-900m-portuguese-ptbr-encoder
62
+ - sentence-transformers/all-MiniLM-L12-v2
63
+ - nvidia/llama-embed-nemotron-8b
64
+ - PORTULAN/albertina-100m-portuguese-ptbr-encoder
65
+ - sentence-transformers/all-mpnet-base-v2
66
+ - sentence-transformers/all-MiniLM-L6-v2
67
+ - BidirLM/BidirLM-1.7B-Embedding
68
+ - sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
69
  ---
70
 
71
+ # MTEB(por) Brazilian Portuguese Massive Text Embedding Benchmark
72
+
73
+ The fifth language-specific MTEB sub-benchmark (after Scandinavian, Chinese, Polish,
74
+ French; Enevoldsen et al., 2025) targeting **Brazilian Portuguese**.
75
+
76
+ - **56 models** evaluated on **18 native PT-BR tasks** (no machine-translated mMARCO/mkqa)
77
+ - Tasks: 11 non-retrieval (classification, NLI, STS, clustering) + 7 retrieval (incl. Quati Pool)
78
+ - Headline metric: **mean_16** (excludes degenerate CSTNews + BBC copyright concern)
79
+ - All raw results: [mteb-pt/mteb-pt-results](https://huggingface.co/datasets/mteb-pt/mteb-pt-results)
80
+ - Source code: [github.com/tardellirs/mteb-pt](https://github.com/tardellirs/mteb-pt)
81
+
82
+ ## Tasks (18 total)
83
+
84
+ | Category | Tasks |
85
+ |---|---|
86
+ | Classification | HateBR, OffComBR, TweetSentBR, ToxSynPT |
87
+ | Pair classification (NLI) | AssinRTE, InferBR |
88
+ | STS | AssinSTS |
89
+ | Clustering | MedPTClustering, BBCNewsPTClustering*, WikipediaPTCategoriesClusteringP2P, CSTNewsClustering* |
90
+ | Retrieval | Quati (Pool), JurisTCU, BRTaxQAR, FaQuADIR, MedPTRetrieval |
91
+ | Reranking | QuatiReranking, JurisTCUReranking |
92
+
93
+ \* excluded from headline mean_16
94
+
95
+ ## How to add a model
96
+
97
+ Submit via GitHub Issues at [tardellirs/mteb-pt/issues](https://github.com/tardellirs/mteb-pt/issues)
98
+ with model_id, eval JSONs, and reproduction script.
99
+
100
+ ## Citation
101
+
102
+ ```bibtex
103
+ @misc{mteb-por-2026,
104
+ title = {MTEB(por): The Brazilian Portuguese MTEB Sub-Benchmark},
105
+ author = {Tardelli, R.S.},
106
+ year = {2026},
107
+ url = {https://huggingface.co/spaces/mteb-pt/leaderboard}
108
+ }
109
+ ```
110
+
assets/index-D0qkT26e.css ADDED
@@ -0,0 +1 @@
 
 
1
+ :root{--bg:#0e1117;--surface:#161b22;--border:#30363d;--text:#e6edf3;--text-dim:#8b949e;--accent:#58a6ff;--best:#2ea043;--row-hover:#21262d;--tier-bg:#21262d}@media (prefers-color-scheme:light){:root{--bg:#fff;--surface:#f6f8fa;--border:#d0d7de;--text:#1f2328;--text-dim:#656d76;--accent:#0969da;--best:#1a7f37;--row-hover:#f6f8fa;--tier-bg:#eaeef2}}*{box-sizing:border-box}html,body{background:var(--bg);color:var(--text);margin:0;padding:0;font-family:-apple-system,BlinkMacSystemFont,Segoe UI,Helvetica,Arial,sans-serif;font-size:14px}.app{max-width:1600px;margin:0 auto;padding:1.5rem 1rem}header h1{margin:0 0 .25rem;font-size:1.6rem}.subtitle{color:var(--text-dim);margin:0}.links{margin:.25rem 0 1rem;font-size:.9rem}.links a{color:var(--accent);margin-right:.25rem;text-decoration:none}.links a:hover{text-decoration:underline}.controls{flex-wrap:wrap;align-items:center;gap:.5rem;margin-bottom:.5rem;display:flex}.controls input,.controls select{background:var(--surface);color:var(--text);border:1px solid var(--border);border-radius:6px;padding:.4rem .6rem;font-size:.9rem}.controls .search{min-width:220px}.controls .cb{color:var(--text-dim);align-items:center;gap:.3rem;font-size:.85rem;display:flex}.toggle-group{border:1px solid var(--border);border-radius:6px;display:flex;overflow:hidden}.toggle-group button{background:var(--surface);color:var(--text-dim);cursor:pointer;border:none;padding:.4rem .8rem;font-size:.85rem}.toggle-group button.active{background:var(--accent);color:#fff}.meta-bar{color:var(--text-dim);margin:.25rem 0 .75rem;font-size:.85rem}.table-wrap{border:1px solid var(--border);border-radius:8px;max-height:80vh;overflow:auto}table{border-collapse:collapse;font-variant-numeric:tabular-nums;width:100%;font-size:.82rem}th,td{text-align:right;border-bottom:1px solid var(--border);white-space:nowrap;padding:.45rem .55rem}th{background:var(--surface);cursor:pointer;-webkit-user-select:none;user-select:none;z-index:2;position:sticky;top:0}th:hover,tbody tr:hover{background:var(--row-hover)}th.model-col,td.model-col{text-align:left;min-width:220px}th.sticky,td.sticky{background:var(--surface);position:sticky}th.sticky:first-child,td.sticky:first-child{z-index:3;left:0}th.sticky:nth-child(2),td.sticky:nth-child(2){z-index:3;left:40px}tbody td.sticky{background:var(--bg)}tbody tr:hover td.sticky{background:var(--row-hover)}td.model-col a{color:var(--accent);font-weight:500;text-decoration:none}td.model-col a:hover{text-decoration:underline}.tier-badge{background:var(--tier-bg);color:var(--text-dim);border-radius:4px;margin-left:.4rem;padding:.05rem .4rem;font-size:.7rem;display:inline-block}td.license{color:var(--text-dim);font-family:ui-monospace,monospace;font-size:.75rem}td.metric{font-weight:600}td.task{color:var(--text-dim)}td.task.best{color:var(--best);font-weight:600}footer{color:var(--text-dim);margin-top:1.5rem;font-size:.8rem;line-height:1.5}footer a{color:var(--accent)}
assets/index-DB6Y9hrY.js ADDED
@@ -0,0 +1 @@
 
 
1
+ (function(){let e=document.createElement(`link`).relList;if(e&&e.supports&&e.supports(`modulepreload`))return;for(let e of document.querySelectorAll(`link[rel="modulepreload"]`))n(e);new MutationObserver(e=>{for(let t of e)if(t.type===`childList`)for(let e of t.addedNodes)e.tagName===`LINK`&&e.rel===`modulepreload`&&n(e)}).observe(document,{childList:!0,subtree:!0});function t(e){let t={};return e.integrity&&(t.integrity=e.integrity),e.referrerPolicy&&(t.referrerPolicy=e.referrerPolicy),e.crossOrigin===`use-credentials`?t.credentials=`include`:e.crossOrigin===`anonymous`?t.credentials=`omit`:t.credentials=`same-origin`,t}function n(e){if(e.ep)return;e.ep=!0;let n=t(e);fetch(e.href,n)}})();var e={context:void 0,registry:void 0,effects:void 0,done:!1,getContextId(){return t(this.context.count)},getNextContextId(){return t(this.context.count++)}};function t(t){let n=String(t),r=n.length-1;return e.context.id+(r?String.fromCharCode(96+r):``)+n}function n(t){e.context=t}function r(){return{...e.context,id:e.getNextContextId(),count:0}}var i=(e,t)=>e===t,a=Symbol(`solid-track`),o={equals:i},s=null,c=R,l=1,u=2,d={owned:null,cleanups:null,context:null,owner:null},f=null,p=null,m=null,h=null,g=null,_=null,v=null,y=0;function b(e,t){let n=g,r=f,i=e.length===0,a=t===void 0?r:t,o=i?d:{owned:null,cleanups:null,context:a?a.context:null,owner:a},s=i?e:()=>e(()=>w(()=>V(o)));f=o,g=null;try{return I(s,!0)}finally{g=n,f=r}}function x(e,t){t=t?Object.assign({},o,t):o;let n={value:e,observers:null,observerSlots:null,comparator:t.equals||void 0};return[A.bind(n),e=>(typeof e==`function`&&(e=p&&p.running&&p.sources.has(n)?e(n.tValue):e(n.value)),j(n,e))]}function S(e,t,n){let r=P(e,t,!1,l);m&&p&&p.running?_.push(r):M(r)}function C(e,t,n){n=n?Object.assign({},o,n):o;let r=P(e,t,!0,0);return r.observers=null,r.observerSlots=null,r.comparator=n.equals||void 0,m&&p&&p.running?(r.tState=l,_.push(r)):M(r),A.bind(r)}function w(e){if(!h&&g===null)return e();let t=g;g=null;try{return h?h.untrack(e):e()}finally{g=t}}function T(e){return f===null||(f.cleanups===null?f.cleanups=[e]:f.cleanups.push(e)),e}function E(e){if(p&&p.running)return e(),p.done;let t=g,n=f;return Promise.resolve().then(()=>{g=t,f=n;let r;return(m||k)&&(r=p||={sources:new Set,effects:[],promises:new Set,disposed:new Set,queue:new Set,running:!0},r.done||=new Promise(e=>r.resolve=e),r.running=!0),I(e,!1),g=f=null,r?r.done:void 0})}var[D,O]=x(!1),k;function A(){let e=p&&p.running;if(this.sources&&(e?this.tState:this.state))if((e?this.tState:this.state)===l)M(this);else{let e=_;_=null,I(()=>B(this),!1),_=e}if(g){let e=this.observers;if(!e||e[e.length-1]!==g){let t=e?e.length:0;g.sources?(g.sources.push(this),g.sourceSlots.push(t)):(g.sources=[this],g.sourceSlots=[t]),e?(e.push(g),this.observerSlots.push(g.sources.length-1)):(this.observers=[g],this.observerSlots=[g.sources.length-1])}}return e&&p.sources.has(this)?this.tValue:this.value}function j(e,t,n){let r=p&&p.running&&p.sources.has(e)?e.tValue:e.value;if(!e.comparator||!e.comparator(r,t)){if(p){let r=p.running;(r||!n&&p.sources.has(e))&&(p.sources.add(e),e.tValue=t),r||(e.value=t)}else e.value=t;e.observers&&e.observers.length&&I(()=>{for(let t=0;t<e.observers.length;t+=1){let n=e.observers[t],r=p&&p.running;r&&p.disposed.has(n)||((r?!n.tState:!n.state)&&(n.pure?_.push(n):v.push(n),n.observers&&ee(n)),r?n.tState=l:n.state=l)}if(_.length>1e6)throw _=[],Error()},!1)}return t}function M(e){if(!e.fn)return;V(e);let t=y;N(e,p&&p.running&&p.sources.has(e)?e.tValue:e.value,t),p&&!p.running&&p.sources.has(e)&&queueMicrotask(()=>{I(()=>{p&&(p.running=!0),g=f=e,N(e,e.tValue,t),g=f=null},!1)})}function N(e,t,n){let r,i=f,a=g;g=f=e;try{r=e.fn(t)}catch(t){return e.pure&&(p&&p.running?(e.tState=l,e.tOwned&&e.tOwned.forEach(V),e.tOwned=void 0):(e.state=l,e.owned&&e.owned.forEach(V),e.owned=null)),e.updatedAt=n+1,W(t)}finally{g=a,f=i}(!e.updatedAt||e.updatedAt<=n)&&(e.updatedAt!=null&&`observers`in e?j(e,r,!0):p&&p.running&&e.pure?(p.sources.has(e)||(e.value=r),p.sources.add(e),e.tValue=r):e.value=r,e.updatedAt=n)}function P(e,t,n,r=l,i){let a={fn:e,state:r,updatedAt:null,owned:null,sources:null,sourceSlots:null,cleanups:null,value:t,owner:f,context:f?f.context:null,pure:n};if(p&&p.running&&(a.state=0,a.tState=r),f===null||f!==d&&(p&&p.running&&f.pure?f.tOwned?f.tOwned.push(a):f.tOwned=[a]:f.owned?f.owned.push(a):f.owned=[a]),h&&a.fn){let e=a.fn,[t,n]=x(void 0,{equals:!1}),r=h.factory(e,n);T(()=>r.dispose());let i,o=()=>E(n).then(()=>{i&&=(i.dispose(),void 0)});a.fn=n=>(t(),p&&p.running?(i||=h.factory(e,o),i.track(n)):r.track(n))}return a}function F(e){let t=p&&p.running;if((t?e.tState:e.state)===0)return;if((t?e.tState:e.state)===u)return B(e);if(e.suspense&&w(e.suspense.inFallback))return e.suspense.effects.push(e);let n=[e];for(;(e=e.owner)&&(!e.updatedAt||e.updatedAt<y);){if(t&&p.disposed.has(e))return;(t?e.tState:e.state)&&n.push(e)}for(let r=n.length-1;r>=0;r--){if(e=n[r],t){let t=e,i=n[r+1];for(;(t=t.owner)&&t!==i;)if(p.disposed.has(t))return}if((t?e.tState:e.state)===l)M(e);else if((t?e.tState:e.state)===u){let t=_;_=null,I(()=>B(e,n[0]),!1),_=t}}}function I(e,t){if(_)return e();let n=!1;t||(_=[]),v?n=!0:v=[],y++;try{let t=e();return L(n),t}catch(e){n||(v=null),_=null,W(e)}}function L(e){if(_&&=(m&&p&&p.running?z(_):R(_),null),e)return;let t;if(p){if(!p.promises.size&&!p.queue.size){let e=p.sources,n=p.disposed;v.push.apply(v,p.effects),t=p.resolve;for(let e of v)`tState`in e&&(e.state=e.tState),delete e.tState;p=null,I(()=>{for(let e of n)V(e);for(let t of e){if(t.value=t.tValue,t.owned)for(let e=0,n=t.owned.length;e<n;e++)V(t.owned[e]);t.tOwned&&(t.owned=t.tOwned),delete t.tValue,delete t.tOwned,t.tState=0}O(!1)},!1)}else if(p.running){p.running=!1,p.effects.push.apply(p.effects,v),v=null,O(!0);return}}let n=v;v=null,n.length&&I(()=>c(n),!1),t&&t()}function R(e){for(let t=0;t<e.length;t++)F(e[t])}function z(e){for(let t=0;t<e.length;t++){let n=e[t],r=p.queue;r.has(n)||(r.add(n),m(()=>{r.delete(n),I(()=>{p.running=!0,F(n)},!1),p&&(p.running=!1)}))}}function B(e,t){let n=p&&p.running;n?e.tState=0:e.state=0;for(let r=0;r<e.sources.length;r+=1){let i=e.sources[r];if(i.sources){let e=n?i.tState:i.state;e===l?i!==t&&(!i.updatedAt||i.updatedAt<y)&&F(i):e===u&&B(i,t)}}}function ee(e){let t=p&&p.running;for(let n=0;n<e.observers.length;n+=1){let r=e.observers[n];(t?!r.tState:!r.state)&&(t?r.tState=u:r.state=u,r.pure?_.push(r):v.push(r),r.observers&&ee(r))}}function V(e){let t;if(e.sources)for(;e.sources.length;){let t=e.sources.pop(),n=e.sourceSlots.pop(),r=t.observers;if(r&&r.length){let e=r.pop(),i=t.observerSlots.pop();n<r.length&&(e.sourceSlots[i]=n,r[n]=e,t.observerSlots[n]=i)}}if(e.tOwned){for(t=e.tOwned.length-1;t>=0;t--)V(e.tOwned[t]);delete e.tOwned}if(p&&p.running&&e.pure)H(e,!0);else if(e.owned){for(t=e.owned.length-1;t>=0;t--)V(e.owned[t]);e.owned=null}if(e.cleanups){for(t=e.cleanups.length-1;t>=0;t--)e.cleanups[t]();e.cleanups=null}p&&p.running?e.tState=0:e.state=0}function H(e,t){if(t||(e.tState=0,p.disposed.add(e)),e.owned)for(let t=0;t<e.owned.length;t++)H(e.owned[t])}function te(e){return e instanceof Error?e:Error(typeof e==`string`?e:`Unknown error`,{cause:e})}function U(e,t,n){try{for(let n of t)n(e)}catch(e){W(e,n&&n.owner||null)}}function W(e,t=f){let n=s&&t&&t.context&&t.context[s],r=te(e);if(!n)throw r;v?v.push({fn(){U(r,n,t)},state:l}):U(r,n,t)}var ne=Symbol(`fallback`);function re(e){for(let t=0;t<e.length;t++)e[t]()}function ie(e,t,n={}){let r=[],i=[],o=[],s=0,c=t.length>1?[]:null;return T(()=>re(o)),()=>{let l=e()||[],u=l.length,d,f;return l[a],w(()=>{let e,t,a,m,h,g,_,v,y;if(u===0)s!==0&&(re(o),o=[],r=[],i=[],s=0,c&&=[]),n.fallback&&(r=[ne],i[0]=b(e=>(o[0]=e,n.fallback())),s=1);else if(s===0){for(i=Array(u),f=0;f<u;f++)r[f]=l[f],i[f]=b(p);s=u}else{for(a=Array(u),m=Array(u),c&&(h=Array(u)),g=0,_=Math.min(s,u);g<_&&r[g]===l[g];g++);for(_=s-1,v=u-1;_>=g&&v>=g&&r[_]===l[v];_--,v--)a[v]=i[_],m[v]=o[_],c&&(h[v]=c[_]);for(e=new Map,t=Array(v+1),f=v;f>=g;f--)y=l[f],d=e.get(y),t[f]=d===void 0?-1:d,e.set(y,f);for(d=g;d<=_;d++)y=r[d],f=e.get(y),f!==void 0&&f!==-1?(a[f]=i[d],m[f]=o[d],c&&(h[f]=c[d]),f=t[f],e.set(y,f)):o[d]();for(f=g;f<u;f++)f in a?(i[f]=a[f],o[f]=m[f],c&&(c[f]=h[f],c[f](f))):i[f]=b(p);i=i.slice(0,s=u),r=l.slice(0)}return i});function p(e){if(o[f]=e,c){let[e,n]=x(f);return c[f]=n,t(l[f],e)}return t(l[f])}}}var ae=!1;function G(t,i){if(ae&&e.context){let a=e.context;n(r());let o=w(()=>t(i||{}));return n(a),o}return w(()=>t(i||{}))}function K(e){let t=`fallback`in e&&{fallback:()=>e.fallback};return C(ie(()=>e.each,e.children,t||void 0))}function oe(e,t,n){let r=n.length,i=t.length,a=r,o=0,s=0,c=t[i-1].nextSibling,l=null;for(;o<i||s<a;){if(t[o]===n[s]){o++,s++;continue}for(;t[i-1]===n[a-1];)i--,a--;if(i===o){let t=a<r?s?n[s-1].nextSibling:n[a-s]:c;for(;s<a;)e.insertBefore(n[s++],t)}else if(a===s)for(;o<i;)(!l||!l.has(t[o]))&&t[o].remove(),o++;else if(t[o]===n[a-1]&&n[s]===t[i-1]){let r=t[--i].nextSibling;e.insertBefore(n[s++],t[o++].nextSibling),e.insertBefore(n[--a],r),t[i]=n[a]}else{if(!l){l=new Map;let e=s;for(;e<a;)l.set(n[e],e++)}let r=l.get(t[o]);if(r!=null)if(s<r&&r<a){let c=o,u=1,d;for(;++c<i&&c<a&&!((d=l.get(t[c]))==null||d!==r+u);)u++;if(u>r-s){let i=t[o];for(;s<r;)e.insertBefore(n[s++],i)}else e.replaceChild(n[s++],t[o++])}else o++;else t[o++].remove()}}}var se=`_$DX_DELEGATE`;function ce(e,t,n,r={}){let i;return b(r=>{i=r,t===document?e():Y(t,e(),t.firstChild?null:void 0,n)},r.owner),()=>{i(),t.textContent=``}}function q(e,t,n,r){let i,a=()=>{let t=r?document.createElementNS(`http://www.w3.org/1998/Math/MathML`,`template`):document.createElement(`template`);return t.innerHTML=e,n?t.content.firstChild.firstChild:r?t.firstChild:t.content.firstChild},o=t?()=>w(()=>document.importNode(i||=a(),!0)):()=>(i||=a()).cloneNode(!0);return o.cloneNode=o,o}function le(e,t=window.document){let n=t[se]||(t[se]=new Set);for(let r=0,i=e.length;r<i;r++){let i=e[r];n.has(i)||(n.add(i),t.addEventListener(i,de))}}function J(e,t,n){ue(e)||(n==null?e.removeAttribute(t):e.setAttribute(t,n))}function Y(e,t,n,r){if(n!==void 0&&!r&&(r=[]),typeof t!=`function`)return X(e,t,r,n);S(r=>X(e,t(),r,n),r)}function ue(t){return!!e.context&&!e.done&&(!t||t.isConnected)}function de(t){if(e.registry&&e.events&&e.events.find(([e,n])=>n===t))return;let n=t.target,r=`$$${t.type}`,i=t.target,a=t.currentTarget,o=e=>Object.defineProperty(t,"target",{configurable:!0,value:e}),s=()=>{let e=n[r];if(e&&!n.disabled){let i=n[`${r}Data`];if(i===void 0?e.call(n,t):e.call(n,i,t),t.cancelBubble)return}return n.host&&typeof n.host!=`string`&&!n.host._$host&&n.contains(t.target)&&o(n.host),!0},c=()=>{for(;s()&&(n=n._$host||n.parentNode||n.host););};if(Object.defineProperty(t,"currentTarget",{configurable:!0,get(){return n||document}}),e.registry&&!e.done&&(e.done=_$HY.done=!0),t.composedPath){let e=t.composedPath();o(e[0]);for(let t=0;t<e.length-2&&(n=e[t],s());t++){if(n._$host){n=n._$host,c();break}if(n.parentNode===a)break}}else c();o(i)}function X(e,t,n,r,i){let a=ue(e);if(a){!n&&(n=[...e.childNodes]);let t=[];for(let e=0;e<n.length;e++){let r=n[e];r.nodeType===8&&r.data.slice(0,2)===`!$`?r.remove():t.push(r)}n=t}for(;typeof n==`function`;)n=n();if(t===n)return n;let o=typeof t,s=r!==void 0;if(e=s&&n[0]&&n[0].parentNode||e,o===`string`||o===`number`){if(a||o===`number`&&(t=t.toString(),t===n))return n;if(s){let i=n[0];i&&i.nodeType===3?i.data!==t&&(i.data=t):i=document.createTextNode(t),n=Q(e,n,r,i)}else n=n!==``&&typeof n==`string`?e.firstChild.data=t:e.textContent=t}else if(t==null||o===`boolean`){if(a)return n;n=Q(e,n,r)}else if(o===`function`)return S(()=>{let i=t();for(;typeof i==`function`;)i=i();n=X(e,i,n,r)}),()=>n;else if(Array.isArray(t)){let o=[],c=n&&Array.isArray(n);if(Z(o,t,n,i))return S(()=>n=X(e,o,n,r,!0)),()=>n;if(a){if(!o.length)return n;if(r===void 0)return n=[...e.childNodes];let t=o[0];if(t.parentNode!==e)return n;let i=[t];for(;(t=t.nextSibling)!==r;)i.push(t);return n=i}if(o.length===0){if(n=Q(e,n,r),s)return n}else c?n.length===0?fe(e,o,r):oe(e,n,o):(n&&Q(e),fe(e,o));n=o}else if(t.nodeType){if(a&&t.parentNode)return n=s?[t]:t;if(Array.isArray(n)){if(s)return n=Q(e,n,r,t);Q(e,n,null,t)}else n==null||n===``||!e.firstChild?e.appendChild(t):e.replaceChild(t,e.firstChild);n=t}return n}function Z(e,t,n,r){let i=!1;for(let a=0,o=t.length;a<o;a++){let o=t[a],s=n&&n[e.length],c;if(!(o==null||o===!0||o===!1))if((c=typeof o)==`object`&&o.nodeType)e.push(o);else if(Array.isArray(o))i=Z(e,o,s)||i;else if(c===`function`)if(r){for(;typeof o==`function`;)o=o();i=Z(e,Array.isArray(o)?o:[o],Array.isArray(s)?s:[s])||i}else e.push(o),i=!0;else{let t=String(o);s&&s.nodeType===3&&s.data===t?e.push(s):e.push(document.createTextNode(t))}}return i}function fe(e,t,n=null){for(let r=0,i=t.length;r<i;r++)e.insertBefore(t[r],n)}function Q(e,t,n,r){if(n===void 0)return e.textContent=``;let i=r||document.createTextNode(``);if(t.length){let r=!1;for(let a=t.length-1;a>=0;a--){let o=t[a];if(i!==o){let t=o.parentNode===e;!r&&!a?t?e.replaceChild(i,o):e.insertBefore(i,n):t&&o.remove()}else r=!0}}else e.insertBefore(i,n);return[i]}var $={version:`v0.8.3`,generated_at:`2026-06-07`,n_models:56,tasks:{non_retrieval:[`hatebr`,`offcombr`,`tweetsentbr`,`toxsynpt`,`inferbr`,`assinrte`,`assinsts`,`medptclustering`,`bbcnewsptclustering`,`wikipediaptcategoriesclusteringp2p`,`cstnewsclustering`],retrieval:[`quati`,`juristcu`,`brtaxqar`,`faquadir`,`medptretrieval`,`quatireranking`,`juristcureranking`],headline_excluded:[`bbcnewsptclustering`,`cstnewsclustering`]},models:[{id:`google/gemini-embedding-001`,name:`gemini-embedding-001`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7444,mean_18:.7315,scores:{hatebr:.9086,offcombr:.8309,tweetsentbr:.7587,toxsynpt:.9184,inferbr:.8029,assinrte:.7195,assinsts:.8184,medptclustering:.685,bbcnewsptclustering:.2764,wikipediaptcategoriesclusteringp2p:.7375,cstnewsclustering:.9802,quati:.5912,juristcu:.6087,brtaxqar:.3662,faquadir:.8561,medptretrieval:.877,quatireranking:.6618,juristcureranking:.7701},rank:1},{id:`openai/text-embedding-3-large`,name:`text-embedding-3-large`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7331,mean_18:.72,scores:{hatebr:.9236,offcombr:.8502,tweetsentbr:.7637,toxsynpt:.9293,inferbr:.8123,assinrte:.8935,assinsts:.7921,medptclustering:.5508,bbcnewsptclustering:.2423,wikipediaptcategoriesclusteringp2p:.7129,cstnewsclustering:.9888,quati:.6276,juristcu:.6073,brtaxqar:.2485,faquadir:.7898,medptretrieval:.8459,quatireranking:.6349,juristcureranking:.7473},rank:2},{id:`Qwen/Qwen3-Embedding-8B`,name:`Qwen3-Embedding-8B`,tier:`Pool`,params:7600,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.7329,mean_18:.7274,scores:{hatebr:.8378,offcombr:.7623,tweetsentbr:.6072,toxsynpt:.8743,inferbr:.9074,assinrte:.8657,assinsts:.7868,medptclustering:.731,bbcnewsptclustering:.3669,wikipediaptcategoriesclusteringp2p:.7963,cstnewsclustering:1,quati:.579,juristcu:.6191,brtaxqar:.2885,faquadir:.8372,medptretrieval:.8228,quatireranking:.6507,juristcureranking:.7609},rank:3},{id:`google/gemini-embedding-2`,name:`gemini-embedding-2`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7305,mean_18:.7164,scores:{hatebr:.92,offcombr:.8551,tweetsentbr:.7637,toxsynpt:.9261,inferbr:.7689,assinrte:.875,assinsts:.7479,medptclustering:.6662,bbcnewsptclustering:.2246,wikipediaptcategoriesclusteringp2p:.7173,cstnewsclustering:.982,quati:.5677,juristcu:.4885,brtaxqar:.2939,faquadir:.8603,medptretrieval:.8754,quatireranking:.6644,juristcureranking:.6982},rank:4},{id:`Octen/Octen-Embedding-8B`,name:`Octen-Embedding-8B`,tier:`Pending`,params:8e3,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.7281,mean_18:.722,scores:{hatebr:.8352,offcombr:.7657,tweetsentbr:.5963,toxsynpt:.8755,inferbr:.9084,assinrte:.8642,assinsts:.7859,medptclustering:.7276,bbcnewsptclustering:.3473,wikipediaptcategoriesclusteringp2p:.7839,cstnewsclustering:1,quati:.5715,juristcu:.5786,brtaxqar:.304,faquadir:.8015,medptretrieval:.8573,quatireranking:.6577,juristcureranking:.736},rank:5},{id:`google/embeddinggemma-300m`,name:`embeddinggemma-300m`,tier:`Phase D v0.8.1`,params:300,license:`gemma`,type:`open`,n_tasks:18,mean_16:.7257,mean_18:.7202,scores:{hatebr:.8309,offcombr:.7536,tweetsentbr:.653,toxsynpt:.8589,inferbr:.8753,assinrte:.8756,assinsts:.7886,medptclustering:.7495,bbcnewsptclustering:.353,wikipediaptcategoriesclusteringp2p:.6945,cstnewsclustering:1,quati:.5442,juristcu:.6187,brtaxqar:.3731,faquadir:.8411,medptretrieval:.7767,quatireranking:.6129,juristcureranking:.7648},rank:6},{id:`voyage/voyage-4-large`,name:`voyage-4-large`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7244,mean_18:.7123,scores:{hatebr:.9057,offcombr:.8357,tweetsentbr:.7139,toxsynpt:.9253,inferbr:.8182,assinrte:.88,assinsts:.7616,medptclustering:.5082,bbcnewsptclustering:.2521,wikipediaptcategoriesclusteringp2p:.6202,cstnewsclustering:.9798,quati:.5591,juristcu:.5477,brtaxqar:.3649,faquadir:.857,medptretrieval:.8929,quatireranking:.6689,juristcureranking:.7309},rank:7},{id:`microsoft/harrier-oss-v1-27b`,name:`harrier-oss-v1-27b`,tier:`Held-out SOTA`,params:27e3,license:`mit`,type:`open`,n_tasks:18,mean_16:.7224,mean_18:.7138,scores:{hatebr:.853,offcombr:.7768,tweetsentbr:.6388,toxsynpt:.8858,inferbr:.7956,assinrte:.7937,assinsts:.7862,medptclustering:.6649,bbcnewsptclustering:.2902,wikipediaptcategoriesclusteringp2p:.6166,cstnewsclustering:1,quati:.6019,juristcu:.6643,brtaxqar:.3015,faquadir:.8609,medptretrieval:.884,quatireranking:.6461,juristcureranking:.7877},rank:8},{id:`cohere/embed-v4`,name:`embed-v4`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7217,mean_18:.7086,scores:{hatebr:.9064,offcombr:.8309,tweetsentbr:.709,toxsynpt:.9,inferbr:.7707,assinrte:.89,assinsts:.7675,medptclustering:.5195,bbcnewsptclustering:.2286,wikipediaptcategoriesclusteringp2p:.7033,cstnewsclustering:.9787,quati:.5402,juristcu:.5968,brtaxqar:.3503,faquadir:.8654,medptretrieval:.8205,quatireranking:.6101,juristcureranking:.7668},rank:9},{id:`Qwen/Qwen3-Embedding-4B`,name:`Qwen3-Embedding-4B`,tier:`Pool`,params:4e3,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.7182,mean_18:.7132,scores:{hatebr:.819,offcombr:.6995,tweetsentbr:.5495,toxsynpt:.8298,inferbr:.894,assinrte:.8663,assinsts:.7932,medptclustering:.8043,bbcnewsptclustering:.3459,wikipediaptcategoriesclusteringp2p:.7787,cstnewsclustering:1,quati:.5203,juristcu:.622,brtaxqar:.2918,faquadir:.8296,medptretrieval:.7913,quatireranking:.6399,juristcureranking:.7628},rank:10},{id:`tencent/KaLM-Embedding-Gemma3-12B-2511`,name:`KaLM-Embedding-Gemma3-12B-2511`,tier:`Held-out SOTA`,params:12e3,license:`gemma`,type:`open`,n_tasks:18,mean_16:.711,mean_18:.7057,scores:{hatebr:.8469,offcombr:.7831,tweetsentbr:.6371,toxsynpt:.8865,inferbr:.7892,assinrte:.7566,assinsts:.7607,medptclustering:.654,bbcnewsptclustering:.3261,wikipediaptcategoriesclusteringp2p:.6642,cstnewsclustering:1,quati:.5727,juristcu:.6099,brtaxqar:.2912,faquadir:.8172,medptretrieval:.8917,quatireranking:.6554,juristcureranking:.7596},rank:11},{id:`codefuse-ai/F2LLM-v2-8B`,name:`F2LLM-v2-8B`,tier:`Pending`,params:8e3,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.7105,mean_18:.7069,scores:{hatebr:.7981,offcombr:.7343,tweetsentbr:.5291,toxsynpt:.8251,inferbr:.8492,assinrte:.8506,assinsts:.8076,medptclustering:.784,bbcnewsptclustering:.3563,wikipediaptcategoriesclusteringp2p:.7461,cstnewsclustering:1,quati:.5706,juristcu:.6065,brtaxqar:.2501,faquadir:.7667,medptretrieval:.8701,quatireranking:.644,juristcureranking:.7365},rank:12},{id:`openai/text-embedding-3-small`,name:`text-embedding-3-small`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.7099,mean_18:.6986,scores:{hatebr:.9143,offcombr:.8454,tweetsentbr:.7289,toxsynpt:.9109,inferbr:.7765,assinrte:.8895,assinsts:.7705,medptclustering:.5287,bbcnewsptclustering:.2331,wikipediaptcategoriesclusteringp2p:.7115,cstnewsclustering:.9845,quati:.5653,juristcu:.581,brtaxqar:.2706,faquadir:.8017,medptretrieval:.7748,quatireranking:.5675,juristcureranking:.7209},rank:13},{id:`microsoft/harrier-oss-v1-0.6b`,name:`harrier-oss-v1-0.6b`,tier:`Pending`,params:600,license:`mit`,type:`open`,n_tasks:18,mean_16:.6988,mean_18:.6959,scores:{hatebr:.8003,offcombr:.7275,tweetsentbr:.5759,toxsynpt:.8529,inferbr:.8478,assinrte:.8592,assinsts:.7711,medptclustering:.715,bbcnewsptclustering:.345,wikipediaptcategoriesclusteringp2p:.7579,cstnewsclustering:1,quati:.4854,juristcu:.5802,brtaxqar:.2654,faquadir:.8516,medptretrieval:.7623,quatireranking:.6137,juristcureranking:.7148},rank:14},{id:`codefuse-ai/F2LLM-v2-14B`,name:`F2LLM-v2-14B`,tier:`Held-out SOTA`,params:14e3,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6913,mean_18:.6876,scores:{hatebr:.8608,offcombr:.7947,tweetsentbr:.654,toxsynpt:.8372,inferbr:.8063,assinrte:.7866,assinsts:.7779,medptclustering:.6083,bbcnewsptclustering:.3164,wikipediaptcategoriesclusteringp2p:.4908,cstnewsclustering:1,quati:.5574,juristcu:.5965,brtaxqar:.2342,faquadir:.768,medptretrieval:.887,quatireranking:.6578,juristcureranking:.7427},rank:15},{id:`mistral/mistral-embed`,name:`mistral-embed`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.6905,mean_18:.6822,scores:{hatebr:.8929,offcombr:.8213,tweetsentbr:.6965,toxsynpt:.8936,inferbr:.7777,assinrte:.8785,assinsts:.7479,medptclustering:.4353,bbcnewsptclustering:.2555,wikipediaptcategoriesclusteringp2p:.7031,cstnewsclustering:.9763,quati:.4838,juristcu:.5897,brtaxqar:.2281,faquadir:.8054,medptretrieval:.7799,quatireranking:.5651,juristcureranking:.7488},rank:16},{id:`intfloat/multilingual-e5-large-instruct`,name:`multilingual-e5-large-instruct`,tier:`Pool`,params:560,license:`mit`,type:`open`,n_tasks:18,mean_16:.6898,mean_18:.6874,scores:{hatebr:.826,offcombr:.7638,tweetsentbr:.6704,toxsynpt:.8944,inferbr:.8273,assinrte:.8771,assinsts:.8077,medptclustering:.7272,bbcnewsptclustering:.3374,wikipediaptcategoriesclusteringp2p:.7885,cstnewsclustering:1,quati:.3971,juristcu:.5235,brtaxqar:.1868,faquadir:.7628,medptretrieval:.759,quatireranking:.523,juristcureranking:.7017},rank:17},{id:`SamilPwC-AXNode-GenAI/PwC-Embedding_expr`,name:`PwC-Embedding_expr`,tier:`Phase C`,params:568,license:`mit`,type:`open`,n_tasks:18,mean_16:.6837,mean_18:.6831,scores:{hatebr:.8258,offcombr:.7556,tweetsentbr:.652,toxsynpt:.8799,inferbr:.8524,assinrte:.8814,assinsts:.8052,medptclustering:.7011,bbcnewsptclustering:.3557,wikipediaptcategoriesclusteringp2p:.7703,cstnewsclustering:1,quati:.4231,juristcu:.4651,brtaxqar:.2175,faquadir:.7787,medptretrieval:.7412,quatireranking:.5314,juristcureranking:.659},rank:18},{id:`BAAI/bge-m3`,name:`bge-m3`,tier:`Pool`,params:568,license:`mit`,type:`open`,n_tasks:18,mean_16:.6827,mean_18:.6788,scores:{hatebr:.8206,offcombr:.7242,tweetsentbr:.6112,toxsynpt:.8564,inferbr:.8248,assinrte:.8224,assinsts:.7537,medptclustering:.6189,bbcnewsptclustering:.2949,wikipediaptcategoriesclusteringp2p:.5844,cstnewsclustering:1,quati:.5338,juristcu:.5913,brtaxqar:.2656,faquadir:.8287,medptretrieval:.7462,quatireranking:.6027,juristcureranking:.7385},rank:19},{id:`Qwen/Qwen3-Embedding-0.6B`,name:`Qwen3-Embedding-0.6B`,tier:`Pool`,params:600,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6805,mean_18:.6797,scores:{hatebr:.7848,offcombr:.7473,tweetsentbr:.5281,toxsynpt:.8414,inferbr:.8176,assinrte:.834,assinsts:.7399,medptclustering:.6896,bbcnewsptclustering:.3469,wikipediaptcategoriesclusteringp2p:.7689,cstnewsclustering:1,quati:.5004,juristcu:.5749,brtaxqar:.2716,faquadir:.7962,medptretrieval:.6956,quatireranking:.5774,juristcureranking:.7205},rank:20},{id:`amazon/titan-embed-text-v2`,name:`titan-embed-text-v2`,tier:`Closed v0.7`,params:null,license:`proprietary`,type:`closed`,n_tasks:18,mean_16:.6799,mean_18:.669,scores:{hatebr:.8621,offcombr:.8116,tweetsentbr:.6866,toxsynpt:.8817,inferbr:.8199,assinrte:.882,assinsts:.7622,medptclustering:.3566,bbcnewsptclustering:.1805,wikipediaptcategoriesclusteringp2p:.6295,cstnewsclustering:.9835,quati:.4404,juristcu:.6065,brtaxqar:.3856,faquadir:.7482,medptretrieval:.7276,quatireranking:.5424,juristcureranking:.735},rank:21},{id:`perplexity-ai/pplx-embed-v1-0.6b`,name:`pplx-embed-v1-0.6b`,tier:`Phase D v0.8.1`,params:600,license:`proprietary`,type:`closed-api`,n_tasks:18,mean_16:.6788,mean_18:.6754,scores:{hatebr:.7834,offcombr:.7179,tweetsentbr:.5299,toxsynpt:.7843,inferbr:.701,assinrte:.8159,assinsts:.7565,medptclustering:.6677,bbcnewsptclustering:.2957,wikipediaptcategoriesclusteringp2p:.61,cstnewsclustering:1,quati:.5517,juristcu:.6348,brtaxqar:.3,faquadir:.847,medptretrieval:.7819,quatireranking:.6168,juristcureranking:.7623},rank:22},{id:`telepix/PIXIE-Rune-v1.0`,name:`PIXIE-Rune-v1.0`,tier:`Phase C`,params:568,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6778,mean_18:.6733,scores:{hatebr:.8441,offcombr:.7362,tweetsentbr:.5903,toxsynpt:.8482,inferbr:.6977,assinrte:.8361,assinsts:.7798,medptclustering:.6155,bbcnewsptclustering:.2755,wikipediaptcategoriesclusteringp2p:.5802,cstnewsclustering:1,quati:.5053,juristcu:.5961,brtaxqar:.2636,faquadir:.8526,medptretrieval:.7623,quatireranking:.5887,juristcureranking:.7476},rank:23},{id:`ufca-llms/jua-4B-mixed`,name:`jua-4B-mixed`,tier:`PT-native v0.6`,params:4e3,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6778,mean_18:.6757,scores:{hatebr:.8125,offcombr:.7628,tweetsentbr:.5291,toxsynpt:.7795,inferbr:.7124,assinrte:.7528,assinsts:.7275,medptclustering:.6612,bbcnewsptclustering:.3177,wikipediaptcategoriesclusteringp2p:.6459,cstnewsclustering:1,quati:.5312,juristcu:.5814,brtaxqar:.399,faquadir:.7953,medptretrieval:.8154,quatireranking:.6018,juristcureranking:.7364},rank:24},{id:`Octen/Octen-Embedding-0.6B`,name:`Octen-Embedding-0.6B`,tier:`Phase C`,params:600,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6769,mean_18:.677,scores:{hatebr:.784,offcombr:.7275,tweetsentbr:.5473,toxsynpt:.8199,inferbr:.8035,assinrte:.824,assinsts:.7467,medptclustering:.7415,bbcnewsptclustering:.3554,wikipediaptcategoriesclusteringp2p:.7682,cstnewsclustering:1,quati:.4989,juristcu:.5424,brtaxqar:.2736,faquadir:.7913,medptretrieval:.7141,quatireranking:.5569,juristcureranking:.6901},rank:25},{id:`jinaai/jina-embeddings-v5-text-small`,name:`jina-embeddings-v5-text-small`,tier:`Pending`,params:137,license:`cc-by-nc-4.0`,type:`open`,n_tasks:18,mean_16:.6638,mean_18:.6602,scores:{hatebr:.7961,offcombr:.7058,tweetsentbr:.5015,toxsynpt:.8076,inferbr:.7371,assinrte:.7826,assinsts:.7298,medptclustering:.6935,bbcnewsptclustering:.2616,wikipediaptcategoriesclusteringp2p:.6576,cstnewsclustering:1,quati:.499,juristcu:.5786,brtaxqar:.2843,faquadir:.796,medptretrieval:.7658,quatireranking:.5611,juristcureranking:.7247},rank:26},{id:`intfloat/multilingual-e5-large`,name:`multilingual-e5-large`,tier:`Pool`,params:560,license:`mit`,type:`open`,n_tasks:18,mean_16:.6579,mean_18:.6565,scores:{hatebr:.8204,offcombr:.7338,tweetsentbr:.6152,toxsynpt:.8557,inferbr:.7673,assinrte:.7874,assinsts:.7437,medptclustering:.6091,bbcnewsptclustering:.2894,wikipediaptcategoriesclusteringp2p:.5947,cstnewsclustering:1,quati:.4881,juristcu:.5337,brtaxqar:.1884,faquadir:.8474,medptretrieval:.6797,quatireranking:.5715,juristcureranking:.6908},rank:27},{id:`Snowflake/snowflake-arctic-embed-l-v2.0`,name:`snowflake-arctic-embed-l-v2.0`,tier:`Held-out`,params:568,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6553,mean_18:.6531,scores:{hatebr:.8364,offcombr:.743,tweetsentbr:.5813,toxsynpt:.8344,inferbr:.6635,assinrte:.7942,assinsts:.7429,medptclustering:.6186,bbcnewsptclustering:.2713,wikipediaptcategoriesclusteringp2p:.588,cstnewsclustering:1,quati:.4545,juristcu:.5586,brtaxqar:.2664,faquadir:.7906,medptretrieval:.7469,quatireranking:.5502,juristcureranking:.7153},rank:28},{id:`ibm-granite/granite-embedding-311m-multilingual-r2`,name:`granite-embedding-311m-multilingual-r2`,tier:`PT-native v0.6`,params:311,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6464,mean_18:.6474,scores:{hatebr:.7934,offcombr:.7101,tweetsentbr:.5286,toxsynpt:.7318,inferbr:.6265,assinrte:.7753,assinsts:.7245,medptclustering:.6459,bbcnewsptclustering:.3108,wikipediaptcategoriesclusteringp2p:.6329,cstnewsclustering:1,quati:.481,juristcu:.5576,brtaxqar:.3638,faquadir:.7696,medptretrieval:.7179,quatireranking:.5799,juristcureranking:.704},rank:29},{id:`intfloat/multilingual-e5-base`,name:`multilingual-e5-base`,tier:`Pool`,params:278,license:`mit`,type:`open`,n_tasks:18,mean_16:.6376,mean_18:.6382,scores:{hatebr:.7939,offcombr:.7266,tweetsentbr:.5866,toxsynpt:.827,inferbr:.7019,assinrte:.7955,assinsts:.7408,medptclustering:.6307,bbcnewsptclustering:.2851,wikipediaptcategoriesclusteringp2p:.5703,cstnewsclustering:1,quati:.4587,juristcu:.4912,brtaxqar:.1915,faquadir:.8365,medptretrieval:.619,quatireranking:.5697,juristcureranking:.6619},rank:30},{id:`PORTULAN/serafim-335m-portuguese-pt-sentence-encoder-ir`,name:`serafim-335m-portuguese-pt-sentence-encoder-ir`,tier:`Pool`,params:335,license:`mit`,type:`open`,n_tasks:18,mean_16:.6317,mean_18:.6324,scores:{hatebr:.8051,offcombr:.7043,tweetsentbr:.5415,toxsynpt:.8186,inferbr:.7273,assinrte:.7936,assinsts:.7548,medptclustering:.6369,bbcnewsptclustering:.2763,wikipediaptcategoriesclusteringp2p:.5746,cstnewsclustering:1,quati:.3409,juristcu:.5429,brtaxqar:.198,faquadir:.7798,medptretrieval:.6617,quatireranking:.5189,juristcureranking:.7085},rank:31},{id:`PORTULAN/serafim-100m-portuguese-pt-sentence-encoder-ir`,name:`serafim-100m-portuguese-pt-sentence-encoder-ir`,tier:`Pool`,params:100,license:`mit`,type:`open`,n_tasks:18,mean_16:.6313,mean_18:.6319,scores:{hatebr:.8179,offcombr:.699,tweetsentbr:.5502,toxsynpt:.81,inferbr:.7581,assinrte:.83,assinsts:.7739,medptclustering:.5545,bbcnewsptclustering:.2724,wikipediaptcategoriesclusteringp2p:.59,cstnewsclustering:1,quati:.3203,juristcu:.5533,brtaxqar:.2123,faquadir:.7821,medptretrieval:.642,quatireranking:.4955,juristcureranking:.7121},rank:32},{id:`PORTULAN/serafim-900m-portuguese-pt-sentence-encoder-ir`,name:`serafim-900m-portuguese-pt-sentence-encoder-ir`,tier:`Pool`,params:900,license:`mit`,type:`open`,n_tasks:18,mean_16:.6301,mean_18:.63,scores:{hatebr:.7983,offcombr:.7029,tweetsentbr:.5445,toxsynpt:.8196,inferbr:.733,assinrte:.769,assinsts:.7388,medptclustering:.5612,bbcnewsptclustering:.2593,wikipediaptcategoriesclusteringp2p:.5556,cstnewsclustering:1,quati:.343,juristcu:.5666,brtaxqar:.1863,faquadir:.8114,medptretrieval:.6913,quatireranking:.5319,juristcureranking:.7276},rank:33},{id:`microsoft/harrier-oss-v1-270m`,name:`harrier-oss-v1-270m`,tier:`Pending`,params:270,license:`mit`,type:`open`,n_tasks:18,mean_16:.6257,mean_18:.6308,scores:{hatebr:.807,offcombr:.7101,tweetsentbr:.5856,toxsynpt:.8378,inferbr:.7194,assinrte:.8053,assinsts:.7648,medptclustering:.6749,bbcnewsptclustering:.3429,wikipediaptcategoriesclusteringp2p:.7475,cstnewsclustering:1,quati:0,juristcu:.549,brtaxqar:.2074,faquadir:.7682,medptretrieval:.6714,quatireranking:.4918,juristcureranking:.6715},rank:34},{id:`jinaai/jina-embeddings-v5-text-nano`,name:`jina-embeddings-v5-text-nano`,tier:`Pending`,params:36,license:`cc-by-nc-4.0`,type:`open`,n_tasks:18,mean_16:.6166,mean_18:.6199,scores:{hatebr:.7425,offcombr:.6952,tweetsentbr:.4667,toxsynpt:.7902,inferbr:.57,assinrte:.6773,assinsts:.6067,medptclustering:.6611,bbcnewsptclustering:.2941,wikipediaptcategoriesclusteringp2p:.6801,cstnewsclustering:1,quati:.5031,juristcu:.493,brtaxqar:.272,faquadir:.7871,medptretrieval:.7064,quatireranking:.5731,juristcureranking:.6403},rank:35},{id:`intfloat/multilingual-e5-small`,name:`multilingual-e5-small`,tier:`Pool`,params:118,license:`mit`,type:`open`,n_tasks:18,mean_16:.6142,mean_18:.6162,scores:{hatebr:.7695,offcombr:.7043,tweetsentbr:.5585,toxsynpt:.8034,inferbr:.7206,assinrte:.8006,assinsts:.7381,medptclustering:.6408,bbcnewsptclustering:.2636,wikipediaptcategoriesclusteringp2p:.5564,cstnewsclustering:1,quati:.3955,juristcu:.4935,brtaxqar:.1489,faquadir:.8272,medptretrieval:.4912,quatireranking:.5233,juristcureranking:.656},rank:36},{id:`ibm-granite/granite-embedding-107m-multilingual`,name:`granite-embedding-107m-multilingual`,tier:`Phase D v0.8.3`,params:107,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.608,mean_18:.6132,scores:{hatebr:.7628,offcombr:.6879,tweetsentbr:.5435,toxsynpt:.7702,inferbr:.606,assinrte:.826,assinsts:.7474,medptclustering:.6281,bbcnewsptclustering:.3104,wikipediaptcategoriesclusteringp2p:.6318,cstnewsclustering:1,quati:.3679,juristcu:.5099,brtaxqar:.1613,faquadir:.7418,medptretrieval:.5833,quatireranking:.5066,juristcureranking:.6532},rank:37},{id:`codefuse-ai/F2LLM-v2-160M`,name:`F2LLM-v2-160M`,tier:`Phase D v0.8.2`,params:160,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.6038,mean_18:.6121,scores:{hatebr:.7472,offcombr:.6522,tweetsentbr:.5167,toxsynpt:.7426,inferbr:.6049,assinrte:.7842,assinsts:.7169,medptclustering:.5892,bbcnewsptclustering:.3566,wikipediaptcategoriesclusteringp2p:.6836,cstnewsclustering:1,quati:.3799,juristcu:.5222,brtaxqar:.1629,faquadir:.7118,medptretrieval:.6677,quatireranking:.501,juristcureranking:.6775},rank:38},{id:`rufimelo/Legal-BERTimbau-sts-large`,name:`Legal-BERTimbau-sts-large`,tier:`Phase C`,params:335,license:`mit`,type:`open`,n_tasks:18,mean_16:.5981,mean_18:.6029,scores:{hatebr:.7991,offcombr:.7275,tweetsentbr:.5741,toxsynpt:.8376,inferbr:.7518,assinrte:.8445,assinsts:.7761,medptclustering:.6112,bbcnewsptclustering:.2835,wikipediaptcategoriesclusteringp2p:.6449,cstnewsclustering:1,quati:.1895,juristcu:.424,brtaxqar:.1569,faquadir:.7031,medptretrieval:.4911,quatireranking:.4553,juristcureranking:.5822},rank:39},{id:`ibm-granite/granite-embedding-97m-multilingual-r2`,name:`granite-embedding-97m-multilingual-r2`,tier:`Phase D v0.8.2`,params:97,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.5976,mean_18:.604,scores:{hatebr:.7505,offcombr:.6952,tweetsentbr:.4843,toxsynpt:.7099,inferbr:.5782,assinrte:.7546,assinsts:.7012,medptclustering:.6665,bbcnewsptclustering:.3091,wikipediaptcategoriesclusteringp2p:.6274,cstnewsclustering:1,quati:.4005,juristcu:.4562,brtaxqar:.2014,faquadir:.7543,medptretrieval:.6498,quatireranking:.5171,juristcureranking:.6152},rank:40},{id:`Alibaba-NLP/gte-Qwen2-1.5B-instruct`,name:`gte-Qwen2-1.5B-instruct`,tier:`Held-out`,params:1500,license:`apache-2.0`,type:`open`,n_tasks:6,mean_16:.5797,mean_18:.5797,scores:{hatebr:.8195,toxsynpt:.8853,assinsts:.7397,quati:.2208,juristcu:.3217,medptretrieval:.4912},rank:41},{id:`sentence-transformers/paraphrase-multilingual-mpnet-base-v2`,name:`paraphrase-multilingual-mpnet-base-v2`,tier:`Pool`,params:278,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.5757,mean_18:.5791,scores:{hatebr:.8034,offcombr:.6725,tweetsentbr:.5599,toxsynpt:.841,inferbr:.8388,assinrte:.8049,assinsts:.7204,medptclustering:.5921,bbcnewsptclustering:.213,wikipediaptcategoriesclusteringp2p:.5062,cstnewsclustering:1,quati:.2467,juristcu:.374,brtaxqar:.0906,faquadir:.6308,medptretrieval:.5531,quatireranking:.4418,juristcureranking:.5346},rank:42},{id:`stjiris/bert-large-portuguese-cased-legal-mlm-sts-v1.0`,name:`bert-large-portuguese-cased-legal-mlm-sts-v1.0`,tier:`PT-native v0.6`,params:335,license:`mit`,type:`open`,n_tasks:18,mean_16:.5753,mean_18:.5805,scores:{hatebr:.7971,offcombr:.7324,tweetsentbr:.554,toxsynpt:.8316,inferbr:.7436,assinrte:.8411,assinsts:.7694,medptclustering:.6151,bbcnewsptclustering:.2442,wikipediaptcategoriesclusteringp2p:.5634,cstnewsclustering:1,quati:.1799,juristcu:.3552,brtaxqar:.1247,faquadir:.6461,medptretrieval:.4866,quatireranking:.4163,juristcureranking:.5477},rank:43},{id:`sentence-transformers/LaBSE`,name:`LaBSE`,tier:`Phase A`,params:471,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.546,mean_18:.557,scores:{hatebr:.8102,offcombr:.7159,tweetsentbr:.5644,toxsynpt:.8056,inferbr:.577,assinrte:.8077,assinsts:.7083,medptclustering:.6296,bbcnewsptclustering:.29,wikipediaptcategoriesclusteringp2p:.5822,cstnewsclustering:1,quati:.1232,juristcu:.3004,brtaxqar:.1179,faquadir:.6474,medptretrieval:.4399,quatireranking:.3962,juristcureranking:.5099},rank:44},{id:`rufimelo/Legal-BERTimbau-sts-large-ma-v3`,name:`Legal-BERTimbau-sts-large-ma-v3`,tier:`Phase C`,params:335,license:`mit`,type:`open`,n_tasks:18,mean_16:.5415,mean_18:.5532,scores:{hatebr:.799,offcombr:.6836,tweetsentbr:.5734,toxsynpt:.8709,inferbr:.823,assinrte:.8515,assinsts:.7634,medptclustering:.6616,bbcnewsptclustering:.2943,wikipediaptcategoriesclusteringp2p:.5628,cstnewsclustering:1,quati:.1228,juristcu:.2057,brtaxqar:.0686,faquadir:.4783,medptretrieval:.4346,quatireranking:.389,juristcureranking:.3756},rank:45},{id:`neuralmind/bert-base-portuguese-cased`,name:`bert-base-portuguese-cased`,tier:`Phase C`,params:110,license:`mit`,type:`open`,n_tasks:18,mean_16:.5061,mean_18:.5209,scores:{hatebr:.819,offcombr:.7449,tweetsentbr:.554,toxsynpt:.854,inferbr:.5149,assinrte:.6901,assinsts:.6442,medptclustering:.6737,bbcnewsptclustering:.2789,wikipediaptcategoriesclusteringp2p:.6201,cstnewsclustering:1,quati:.1175,juristcu:.1725,brtaxqar:.0845,faquadir:.5658,medptretrieval:.3158,quatireranking:.3882,juristcureranking:.3387},rank:46},{id:`neuralmind/bert-large-portuguese-cased`,name:`bert-large-portuguese-cased`,tier:`Phase C`,params:335,license:`mit`,type:`open`,n_tasks:18,mean_16:.5057,mean_18:.5217,scores:{hatebr:.8274,offcombr:.7444,tweetsentbr:.5721,toxsynpt:.8582,inferbr:.5337,assinrte:.6657,assinsts:.6608,medptclustering:.68,bbcnewsptclustering:.299,wikipediaptcategoriesclusteringp2p:.625,cstnewsclustering:1,quati:.0967,juristcu:.1933,brtaxqar:.0422,faquadir:.4935,medptretrieval:.358,quatireranking:.378,juristcureranking:.3621},rank:47},{id:`mixedbread-ai/mxbai-embed-large-v1`,name:`mxbai-embed-large-v1`,tier:`Held-out`,params:335,license:`apache-2.0`,type:`open`,n_tasks:6,mean_16:.4975,mean_18:.4975,scores:{hatebr:.6653,toxsynpt:.6927,assinsts:.5639,quati:.2286,juristcu:.3415,medptretrieval:.4931},rank:48},{id:`PORTULAN/albertina-900m-portuguese-ptbr-encoder`,name:`albertina-900m-portuguese-ptbr-encoder`,tier:`Phase D v0.8`,params:900,license:`mit`,type:`open`,n_tasks:18,mean_16:.4819,mean_18:.4992,scores:{hatebr:.7563,offcombr:.7029,tweetsentbr:.506,toxsynpt:.8274,inferbr:.4942,assinrte:.6587,assinsts:.6243,medptclustering:.614,bbcnewsptclustering:.2756,wikipediaptcategoriesclusteringp2p:.6096,cstnewsclustering:1,quati:.1023,juristcu:.2162,brtaxqar:.0603,faquadir:.5259,medptretrieval:.248,quatireranking:.3657,juristcureranking:.3991},rank:49},{id:`sentence-transformers/all-MiniLM-L12-v2`,name:`all-MiniLM-L12-v2`,tier:`Phase A`,params:33,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.4758,mean_18:.4928,scores:{hatebr:.6199,offcombr:.6604,tweetsentbr:.4341,toxsynpt:.6589,inferbr:.4737,assinrte:.6511,assinsts:.5333,medptclustering:.5188,bbcnewsptclustering:.2576,wikipediaptcategoriesclusteringp2p:.5364,cstnewsclustering:1,quati:.1603,juristcu:.3362,brtaxqar:.1356,faquadir:.5622,medptretrieval:.4047,quatireranking:.4098,juristcureranking:.5167},rank:50},{id:`nvidia/llama-embed-nemotron-8b`,name:`llama-embed-nemotron-8b`,tier:`Pending`,params:8e3,license:`llama-3.1`,type:`open`,n_tasks:18,mean_16:.467,mean_18:.4873,scores:{hatebr:.7762,offcombr:.7488,tweetsentbr:.5647,toxsynpt:.8479,inferbr:.3945,assinrte:.5627,assinsts:.589,medptclustering:.6108,bbcnewsptclustering:.2997,wikipediaptcategoriesclusteringp2p:.5687,cstnewsclustering:1,quati:.0257,juristcu:.1595,brtaxqar:.1111,faquadir:.4709,medptretrieval:.5441,quatireranking:.2054,juristcureranking:.2922},rank:51},{id:`PORTULAN/albertina-100m-portuguese-ptbr-encoder`,name:`albertina-100m-portuguese-ptbr-encoder`,tier:`Phase D v0.8`,params:100,license:`mit`,type:`open`,n_tasks:18,mean_16:.4607,mean_18:.4823,scores:{hatebr:.7063,offcombr:.7271,tweetsentbr:.4928,toxsynpt:.8075,inferbr:.499,assinrte:.6566,assinsts:.6126,medptclustering:.5621,bbcnewsptclustering:.3106,wikipediaptcategoriesclusteringp2p:.6229,cstnewsclustering:1,quati:.0791,juristcu:.1853,brtaxqar:.047,faquadir:.5455,medptretrieval:.1795,quatireranking:.311,juristcureranking:.3365},rank:52},{id:`sentence-transformers/all-mpnet-base-v2`,name:`all-mpnet-base-v2`,tier:`Phase A`,params:110,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.4533,mean_18:.4737,scores:{hatebr:.635,offcombr:.6874,tweetsentbr:.4234,toxsynpt:.6501,inferbr:.4582,assinrte:.6196,assinsts:.5062,medptclustering:.5757,bbcnewsptclustering:.2736,wikipediaptcategoriesclusteringp2p:.5704,cstnewsclustering:1,quati:.1248,juristcu:.267,brtaxqar:.0936,faquadir:.468,medptretrieval:.3885,quatireranking:.3387,juristcureranking:.4468},rank:53},{id:`sentence-transformers/all-MiniLM-L6-v2`,name:`all-MiniLM-L6-v2`,tier:`Phase A`,params:22,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.4475,mean_18:.4688,scores:{hatebr:.5968,offcombr:.656,tweetsentbr:.4381,toxsynpt:.6471,inferbr:.4743,assinrte:.628,assinsts:.53,medptclustering:.5431,bbcnewsptclustering:.2788,wikipediaptcategoriesclusteringp2p:.5661,cstnewsclustering:1,quati:.0949,juristcu:.2792,brtaxqar:.0897,faquadir:.4761,medptretrieval:.3585,quatireranking:.3185,juristcureranking:.4629},rank:54},{id:`BidirLM/BidirLM-1.7B-Embedding`,name:`BidirLM-1.7B-Embedding`,tier:`Pending`,params:1700,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.4186,mean_18:.4415,scores:{hatebr:.5774,offcombr:.5353,tweetsentbr:.4331,toxsynpt:.6405,inferbr:.6137,assinrte:.6431,assinsts:.5083,medptclustering:.4334,bbcnewsptclustering:.2497,wikipediaptcategoriesclusteringp2p:.2369,cstnewsclustering:1,quati:.3382,juristcu:.2588,brtaxqar:.1359,faquadir:.4143,medptretrieval:.1457,quatireranking:.4486,juristcureranking:.3349},rank:55},{id:`sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2`,name:`paraphrase-multilingual-MiniLM-L12-v2`,tier:`Pool`,params:117,license:`apache-2.0`,type:`open`,n_tasks:18,mean_16:.4028,mean_18:.4286,scores:{hatebr:.5526,offcombr:.5981,tweetsentbr:.3744,toxsynpt:.5872,inferbr:.39,assinrte:.3715,assinsts:.2487,medptclustering:.5134,bbcnewsptclustering:.2696,wikipediaptcategoriesclusteringp2p:.3328,cstnewsclustering:1,quati:.2033,juristcu:.3021,brtaxqar:.0302,faquadir:.5735,medptretrieval:.5098,quatireranking:.3869,juristcureranking:.4705},rank:56}]},pe=q(`<div class=app><header><h1>MTEB(por) Leaderboard</h1><p class=subtitle>Massive Text Embedding Benchmark — Brazilian Portuguese · v<!> · <!> models · 18 tasks · updated </p><p class=links><a href=https://github.com/tardellirs/mteb-pt target=_blank>GitHub</a> ·<a href=https://huggingface.co/mteb-pt target=_blank>HF Org</a> ·<a href=https://huggingface.co/datasets/mteb-pt/mteb-pt-results target=_blank>Raw Results</a></p></header><div class=controls><input type=text placeholder="Search model…"class=search><select><option value=all>All models</option><option value=open>Open weights</option><option value=closed>Closed / API</option></select><select><option value=all>All tiers</option></select><div class=toggle-group><button>mean_16</button><button>mean_18</button></div><label class=cb><input type=checkbox>show BBC + CST</label></div><div class=meta-bar>Showing <!> / </div><div class=table-wrap><table><thead><tr><th class=sticky>#</th><th class="sticky model-col">Model</th><th>Params</th><th>License</th><th class=metric>mean_</th></tr></thead><tbody></tbody></table></div><footer><p><b>mean_16</b> = headline (excludes CSTNews degenerate + BBC copyright).<b>mean_18</b> = full task set. Per-task scores: nDCG@10 for retrieval, accuracy for classification/NLI, Spearman for STS, V-measure for clustering.<br>Built from <a href=https://huggingface.co/datasets/mteb-pt/mteb-pt-results>mteb-pt/mteb-pt-results</a> · Cite the <a href=https://github.com/tardellirs/mteb-pt#citation>paper</a> · Submissions via <a href=https://github.com/tardellirs/mteb-pt/issues>GitHub Issues</a>.`),me=q(`<option>`),he=q(`<th class=task>`),ge=q(`<tr><td class=sticky></td><td class="sticky model-col"><a target=_blank></a><span class=tier-badge></span></td><td></td><td class=license></td><td class=metric><b>`),_e=q(`<td class=task>`),ve=$.tasks.non_retrieval,ye=$.tasks.retrieval,be=new Set($.tasks.headline_excluded),xe=[...ve,...ye],Se={hatebr:`HateBR`,offcombr:`OffCom`,tweetsentbr:`TwSent`,toxsynpt:`ToxSyn`,inferbr:`InfBR`,assinrte:`AsRTE`,assinsts:`AsSTS`,medptclustering:`MedClus`,bbcnewsptclustering:`BBC`,wikipediaptcategoriesclusteringp2p:`Wiki`,cstnewsclustering:`CST`,quati:`Quati`,juristcu:`JurT`,brtaxqar:`BRTax`,faquadir:`FaQ`,medptretrieval:`MedR`,quatireranking:`QuRk`,juristcureranking:`JurR`};function Ce(){let[e,t]=x(`mean_16`),[n,r]=x(!0),[i,a]=x(`all`),[o,s]=x(`all`),[c,l]=x(``),[u,d]=x(!1),[f,p]=x(`16`),m=[...new Set($.models.map(e=>e.tier))].sort(),h=C(()=>{let e=$.models,t=i();t===`open`&&(e=e.filter(e=>e.type===`open`)),t===`closed`&&(e=e.filter(e=>e.type!==`open`));let n=o();n!==`all`&&(e=e.filter(e=>e.tier===n));let r=c().toLowerCase().trim();return r&&(e=e.filter(e=>e.name.toLowerCase().includes(r)||e.id.toLowerCase().includes(r))),e}),g=C(()=>{let t=[...h()],r=e(),i=n();return t.sort((e,t)=>{let n,a;if(r===`rank`||r===`mean_16`||r===`mean_18`||r===`params`)n=e[r]??-1,a=t[r]??-1;else if(r===`name`)return i?t.name.localeCompare(e.name):e.name.localeCompare(t.name);else n=e.scores[r]??-1,a=t.scores[r]??-1;return i?a-n:n-a}),t}),_=i=>{e()===i?r(!n()):(t(i),r(!0))},v=t=>e()===t?n()?` ↓`:` ↑`:``,y=e=>e==null?`—`:e.toFixed(3),b=e=>e==null?`—`:e>=1e3?`${(e/1e3).toFixed(1)}B`:`${e}M`,w=C(()=>u()?xe:xe.filter(e=>!be.has(e)));return(()=>{var e=pe(),t=e.firstChild,n=t.firstChild.nextSibling,r=n.firstChild.nextSibling,x=r.nextSibling.nextSibling;x.nextSibling;var C=t.nextSibling,T=C.firstChild,E=T.nextSibling,D=E.nextSibling;D.firstChild;var O=D.nextSibling,k=O.firstChild,A=k.nextSibling,j=O.nextSibling.firstChild,M=C.nextSibling,N=M.firstChild.nextSibling;N.nextSibling;var P=M.nextSibling.firstChild.firstChild,F=P.firstChild,I=F.firstChild;I.firstChild;var L=I.nextSibling;L.firstChild;var R=L.nextSibling;R.firstChild;var z=R.nextSibling.nextSibling;z.firstChild;var B=P.nextSibling;return Y(n,()=>$.version,r),Y(n,()=>$.n_models,x),Y(n,()=>$.generated_at,null),T.$$input=e=>l(e.currentTarget.value),E.addEventListener(`change`,e=>a(e.currentTarget.value)),D.addEventListener(`change`,e=>s(e.currentTarget.value)),Y(D,G(K,{each:m,children:e=>(()=>{var t=me();return t.value=e,Y(t,e),t})()}),null),k.$$click=()=>p(`16`),A.$$click=()=>p(`18`),j.addEventListener(`change`,e=>d(e.currentTarget.checked)),Y(M,()=>h().length,N),Y(M,()=>$.n_models,null),I.$$click=()=>_(`rank`),Y(I,()=>v(`rank`),null),L.$$click=()=>_(`name`),Y(L,()=>v(`name`),null),R.$$click=()=>_(`params`),Y(R,()=>v(`params`),null),z.$$click=()=>_(f()===`16`?`mean_16`:`mean_18`),Y(z,f,null),Y(z,()=>v(f()===`16`?`mean_16`:`mean_18`),null),Y(F,G(K,{get each(){return w()},children:e=>(()=>{var t=he();return t.$$click=()=>_(e),J(t,`title`,e),Y(t,()=>Se[e]||e,null),Y(t,()=>v(e),null),t})()}),null),Y(B,G(K,{get each(){return g()},children:(e,t)=>(()=>{var n=ge(),r=n.firstChild,i=r.nextSibling,a=i.firstChild,o=a.nextSibling,s=i.nextSibling,c=s.nextSibling,l=c.nextSibling.firstChild;return Y(r,()=>t()+1),Y(a,()=>e.name),Y(o,()=>e.tier),Y(s,()=>b(e.params)),Y(c,()=>e.license),Y(l,()=>y(f()===`16`?e.mean_16:e.mean_18)),Y(n,G(K,{get each(){return w()},children:t=>(()=>{var n=_e();return Y(n,()=>y(e.scores[t])),S(()=>n.classList.toggle(`best`,e.scores[t]!=null&&e.scores[t]>=.7)),n})()}),null),S(t=>{var n=`https://huggingface.co/${e.id}`,r=e.id;return n!==t.e&&J(a,`href`,t.e=n),r!==t.t&&J(a,`title`,t.t=r),t},{e:void 0,t:void 0}),n})()})),S(e=>{var t=f()===`16`,n=f()===`18`;return t!==e.e&&k.classList.toggle(`active`,e.e=t),n!==e.t&&A.classList.toggle(`active`,e.t=n),e},{e:void 0,t:void 0}),S(()=>T.value=c()),S(()=>E.value=i()),S(()=>D.value=o()),S(()=>j.checked=u()),e})()}le([`input`,`click`]),ce(()=>G(Ce,{}),document.getElementById(`root`));
favicon.svg ADDED
icons.svg ADDED
index.html CHANGED
@@ -1,19 +1,17 @@
1
  <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
19
  </html>
 
1
  <!doctype html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="UTF-8" />
5
+ <link rel="icon" type="image/svg+xml" href="/favicon.svg" />
6
+ <meta name="viewport" content="width=device-width, initial-scale=1.0" />
7
+ <title>MTEB(por) Leaderboard Brazilian Portuguese</title>
8
+ <meta name="description" content="MTEB(por) — Massive Text Embedding Benchmark for Brazilian Portuguese. 56 models × 18 tasks." />
9
+ <meta property="og:title" content="MTEB(por) Leaderboard" />
10
+ <meta property="og:description" content="56 embedding models evaluated on 18 native PT-BR tasks." />
11
+ <script type="module" crossorigin src="/assets/index-DB6Y9hrY.js"></script>
12
+ <link rel="stylesheet" crossorigin href="/assets/index-D0qkT26e.css">
13
+ </head>
14
+ <body>
15
+ <div id="root"></div>
16
+ </body>
 
 
17
  </html>