File size: 29,849 Bytes
826e4fd | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 | ---
tags:
- sentence-transformers
- cross-encoder
- reranker
- generated_from_trainer
- dataset_size:9383
- loss:BinaryCrossEntropyLoss
base_model: BAAI/bge-m3
pipeline_tag: text-ranking
library_name: sentence-transformers
metrics:
- pearson
- spearman
model-index:
- name: CrossEncoder based on BAAI/bge-m3
results:
- task:
type: cross-encoder-correlation
name: Cross Encoder Correlation
dataset:
name: explorer validation
type: explorer-validation
metrics:
- type: pearson
value: 0.878154266203835
name: Pearson
- type: spearman
value: 0.8642166510510423
name: Spearman
---
# CrossEncoder based on BAAI/bge-m3
This is a [Cross Encoder](https://www.sbert.net/docs/cross_encoder/usage/usage.html) model finetuned from [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3) using the [sentence-transformers](https://www.SBERT.net) library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.
## Model Details
### Model Description
- **Model Type:** Cross Encoder
- **Base model:** [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3) <!-- at revision 5617a9f61b028005a4858fdac845db406aefb181 -->
- **Maximum Sequence Length:** 512 tokens
- **Number of Output Labels:** 1 label
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Documentation:** [Cross Encoder Documentation](https://www.sbert.net/docs/cross_encoder/usage/usage.html)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
- **Hugging Face:** [Cross Encoders on Hugging Face](https://huggingface.co/models?library=sentence-transformers&other=cross-encoder)
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import CrossEncoder
# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of texts
pairs = [
['When did the operator of SS Nomadic go out of business?', 'SS "Nomadic" was a steamship of the White Star Line. She was laid down in 1891, in yard 236 at Harland and Wolff Shipyards, Belfast, as a livestock carrier and completed on 14 April 1891.\n\nIn ancient times, Antrim was inhabited by a Celtic people called the Darini. In the early Middle Ages, southern County Antrim was part of the Kingdom of Ulidia, ruled by the Dál Fiatach clans Keenan and MacDonlevy/McDunlavey; the north was part of Dál Riada, which stretched into what is now western Scotland over the Irish Sea. Dál Riada was ruled by the O\'Lynch clan, who were vassals of the Ulidians. Besides the Ulidians and Dál Riada, there were the Dál nAraide of lower County Antrim, and the Cruthin, who were pre-Gaelic Celts and probably related to the Picts of Britain. Between the 8th and 11th centuries Antrim was exposed to the inroads of the Vikings.\n\nWhite Star Line Former type Partnership Industry Shipping, transportation Fate merged with Cunard Line Successor Cunard White Star Line Founded 1845 (1845) in Liverpool, England Defunct 1934 Area served Transatlantic Parent Ismay, Imrie and Co. Website www.cunard.co.uk'],
['Who founded the college Lawrence Humphrey attended?', "Lawrence Humphrey (or Laurence Humfrey) DD (1527? – 1 February 1590) was an English theologian, who was President of Magdalen College, Oxford, and Dean successively of Gloucester and Winchester.\n\nProminent theatre companies in Oklahoma include, in the capital city, Oklahoma City Theatre Company, Carpenter Square Theatre, Oklahoma Shakespeare in the Park, and CityRep. CityRep is a professional company affording equity points to those performers and technical theatre professionals. In Tulsa, Oklahoma's oldest resident professional company is American Theatre Company, and Theatre Tulsa is the oldest community theatre company west of the Mississippi. Other companies in Tulsa include Heller Theatre and Tulsa Spotlight Theater. The cities of Norman, Lawton, and Stillwater, among others, also host well-reviewed community theatre companies.\n\nHe was President of Magdalen College, Oxford, from 1480 to 1507; previously he had been a Fellow of New College, Oxford, and was brought in by William Waynflete. He was Vice-Chancellor of the University of Oxford in 1484–5, and Chancellor of the University of Oxford in 1502."],
['What was the new record label of the performer of Fame (The Game)?', "In Europe and Australia, the system was released to two separate marketing regions. One region consisted of most of mainland Europe (excluding Italy), and distribution there was handled by a number of different companies, with Nintendo responsible for most cartridge releases. Most of this region saw a 1986 release. Mattel handled distribution for the other region, consisting of the United Kingdom, Ireland, Canada, Italy, Australia and New Zealand, starting the following year. Not until the 1990s did Nintendo's newly created European branch direct distribution throughout Europe.\n\nBoeing 747 Boeing 747 - 100 of Pan American World Airways, the 747's launch customer, in September 1978 Role Wide - body jet airliner National origin United States Manufacturer Boeing Commercial Airplanes First flight February 9, 1969 Introduction January 22, 1970 with Pan American World Airways Status In service Primary users British Airways Lufthansa Korean Air Atlas Air Produced 1968 -- present Number built 1,544 as of April 2018 Program cost US $1 billion at roll - out (1968) 7.0 billion today Unit cost 747 - 100: US $24 million (1972) 747 - 200: US $39 million (1976) 747 - 300: US $83 million (1982) Variants Boeing 747SP Boeing 747 - 400 Boeing 747 - 8 Boeing VC - 25 Boeing E-4 Developed into Boeing YAL - 1 Boeing Dreamlifter\n\nThe Drinkard Singers were an American gospel singing group, most successful in the late 1950s and important in the careers of singers Cissy Houston, Dionne Warwick, Dee Dee Warwick, and Judy Clay."],
['When was the publisher of Crux launched?', 'Sleep Dank, also known as Sleep Da Danker or Sleepdank, is an American rapper signed to the late Mac Dre\'s label Thizz Entertainment.\n\nStrasbourg, well known as centre of humanism, has a long history of excellence in higher-education, at the crossroads of French and German intellectual traditions. Although Strasbourg had been annexed by the Kingdom of France in 1683, it still remained connected to the German-speaking intellectual world throughout the 18th century and the university attracted numerous students from the Holy Roman Empire, including Goethe, Metternich and Montgelas, who studied law in Strasbourg, among the most prominent. Nowadays, Strasbourg is known to offer among the best university courses in France, after Paris.\n\nGrinspoon is an Australian rock band from Lismore, New South Wales formed in 1995 and fronted by Phil Jamieson on vocals and guitar with Pat Davern on guitar, Joe Hansen on bass guitar and Kristian Hopes on drums. Also in 1995, they won the Triple J-sponsored Unearthed competition for Lismore, with their post-grunge song "Sickfest". Their name was taken from Dr. Lester Grinspoon an Associate Professor Emeritus of Psychiatry at Harvard Medical School, who supports marijuana for medical use.'],
['In what ways did Kanye draw inspiration from U2, Led Zeppelin, and the performer of Coming Down Again?', 'Titus Lucretius Tricipitinus was a politician and military leader in the early days of the Roman Republic. Twice, in the years 508 and 504 BC, he was elected Roman Consul, alongside Publius Valerius Poplicola. Also a military leader, he was victorious against Lars Porsena during his first consulate. According to Livy, he led the Roman army together with Valerius against the Sabines in 504 BC and both consuls were awarded the honour of a triumph, however the Fasti Triumphales only mention the triumph of Valerius, in May 504 BC.\n\nFresh off spending the previous year touring the world with U2 on their Vertigo Tour, West felt inspired to compose anthemic rap songs that could operate more efficiently in large arenas. To this end, West incorporated the synthesizer into his hip-hop production, utilized slower tempos, and experimented with electronic music and influenced by music of the 1980s. In addition to U2, West drew musical inspiration from arena rock bands such as The Rolling Stones and Led Zeppelin in terms of melody and chord progression. To make his next effort, the third in a planned tetralogy of education-themed studio albums, more introspective and personal in lyricism, West listened to folk and country singer-songwriters Bob Dylan and Johnny Cash in hopes of developing methods to augment his wordplay and storytelling ability.\n\n"Coming Down Again" is a song by the Rolling Stones featured on their 1973 album "Goats Head Soup". It is sung as a duet by Keith Richards and Mick Jagger.'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)
# Or rank different texts based on similarity to a single text
ranks = model.rank(
'When did the operator of SS Nomadic go out of business?',
[
'SS "Nomadic" was a steamship of the White Star Line. She was laid down in 1891, in yard 236 at Harland and Wolff Shipyards, Belfast, as a livestock carrier and completed on 14 April 1891.\n\nIn ancient times, Antrim was inhabited by a Celtic people called the Darini. In the early Middle Ages, southern County Antrim was part of the Kingdom of Ulidia, ruled by the Dál Fiatach clans Keenan and MacDonlevy/McDunlavey; the north was part of Dál Riada, which stretched into what is now western Scotland over the Irish Sea. Dál Riada was ruled by the O\'Lynch clan, who were vassals of the Ulidians. Besides the Ulidians and Dál Riada, there were the Dál nAraide of lower County Antrim, and the Cruthin, who were pre-Gaelic Celts and probably related to the Picts of Britain. Between the 8th and 11th centuries Antrim was exposed to the inroads of the Vikings.\n\nWhite Star Line Former type Partnership Industry Shipping, transportation Fate merged with Cunard Line Successor Cunard White Star Line Founded 1845 (1845) in Liverpool, England Defunct 1934 Area served Transatlantic Parent Ismay, Imrie and Co. Website www.cunard.co.uk',
"Lawrence Humphrey (or Laurence Humfrey) DD (1527? – 1 February 1590) was an English theologian, who was President of Magdalen College, Oxford, and Dean successively of Gloucester and Winchester.\n\nProminent theatre companies in Oklahoma include, in the capital city, Oklahoma City Theatre Company, Carpenter Square Theatre, Oklahoma Shakespeare in the Park, and CityRep. CityRep is a professional company affording equity points to those performers and technical theatre professionals. In Tulsa, Oklahoma's oldest resident professional company is American Theatre Company, and Theatre Tulsa is the oldest community theatre company west of the Mississippi. Other companies in Tulsa include Heller Theatre and Tulsa Spotlight Theater. The cities of Norman, Lawton, and Stillwater, among others, also host well-reviewed community theatre companies.\n\nHe was President of Magdalen College, Oxford, from 1480 to 1507; previously he had been a Fellow of New College, Oxford, and was brought in by William Waynflete. He was Vice-Chancellor of the University of Oxford in 1484–5, and Chancellor of the University of Oxford in 1502.",
"In Europe and Australia, the system was released to two separate marketing regions. One region consisted of most of mainland Europe (excluding Italy), and distribution there was handled by a number of different companies, with Nintendo responsible for most cartridge releases. Most of this region saw a 1986 release. Mattel handled distribution for the other region, consisting of the United Kingdom, Ireland, Canada, Italy, Australia and New Zealand, starting the following year. Not until the 1990s did Nintendo's newly created European branch direct distribution throughout Europe.\n\nBoeing 747 Boeing 747 - 100 of Pan American World Airways, the 747's launch customer, in September 1978 Role Wide - body jet airliner National origin United States Manufacturer Boeing Commercial Airplanes First flight February 9, 1969 Introduction January 22, 1970 with Pan American World Airways Status In service Primary users British Airways Lufthansa Korean Air Atlas Air Produced 1968 -- present Number built 1,544 as of April 2018 Program cost US $1 billion at roll - out (1968) 7.0 billion today Unit cost 747 - 100: US $24 million (1972) 747 - 200: US $39 million (1976) 747 - 300: US $83 million (1982) Variants Boeing 747SP Boeing 747 - 400 Boeing 747 - 8 Boeing VC - 25 Boeing E-4 Developed into Boeing YAL - 1 Boeing Dreamlifter\n\nThe Drinkard Singers were an American gospel singing group, most successful in the late 1950s and important in the careers of singers Cissy Houston, Dionne Warwick, Dee Dee Warwick, and Judy Clay.",
'Sleep Dank, also known as Sleep Da Danker or Sleepdank, is an American rapper signed to the late Mac Dre\'s label Thizz Entertainment.\n\nStrasbourg, well known as centre of humanism, has a long history of excellence in higher-education, at the crossroads of French and German intellectual traditions. Although Strasbourg had been annexed by the Kingdom of France in 1683, it still remained connected to the German-speaking intellectual world throughout the 18th century and the university attracted numerous students from the Holy Roman Empire, including Goethe, Metternich and Montgelas, who studied law in Strasbourg, among the most prominent. Nowadays, Strasbourg is known to offer among the best university courses in France, after Paris.\n\nGrinspoon is an Australian rock band from Lismore, New South Wales formed in 1995 and fronted by Phil Jamieson on vocals and guitar with Pat Davern on guitar, Joe Hansen on bass guitar and Kristian Hopes on drums. Also in 1995, they won the Triple J-sponsored Unearthed competition for Lismore, with their post-grunge song "Sickfest". Their name was taken from Dr. Lester Grinspoon an Associate Professor Emeritus of Psychiatry at Harvard Medical School, who supports marijuana for medical use.',
'Titus Lucretius Tricipitinus was a politician and military leader in the early days of the Roman Republic. Twice, in the years 508 and 504 BC, he was elected Roman Consul, alongside Publius Valerius Poplicola. Also a military leader, he was victorious against Lars Porsena during his first consulate. According to Livy, he led the Roman army together with Valerius against the Sabines in 504 BC and both consuls were awarded the honour of a triumph, however the Fasti Triumphales only mention the triumph of Valerius, in May 504 BC.\n\nFresh off spending the previous year touring the world with U2 on their Vertigo Tour, West felt inspired to compose anthemic rap songs that could operate more efficiently in large arenas. To this end, West incorporated the synthesizer into his hip-hop production, utilized slower tempos, and experimented with electronic music and influenced by music of the 1980s. In addition to U2, West drew musical inspiration from arena rock bands such as The Rolling Stones and Led Zeppelin in terms of melody and chord progression. To make his next effort, the third in a planned tetralogy of education-themed studio albums, more introspective and personal in lyricism, West listened to folk and country singer-songwriters Bob Dylan and Johnny Cash in hopes of developing methods to augment his wordplay and storytelling ability.\n\n"Coming Down Again" is a song by the Rolling Stones featured on their 1973 album "Goats Head Soup". It is sung as a duet by Keith Richards and Mick Jagger.',
]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Cross Encoder Correlation
* Dataset: `explorer-validation`
* Evaluated with [<code>CECorrelationEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CECorrelationEvaluator)
| Metric | Value |
|:-------------|:-----------|
| pearson | 0.8782 |
| **spearman** | **0.8642** |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 9,383 training samples
* Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
* Approximate statistics based on the first 1000 samples:
| | sentence_0 | sentence_1 | label |
|:--------|:------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------|
| type | string | string | float |
| details | <ul><li>min: 31 characters</li><li>mean: 78.86 characters</li><li>max: 168 characters</li></ul> | <ul><li>min: 428 characters</li><li>mean: 1667.98 characters</li><li>max: 4032 characters</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.49</li><li>max: 1.0</li></ul> |
* Samples:
| sentence_0 | sentence_1 | label |
|:--------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
| <code>When did the operator of SS Nomadic go out of business?</code> | <code>SS "Nomadic" was a steamship of the White Star Line. She was laid down in 1891, in yard 236 at Harland and Wolff Shipyards, Belfast, as a livestock carrier and completed on 14 April 1891.<br><br>In ancient times, Antrim was inhabited by a Celtic people called the Darini. In the early Middle Ages, southern County Antrim was part of the Kingdom of Ulidia, ruled by the Dál Fiatach clans Keenan and MacDonlevy/McDunlavey; the north was part of Dál Riada, which stretched into what is now western Scotland over the Irish Sea. Dál Riada was ruled by the O'Lynch clan, who were vassals of the Ulidians. Besides the Ulidians and Dál Riada, there were the Dál nAraide of lower County Antrim, and the Cruthin, who were pre-Gaelic Celts and probably related to the Picts of Britain. Between the 8th and 11th centuries Antrim was exposed to the inroads of the Vikings.<br><br>White Star Line Former type Partnership Industry Shipping, transportation Fate merged with Cunard Line Successor Cunard White Star Line Founded 1...</code> | <code>1.0</code> |
| <code>Who founded the college Lawrence Humphrey attended?</code> | <code>Lawrence Humphrey (or Laurence Humfrey) DD (1527? – 1 February 1590) was an English theologian, who was President of Magdalen College, Oxford, and Dean successively of Gloucester and Winchester.<br><br>Prominent theatre companies in Oklahoma include, in the capital city, Oklahoma City Theatre Company, Carpenter Square Theatre, Oklahoma Shakespeare in the Park, and CityRep. CityRep is a professional company affording equity points to those performers and technical theatre professionals. In Tulsa, Oklahoma's oldest resident professional company is American Theatre Company, and Theatre Tulsa is the oldest community theatre company west of the Mississippi. Other companies in Tulsa include Heller Theatre and Tulsa Spotlight Theater. The cities of Norman, Lawton, and Stillwater, among others, also host well-reviewed community theatre companies.<br><br>He was President of Magdalen College, Oxford, from 1480 to 1507; previously he had been a Fellow of New College, Oxford, and was brought in by William Way...</code> | <code>1.0</code> |
| <code>What was the new record label of the performer of Fame (The Game)?</code> | <code>In Europe and Australia, the system was released to two separate marketing regions. One region consisted of most of mainland Europe (excluding Italy), and distribution there was handled by a number of different companies, with Nintendo responsible for most cartridge releases. Most of this region saw a 1986 release. Mattel handled distribution for the other region, consisting of the United Kingdom, Ireland, Canada, Italy, Australia and New Zealand, starting the following year. Not until the 1990s did Nintendo's newly created European branch direct distribution throughout Europe.<br><br>Boeing 747 Boeing 747 - 100 of Pan American World Airways, the 747's launch customer, in September 1978 Role Wide - body jet airliner National origin United States Manufacturer Boeing Commercial Airplanes First flight February 9, 1969 Introduction January 22, 1970 with Pan American World Airways Status In service Primary users British Airways Lufthansa Korean Air Atlas Air Produced 1968 -- present Number built ...</code> | <code>0.0</code> |
* Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
```json
{
"activation_fn": "torch.nn.modules.linear.Identity",
"pos_weight": null
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 4
- `per_device_eval_batch_size`: 4
- `num_train_epochs`: 1
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 4
- `per_device_eval_batch_size`: 4
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 1
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `bf16`: False
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `parallelism_config`: None
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch_fused
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `project`: huggingface
- `trackio_space_id`: trackio
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: None
- `hub_always_push`: False
- `hub_revision`: None
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: no
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `liger_kernel_config`: None
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: True
- `prompts`: None
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: proportional
- `router_mapping`: {}
- `learning_rate_mapping`: {}
</details>
### Training Logs
| Epoch | Step | Training Loss | explorer-validation_spearman |
|:------:|:----:|:-------------:|:----------------------------:|
| 0.2131 | 500 | 0.5622 | 0.8333 |
| 0.4263 | 1000 | 0.4409 | 0.8522 |
| 0.6394 | 1500 | 0.3972 | 0.8593 |
| 0.8525 | 2000 | 0.3861 | 0.8642 |
### Framework Versions
- Python: 3.12.11
- Sentence Transformers: 5.2.0
- Transformers: 4.57.3
- PyTorch: 2.9.1+cu128
- Accelerate: 1.12.0
- Datasets: 4.4.2
- Tokenizers: 0.22.2
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
--> |