tomaarsen/multivector-gte-modernbert-base-msmarco-kd

ColBERT gte-modernbert-base distilled from bge-reranker-v2-gemma on MS MARCO

This is a Multi-Vector Encoder model trained on the ms-marco-en-bge-gemma dataset using the sentence-transformers library. It maps inputs to sequences of 128-dimensional token-level vectors and scores them with late interaction (MaxSim), useful for semantic search with late interaction.

Model Details

Model Description

• Model Type: Multi-Vector Encoder
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 128 dimensions
• Similarity Function: maxsim
• Supported Modality: Text
• Training Dataset:
  • ms-marco-en-bge-gemma
• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Multi-Vector Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Multi-Vector Encoders on Hugging Face

Full Model Architecture

MultiVectorEncoder(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'query_expansion': {'strategy': 'min', 'attend': False, 'token': None, 'length': 32}, 'architecture': 'ModernBertModel'})
  (1): Dense({'in_features': 768, 'out_features': 128, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity', 'module_input_name': 'token_embeddings', 'module_output_name': 'token_embeddings'})
  (2): MultiVectorMask({'skiplist_words': ['!', '"', '#', '$', '%', '&', "'", '(', ')', '*', '+', ',', '-', '.', '/', ':', ';', '<', '=', '>', '?', '@', '[', '\\', ']', '^', '_', '`', '{', '|', '}', '~'], 'keep_only_token_ids': None})
  (3): Normalize({'module_input_name': 'token_embeddings', 'module_output_name': 'token_embeddings'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import MultiVectorEncoder

# Download from the 🤗 Hub
model = MultiVectorEncoder("tomaarsen/multivector-gte-modernbert-base-msmarco-kd")
# Run inference: each input becomes a sequence of per-token vectors (variable length).
queries = [
    'Which planet is known as the Red Planet?',
]
documents = [
    "Venus is often called Earth's twin because of its similar size and proximity.",
    'Mars, known for its reddish appearance, is often referred to as the Red Planet.',
    'Saturn, famous for its rings, is sometimes mistaken for the Red Planet.',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings[0].shape, document_embeddings[0].shape)
# (32, 128) (17, 128)

# Get the MaxSim similarity scores
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[27.2338, 30.3040, 29.7375]])

Evaluation

Metrics

Multi Vector Information Retrieval

• Datasets: NanoMSMARCO, NanoNQ and NanoFiQA2018
• Evaluated with MultiVectorInformationRetrievalEvaluator

Metric	NanoMSMARCO	NanoNQ	NanoFiQA2018
maxsim_accuracy@1	0.5	0.64	0.58
maxsim_accuracy@3	0.62	0.82	0.72
maxsim_accuracy@5	0.74	0.9	0.76
maxsim_accuracy@10	0.88	0.9	0.82
maxsim_precision@1	0.5	0.64	0.58
maxsim_precision@3	0.2067	0.28	0.36
maxsim_precision@5	0.148	0.184	0.276
maxsim_precision@10	0.088	0.096	0.15
maxsim_recall@1	0.5	0.61	0.3567
maxsim_recall@3	0.62	0.78	0.5262
maxsim_recall@5	0.74	0.84	0.6178
maxsim_recall@10	0.88	0.86	0.6612
maxsim_ndcg@10	0.6665	0.7539	0.6038
maxsim_mrr@10	0.6008	0.7357	0.661
maxsim_map@100	0.6075	0.714	0.5482

Multi Vector Nano BEIR

• Dataset: NanoBEIR_mean
• Evaluated with MultiVectorNanoBEIREvaluator with these parameters:

  {
      "dataset_names": [
          "msmarco",
          "nq",
          "fiqa2018"
      ],
      "dataset_id": "sentence-transformers/NanoBEIR-en"
  }
  

Metric	Value
maxsim_accuracy@1	0.5733
maxsim_accuracy@3	0.72
maxsim_accuracy@5	0.8
maxsim_accuracy@10	0.8667
maxsim_precision@1	0.5733
maxsim_precision@3	0.2822
maxsim_precision@5	0.2027
maxsim_precision@10	0.1113
maxsim_recall@1	0.4889
maxsim_recall@3	0.6421
maxsim_recall@5	0.7326
maxsim_recall@10	0.8004
maxsim_ndcg@10	0.6747
maxsim_mrr@10	0.6658
maxsim_map@100	0.6233

Training Details

Training Dataset

ms-marco-en-bge-gemma

• Dataset: ms-marco-en-bge-gemma
• Size: 20,000 training samples
• Columns: query, document_1, document_2, document_3, document_4, document_5, document_6, document_7, document_8, document_9, document_10, document_11, document_12, document_13, document_14, document_15, document_16, document_17, document_18, document_19, document_20, document_21, document_22, document_23, document_24, document_25, document_26, document_27, document_28, document_29, document_30, document_31, document_32, and scores
• Approximate statistics based on the first 100 samples:

  	query	document_1	document_2	document_3	document_4	document_5	document_6	document_7	document_8	document_9	document_10	document_11	document_12	document_13	document_14	document_15	document_16	document_17	document_18	document_19	document_20	document_21	document_22	document_23	document_24	document_25	document_26	document_27	document_28	document_29	document_30	document_31	document_32	scores
  type	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	string	list
  modality	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text	text
  details	min: 5 tokens mean: 9.19 tokens max: 19 tokens	min: 25 tokens mean: 79.09 tokens max: 209 tokens	min: 36 tokens mean: 82.93 tokens max: 183 tokens	min: 30 tokens mean: 82.66 tokens max: 189 tokens	min: 28 tokens mean: 80.34 tokens max: 212 tokens	min: 32 tokens mean: 83.55 tokens max: 203 tokens	min: 29 tokens mean: 82.52 tokens max: 245 tokens	min: 36 tokens mean: 80.46 tokens max: 213 tokens	min: 28 tokens mean: 74.78 tokens max: 191 tokens	min: 29 tokens mean: 78.35 tokens max: 182 tokens	min: 29 tokens mean: 80.5 tokens max: 177 tokens	min: 23 tokens mean: 83.23 tokens max: 210 tokens	min: 29 tokens mean: 79.9 tokens max: 212 tokens	min: 39 tokens mean: 79.22 tokens max: 152 tokens	min: 29 tokens mean: 83.35 tokens max: 185 tokens	min: 24 tokens mean: 80.3 tokens max: 179 tokens	min: 36 tokens mean: 86.74 tokens max: 179 tokens	min: 24 tokens mean: 78.78 tokens max: 165 tokens	min: 31 tokens mean: 78.82 tokens max: 178 tokens	min: 23 tokens mean: 80.4 tokens max: 162 tokens	min: 42 tokens mean: 79.89 tokens max: 185 tokens	min: 37 tokens mean: 78.1 tokens max: 172 tokens	min: 26 tokens mean: 80.59 tokens max: 157 tokens	min: 31 tokens mean: 81.41 tokens max: 196 tokens	min: 37 tokens mean: 78.16 tokens max: 208 tokens	min: 25 tokens mean: 80.35 tokens max: 219 tokens	min: 33 tokens mean: 83.47 tokens max: 187 tokens	min: 25 tokens mean: 81.17 tokens max: 186 tokens	min: 40 tokens mean: 79.0 tokens max: 165 tokens	min: 33 tokens mean: 78.94 tokens max: 178 tokens	min: 31 tokens mean: 79.6 tokens max: 198 tokens	min: 27 tokens mean: 78.98 tokens max: 182 tokens	min: 39 tokens mean: 90.72 tokens max: 212 tokens	size: 32 elements

• Samples:

  query	document_1	document_2	document_3	document_4	document_5	document_6	document_7	document_8	document_9	document_10	document_11	document_12	document_13	document_14	document_15	document_16	document_17	document_18	document_19	document_20	document_21	document_22	document_23	document_24	document_25	document_26	document_27	document_28	document_29	document_30	document_31	document_32	scores
  what is a gothic element in literature	Gothic Elements in Literature. Here is a list of distinguishing elements commonly found in gothic literature (AKA you know it's gothic when there is ...): (The above list compiled from one at: http://www.virtualsalt.com/gothic.htm). 1 a setting in a castle, ancestral family home, vault or crypt. 2 a vendetta or vengeance perpetrated against the protagonist and/or his/her family by the antagonist. 3 supernatural beings-monsters, vampires, ghosts, werewolves, and such.	Mood Definition. In literature, mood is a literary element that evokes certain feelings or vibes in readers through words and descriptions. Usually, mood is referred to as the atmosphere of a literary piece, as it creates an emotional situation that surrounds the readers. Mood is developed in a literary piece through various methods.	Elements of the Gothic Novel. The gothic novel was invented almost single-handedly by Horace Walpole, whose The Castle of Otranto (1764) contains essentially all the elements that constitute the genre.	Dracula is an 1897 Gothic horror novel by Irish author Bram Stoker. It introduced Count Dracula, and established many conventions of subsequent vampire fantasy. The novel tells the story of Dracula's attempt to move from Transylvania to England so that he may find new blood and spread the undead curse, and of the battle between Dracula and a small group of men and a woman led by Professor Abraham Van Helsing. Dracula has been assigned to many literary genres including vampire literature, horror	Gothic art is distinguished from its predecessors by an increasing naturalism in the shape and posture of the figures, and an expressive use of line, pattern and color, allowing the artist more freedom of interpretation. Gothic art started in 13th century Italy and developed throughout Europe until the 15th century.	The HTML element represents a thematic break between paragraph-level elements (for example, a change of scene in a story, or a shift of topic with a section). In previous versions of HTML, it represented a horizontal rule.	It’s tricky to define. Goodreads says that gothic fiction “combines elements of both the uncanny and romance” and is a “parent genre” for horror and mystery. While I think the former is true (and it encompasses books that are gothic in feel but aren’t necessarily horror), I don’t quite agree with the latter.	“Edgy” is an English slang term used to describe things, behaviors or trends which are provocative or avant-garde, and is often used to describe things that are dark and gothic in nature. It is commonly used as an insult on 4chan and Tumblr for someone attempting to be badass by acting emo or overly contrarian.	Gothic was a term originally applied to works that people thought to be love stories. ancient legends. epic sagas. bloody tales.	The term became associated with ghost stories and horror novels because early Gothic novels were often associated with the Middle Ages and with things wild, bloody, and barbarous of long ago as J. A. Cuddon puts it in his Dictionary of Literary Terms (381).	Elements of Literature. We generally refer to the things that make up a work of literature, its component parts, as elements. To be a critic of literature, that is to be one who talks about what literature does and means, we need a common vocabulary. For this reason, we study a list of literary terms. All CyberEnglish9 students are expected to know and use these terms.	First element cognate with Ancient Greek γε ‎(ge, intensifying particle), Czech že ‎(“ that ” , conjunction); Second element cognate with Ancient Greek ἐκεῖ ‎(ekei, “ ekeî ”), There Old irish ‎(“ cē ”), Here gothic ‎(𐌷𐌹𐌼𐌼𐌰, “ himma to ”), This latin ‎(“ cis this ”). sideic m ‎(demonstrative), haec f, hoc n. 1 This, these, used to refer to (a) person(s) or thing(s) close to the speaker.	From the Castle. of Otranto (1764) onwards, many gothic texts present themselves as an. editor's recovery and presentation of some ancient text, cloaking the. true author's writing of the story. Such counterfeit framing narratives. frequently complicate the point of view and authenticity of gothic. stories.	Southern Gothic literature was inspired by early Gothic writing, a genre that was popular in 18th century England. In Gothic literature, the authors wanted to expose the problems they saw in society.	Mood Definition. In literature, mood is a literary element that evokes certain feelings or vibes in readers through words and descriptions. Usually, mood is referred to as the atmosphere of a literary piece, as it creates an emotional situation that surrounds the readers.ood is developed in a literary piece through various methods. It can be developed through setting, theme, tone and diction. Let us see how writers use the afore-mentioned elements in their literary works to create a particular mood.	Motifs, on the other hand, are images, ideas, sounds, or words that help to explain the central idea of a literary work – the theme. Moreover, a symbol may appear once or twice in a literary work, whereas a motif is a recurring element. Themes, Motifs, and Symbols in Dickens’ A Tale of Two Cities	Strange Case of Dr. Jekyll and Mr. Hyde. Strange Case of Dr. Jekyll and Mr. Hyde, published in 1886 by Robert Louis Stevenson, is about a man who transforms between two personae: Dr. Henry Jekyll and Mr. Edward Hyde. It is an example of the Gothic genre. Gothic stories typically blend elements from horror stories with elements from Romantic stories.	Word History: The expression Gothic romance unites two major influences in the development of European culture, the Roman Empire and the Germanic tribes, such as the Goths, that invaded it.	Gothic was a term originally applied to works that people thought to be love stories. ancient legends.	In Frankenstein this female is Victor Frankenstein’s would-be wife Elizabeth, who suffers from loneliness without him. She is threatened by the monster even though Victor doesn’t realize it, and she is murdered because Victor was unable to rescue her. In a gothic novel, the characters are often highly emotional. They may be overcome by dread, horror, sorrow or rage. In Frankenstein, this characteristic has a strong presence.	Point of View. Another literary element is point of view. Point of view is how the author chooses to tell the story. Think of it as where the camera is throughout the story. There are three basic camera positions: first person, second person and third person.	1. Mathematics Intersecting at or forming right angles. 2. Being at right angles to the horizontal; vertical. See Synonyms at vertical. 3. often Perpendicular Of or relating to a style of English Gothic architecture of the 1300s and 1400s, characterized by emphasis of the vertical element.	The novel usually regarded as the first Gothic novel is Horace Walpole's The Castle of Otranto, first published in 1764. Horace Walpole's declared aim was to combine elements of the medieval romance, which he deemed too fanciful, and the modern novel, which he considered to be too confined to strict realism.he name Gothic refers to the (pseudo)-medieval buildings, emulating Gothic architecture, in which many of these stories take place. This extreme form of romanticism was very popular in England and Germany. The English Gothic novel also led to new novel types such as the German Schauerroman and the French ¨Georgia¨.	History. One can trace elements of the Gothic novel in earlier novels such as Ferdinand Count Fathom by Tobias Smollett, published in 1753; but the first full-fledged Gothic novel was The Castle of Otranto by Horace Walpole, which appeared in 1764. edit intro ]. The Gothic novel is a form of fiction which became popular in England in the second half of the eighteenth century. Gothic novels often involve elements of the supernatural and were designed to give a pleasing frisson of terror to the reader.	In the 18th century the term Gothic morphed into a genre of literature that had elements of horror. Esther Lombardi (Classic Literature Guide) describes the genre as characterized by supernaturalism, melodrama, and sensationalism..he term Gothic was used in the Renaissance to describe certain types of art (and architecture -- think gargoyles) in the Middle Ages, according to Shelley Esaak's Art History 101.	At the technical level Gothic architecture is characterized by the ribbed vault (a vault in which stone ribs carry the vaulted surface), the pointed arch, and the flying buttress (normally a half arch carrying the thrust of a roof or vault across an aisle to an outer pier or buttress).	Common Literary Elements. 1 Plot: It is the logical sequence of events that develops a story. 2 Setting: It refers to the time and place in which a story takes place. 3 Protagonist: It is the main character of story, novel or a play e.g. 4 Antagonist: It is the character in conflict with the Protagonist e.g. 5 Narrator: A person who tells the story.	Three main aspects will be covered in this section: architecture, sculpture, and the literary culture of the period. The term Gothic was first used as a derogatory term for Late Medieval art and architecture by Italian architect and art historian Giorgio Vasari (1511-1574).	The most fundamental element of the Gothic style of architecture is the pointed arch, which was likely borrowed from Islamic architecture that would have been seen in Spain at this time. The pointed arch relieved some of the thrust, and therefore, the stress on other structural elements.	Think dark, sensual, and mysterious. While Traditional Goth's tend to be all about the 80's music scene, Romantic Goth's focus on the dark, sensual and mysterious world of Gothic created by Victorian literature and subsequent movies. In other words they’re probably more “Gothic” than “Goth,” if that makes sense.s such, a Traditional Goth will venerate the earliest Goth bands: Bauhaus, Siouxsie and the Banshees, The Birthday Party, The Sisters of Mercy, and anything played in the infamous Bat-Cave club. Other influential bands (e.g. The Velvet Underground) may also be revered as minor deities.	Narrative structure, a literary element, is generally described as the structural framework that underlies the order and manner in which a narrative is presented to a reader, listener, or viewer. The narrative text structures are the plot and the setting. 1 Definition.	Jane Eyre as a Female Gothic Novel. KEYWORDS: Charlotte Brontë invests gothic elements in Jane Eyre with a symbolic meaning to create a new, ‘female’ language. It is through this female Gothic language that Brontë creates a heroine whose autobiographical mode of writing is used to trace a story of female rebellion and search for identity.	[0.9999999992804947, 0.24845418756716053, 0.7594154013647826, 0.26644182105618575, 0.390668914839766, ...]
  how is the weather in colorado early december	December is the coldest month for Denver, Colorado. That means temperatures below 0 °F (-18 °C) are likely on a few nights. This page gives detailed information on the typical December weather for Denver.	Depends entirely on the school. Here in Colorado the Fall semester starts during the 2nd week of August and ends the 2nd week of December. Spring starts about the 2nd or 3rd week of January and ends the 2nd week of may.	Rating Newest Oldest. Best Answer: There doesn't tend to be a lot of snow in december, mostly in January or February, but it is cold. Average temperatures range from 28-48 degrees F. You'll definitely want a coat, so I suggest either borrowing one from a friend maybe, or buying a cheap but warm one at target or walmart.	Rain is most likely to occur around 12:00 AM (midnight) during the month of December, and it is least likely to occur around 6:00 AM . In Cancun and the Mexican Caribbean during December, thunderstorms -- when they occur -- are most likely sometime around 6:00 PM .	The highest average temperature in Denver is July at 74 degrees. The coldest average temperature in Denver is December at 28.5 degrees. The most monthly precipitation in Denver occurs in August with 2.7 inches. The Denver weather information is based on the average of the previous 3-7 years of data.	Average Weather in December in Ixtapa-Zihuatanejo Mexico. In Ixtapa-Zihuatanejo, the month of December is characterized by essentially constant daily high temperatures, with daily highs around 87°F throughout the month, rarely exceeding 90°F or dropping below 84°F. Daily low temperatures are around 77°F, rarely falling below 74°F or exceeding 80°F.	Precipitation total in December for Cancun is 2.3 in. The average wind speed in December is 11.9 mph. We are using day length and cloud cover information for each day of the month to calculate averages for this chart. Average sunny hours for Cancun in December is 5.7 hours.	Average Weather in December in Managua Nicaragua. In Managua, the month of December is characterized by essentially constant daily high temperatures, with daily highs around 89°F throughout the month, rarely exceeding 93°F or dropping below 86°F. Daily low temperatures are around 71°F, rarely falling below 67°F or exceeding 75°F.	Guide to Denver weather in November The average maximum daytime temperature in Denver in November is a cool 12°C (54°F). The average night-time temperature is usually a very cold -4°C (25°F).	Cancun Weather in December. Cancun weather in December is going to be much more pleasant than it is back at home. Despite it being one of the ‘colder’ months of the year (only January has a cooler average high temperature) you can still expect 23 of the 31 days of December to reach over 80F during the day, although none over 90F.	Despite the rain, December can be very busy, especially on Ko Tao and Ko Pha Ngan. Southwest Thailand. More glorious weather — and the crowds flock to it. In December on Thailand's west coast you can expect a lot of sunshine with just the very occasional shower. The weather is definitely better on this coast than the Gulf Coast — though not as good as on Ko Chang. Some islands, like Ko Phi Phi are packed to the rafters in December. A fine choice.	Averages for Los Angeles in December. Weather Lowdown. Like November before it, December is one of the coolest months in Los Angeles with an average temperature of 14°C (around 56°F). It is also a very wet month with an average of 66 mm of rainfall that falls during the month. The average high temperature still reaches 19°C (about 66°F) but can dip as low as a rather chilly 8°C (around 46°F). The amount of average daily sunshine drops significantly come December, to about seven hours a day.	Key weather averages for Riverton in December. - 1 1. 2 6. 6 hours of sunshine per day. 3 6. 6 days with some rainfall. - 4 15. 5 9. 9 hours of daylight per day. 6 0. No heat & humidity. 7 7. 7 mm of monthly rainfall. 8 1. 1 (Low) UV index.	Weather in Ocho Rios in December. The average maximum daytime temperature in Ocho Rios in December is a warm 27°C (81°F) with low heat & humidity. There are usually 7 hours of bright sunshine each day, which represents 59% of the 11 hours of daylight. The average sea temperature in and around Ocho Rios in December is 28°C (82°F). Expect 206mm (8.1 inches) of rainfall across the whole of December with 8 days with some rain falling.	Averages for Aruba in December. Although December is the middle of winter, you will not find any snow here in Aruba. Instead, sunny days and high temperatures are still the norm, although the weather may sometimes take a turn for the worse in the form of a storm or two. The average daily temperature, even now at the end of the year, still remains as high as 27°C. This equates to daily highs and lows which will range between 29°C and 25°C, a warm temperature range which means that you still need to wear...	December Weather in Costa Rica. Early December weather is unpredictable. Often the rains taper off and the Pacific enjoys perfect beach weather most of the month. However, occasionally the rainy season continues full force right up through Christmas.	Climate data for Denver, CO - 80201 - 1981-2010 normals - weather Jan: January, Feb: February, Mar: March, Apr: April, May: May, Jun: June, Jul: July, Aug: August, Sep: September, Oct: October, Nov: November, Dec: December	Guide to Monteverde weather in December. The average maximum daytime temperature in Monteverde in December is a warm 26°C (79°F). The average night-time temperature is usually a comfortable 18°C (64°F). There are usually 6 hours of bright sunshine each day, which represents 54% of the 12 hours of daylight.	Because December falls within Guanacaste's dry season, you'll likely experience more sunshine and less humidity. In December, the average humidity level is about 72 percent, a marked decrease from June's high of 84 percent humidity.	Key weather averages for Elko in December. 1 3. 3°C max day temperature. 2 5. 5 hours of sunshine per day. 3 9. 9 days with some rainfall. - 4 10. 5 9. 9 hours of daylight per day. 6 0. No heat & humidity. 7 37. 37 mm of monthly rainfall. 8 2. 2 (Low) UV index.	Average Weather in December in Abilene Texas, United States. In Abilene, the month of December is characterized by falling daily high temperatures, with daily highs decreasing by 6°F, from 62°F to 57°F over the course of the month, and rarely exceeding 75°F or dropping below 39°F.	The release of December sales taxes gave Colorado its first full calendar year of the taxes from recreational pot sales, which began Jan. 1, 2014. Colorado was the first government anywhere in the world to regulate marijuana production and sale, so other governments are watching closely.	Late December weather can be described as mild. Daytime temps in the 70's, occasional day in the low 80's. It does get cooler if a cold front passes, then temps could be in the 60's for a couple of days. At night it will get cool, so a light jacket or sweatshirt may be needed.	Averages for Cancun in December. Weather lowdown. If you aren't a fan of sweltering heat but you still want to experience the sunshine, warmth and beauty of a tropical destination, December is a good time to visit Cancun – and who knows, you may even spend Christmas Day on the beach!	Weather low-down. In December the temperature in Orlando is very pleasant, in the range of the lower 20s. The humidity at night means you won't get cold in the evenings, but be sure to pack some warmer clothes too. The average daytime temperature is generally around 23°C (73°F) whereas the average minimum temperatures drop down to 10°C (50°F).	From December to March, sometimes the cool wind from the United States can lower the temperature by a few degrees, so that the minimum can drop below 20 °C. Summer is sultry, but the heat is tempered by the breezes. Here are the average temperatures. Average temperatures - Grand Turk.	1 The lowest monthly average temperature in Fort Collins for December is 25 degrees. 2 The most monthly precipitation in Fort Collins occurs in July with 4.5 inches. 3 The air quality index in Fort Collins is 7% better than the national average. The pollution index in Fort Collins is 68% better than the national average.	December is the cloudiest month for Salt Lake City. Sunlight in December at Salt Lake City averages 9 hours and 18 minutes a day. The shortest days of the year, from around December 17th to 24th, last 9 hours and 15 minutes from sunrise to sunset.	In most years, Los Angeles averages a daily maximum temperature for December that's between 65 and 70 degrees Fahrenheit (18 to 21 degrees Celsius). The minimum temperature usually falls between 46 and 49 °F (8 to 10 °C). December is the coldest month overall for Los Angeles and the 21st to 23rd are its chilliest days.	Shanghai Weather in December. Rainy, windy, and cloudy days are the major weather of December in Shanghai. It seldom snows and is not as cold as some cities in northern China, but because of the strong wind and dampness, it is really freezing, especially at night. The awful weather diminishes the number of people traveling to Shanghai.	One thing's for sure in December at Walt Disney World - at Mickey's Very Merry Christmas Party, it will snow on Main Street USA! Yes, I said snow. Dad's best advice to combat the ever-changing typical December weather at Walt Disney World is to make like a Boy Scout and be prepared.	In the town of Napa, the average temperature in December is 48 degrees, while the average high is 56 degrees and the average low temperature is 38 degrees. The average rainfall for December is 3.9 inches.	[0.9999999991784339, 0.42233632827946693, 0.5956354295491569, 0.12644415907455164, 0.6636713730105909, ...]
  what time do the actual academy awards start	Quentin Fottrell. Personal finance reporter. NEW YORK (MarketWatch)—The 87th Academy Awards ceremony kicks off from the Dolby Theatre in Hollywood at 8.30 p.m. Eastern on Sunday, or 5.30 Pacific and will be broadcast live on the ABC television network, but red-carpet coverage will start on many channels at 7 Eastern.	Get ready for the biggest night in movies! The 88th Academy Awards will air live from the Dolby Theatre in Hollywood on Sunday, February 28, at 8:30 p.m. EST on ABC. PHOTOS: Oscars 2016 Red Carpet Fashion Chris Rock will return to host the star-studded ceremony for the second time. The 51-year-old entertainer first hosted the Oscars in 2005, when Million Dollar Baby took home four awards, including Best Picture. Chris Rock speaks onstage during the 84th Annual Academy Awards held at the Hollywood & Highland Center on Feb. 26, 2012, in Hollywood.	Catching the Academy Awards if you happen to be outside the U.S. on Oscar night can be a tricky proposition. ABC will be kicking off its extensive Oscar coverage Sunday night at 7 p.m. ET and 4 p.m. PT and will be offering, for the first time, a live stream for viewers to watch the Oscars online and via mobile devices. But for international Oscar fans, finding local live coverage of the 86th Academy Awards means maneuvering through a patchwork of satellite and cable broadcasters, as well as online offerings.	Halle Berry, Denzel Washington triumph at Oscars. On this day in 2002, the 74th annual Academy Awards ceremony is held at its brand new venue, the Kodak Theatre in Los Angeles. Completed the previous November, the $94 million Kodak Theatre would be the first permanent home for the Academy Awards ceremony.	In 1929, the first Academy Awards were presented at a banquet dinner at the Hollywood Roosevelt Hotel. From 1930 to 1943, the ceremony alternated between two venues: the Ambassador Hotel on Wilshire Boulevard and the Biltmore Hotel in downtown Los Angeles.	Underlining its long-range thinking, the Academy of Motion Picture Arts & Sciences on Thursday announced airdates for the next three Oscar ceremonies: Sunday, Feb. 28, 2016; Feb. 26, 2017; and March 4, 2018. This answers questions such as whether Oscars will return to Monday nights or shift its calendar dates to earlier in the year.	The Oscars is like the Super Bowl for films, but how long do they last? Oscars Oscar night is one of the biggest award show evenings of the year, but it's also one of the longest. Between the red carpet coverage and questions about what celebrities are wearing and Oscar speeches and awards to people we've never heard of, film buffs plan a whole night around this event. Just like the Super Bowl, people host parties and make an evening, playing games, eating and making fun of what they are watching on tv. The official red carpet coverage on ABC starts at 7pm ET/4pm PT, with the gala starting at 8:30pm ET/5:30pm ET. The show is scheduled to end at 11:30pm ET/8:30pm PT. When you tabulate all those hours, you clock in at 4 hours and 30 minutes. That is if there are no overruns, which there will be, and if you don't watch the pre-pre-red carpet coverage.	The Academy also announced Monday that the 2015 Academy Awards will move back to the last Sunday in February, which that year will be Feb. 22. The choice of dates for the next two Oscars effectively ends any speculation that the show could move to an earlier date on the Hollywood awards calendar. In setting key dates for next year, the Academy has built a little more time into its voting schedule than was the case this past season. Nomination voting will begin Dec. 27, and the nominations voting deadline will be Wednesday, Jan. 8.	The 86th awards will air on March 2. Oscar voters will have extra time to ponder their nomination ballots and final voting choices next year. The Academy of Motion Picture Arts and Sciences and ABC announced Monday that next year's 86th Annual Academy Awards will take place Sunday, March 2.	Photo: Reuters. The 50th Academy of Country Music Awards (ACM Awards) will air on Sunday, but fans don’t have to be near a TV to watch it. CBS will also livestream the ceremony so everyone can see their favorite country stars live from AT&T Stadium in Arlington, Texas. If you’re watching on television, just tune in to CBS at 8 p.m. EDT to watch the 2015 ACM Awards.	In 1930, the Academy Awards were held twice on April 3rd (2nd Academy Awards) and on November 5th (3rd Academy Awards). Both of the banquets were held at the Ambassador Hotel, … Los Angeles, CA. (Cocoanut Grove and Fiesta Room, respectively).	The following events are closely associated with the annual Academy Awards: 1 César Award. 2 Nominees luncheon. 3 Governors Awards. 4 The 25th Independent Spirit Awards (in 2010), usually held in Santa Monica the Saturday before the Oscars, marked the first time it was moved to a Friday and a change of venue to L.A. Live.	Host Steve Martin gestures to the crowd during the 75th Annual Academy Awards at the Kodak Theatre, March 23, 2003, in Hollywood, Calif. Getty Images Actress and comedian Whoopi Goldberg opens the show for her fourth time as host during the 74th Academy Awards at the Kodak Theatre in Hollywood, Calif., March 24, 2002.	In anticipation of the highly celebrated event for the 5th Academy Awards, radio station KECA presented a half-hour program called “Hollywood on the Air,” broadcast from Radio Pictures Studio in Hollywood on November 17, 1932, the night before the ceremony.	The decision by the Awards Committee to recommend no award, one award, or two awards shall be made to the Academy Board of Directors by October 1. The expense of preparing plaques of recognition is to be borne by the Cornea and Contact Lens Section.	The first Academy Awards, which is the only AA ceremony not to be broadcast on either radio or television, took place on May 16, 1929. Held at a private dinner at the Hollywood Roosevelt Hotel in L.A., the ceremony lasted 15 minutes, tickets cost five dollars and was attended by 270 people.	In 1930, the Academy Awards were held twice on April 3rd (2nd Academy Awards) and on November 5th (3rd Academy Awards). Both of the banquets were held at the Ambassador Hotel,… Los Angeles, CA. (Cocoanut Grove and Fiesta Room, respectively).	Emma Thompson keeps her Oscars in the loo, Russell Crowe keeps his in a chicken coop. Where else do Hollywood stars keep their Academy Awards? Tuesday 25 February 2014 13.08 EST Last modified on Tuesday 25 February 2014 14.52 EST.	There will be a repeat at 5:30 p.m. on Monday. The channel also does its own red-carpet coverage starting at 1:00 a.m. Russia. Just like last year, the Oscars will not air live in Russia, even though a Russian entry, Leviathan, is nominated in the best foreign-language film category.	The Golden Globes are this Sunday, followed by the People’s Choice Awards on Wednesday. Then the Oscar nominees get announced January 23rd. Obviously, a lot of the same people get nominated for multiple awards each year.	View/Post Comments. The stars will be out tomorrow (that's Sunday, February 22) as the Academy of Motion Picture Arts and Sciences present their annual award show, better known to us mere mortals as the Oscars. The 87th Oscars will air on ABC starting at 7 p.m. on ABC. Here are the local channels for ABC:	Like we said before, the Oscar nominations will officially be announced on January 23, 2018, with the show airing on March 4. What are your Oscar predictions? Sound off in the comments below!	The 2018 Academy Awards nominations! Unfortunately, this year's group of Oscar nominees won't be announced until January 23, 2018, but that doesn't mean we have to wait a month and a half to start at least thinking about them. With that being said, here are our predictions, based upon the awards show nominations that have already been announced:	2016 Oscars, Academy Awards The Greenroom for the 88th Academy Awards designed by Rolex is seen in Los Angeles on Wednesday, Feb. 24, 2016. The Academy Awards will be held at the Dolby Theatre on Sunday, Feb. 28.	The 89th Academy Awards ceremony, honoring the best films of 2016, were held on February 26, 2017, at the Dolby Theatre, in Los Angeles, California. The ceremony was hosted by Jimmy Kimmel and was broadcast on ABC. A total of 3,048 Oscars have been awarded from the inception of the award through the 88th.	February 12, 2017 - The 59th Annual Grammy Awards take place. February 15, 2016 - The 58th Annual Grammy Awards take place. 1957 - The National Academy of Recording Arts and Sciences, also known as NARAS or the Recording Academy, is founded in Los Angeles.	The 2015 award will be presented during the joint meeting of the Board for Judicial Administration (BJA) and the CMC on Friday, December 18, at SeaTac. Nomination forms must arrive at the AOC by 5 p.m. on Friday, October 30.	The newest instalment of the Star Wars franchise was not considered in contention for the Golden Globe Awards (presented on January 10) or the Screen Actors Guild Awards (presented on January 31). But The Force Awakens will be in contention for the 2016 Academy Awards. Nominees for the 2016 Oscars are announced on January 14, and the ceremony itself will take place on February 28. Director JJ Abrams on the set of Star Wars: The Force Awakens ...	The awards show will start at 5:30 p.m. PST (8:30 p.m. EST) and is scheduled to last three hours. It will be hosted by Family Guy and Ted star Seth MacFarlane and televised live in more than 225 countries.	Getty. The nominees for the 2012 Academy Awards were announced on Tuesday morning, and as expected, films about films led the way. The Artist, the silent, black and white tribute to old Hollywood, earned a nod for Best Picture, and, after a series of recent critics and guild award wins, is considered the favorite.	Coverage of the 2016 Grammy Awards begins with the Grammy Live special at 3 p.m. ET. The pre-show can be streamed on Grammy.com, CBS.com, the Grammy Live app and the CBS App. It will feature red carpet arrivals and an appearance by The Wild Feathers, winners of CBS.com's Artists of Tomorrow contest.	WATCH LIVE: The Oscars 2016 Now Airing on TV, Live Stream. Plus, what channel the 88th annual Academy Awards is on television Sunday night. HOLLYWOOD, CA- The stars will shine brightly at the 88th Academy Awards — better known as The Oscars — Sunday night, live from Los Angeles. If you want to catch all the awards action and those lovely acceptance speeches live on television, tune in at 5:30 p.m. local time (That's 8:30 p.m. if you're watching from the East Coast).	[0.9999999991841937, 0.877629062381539, 0.8330146583389045, 0.3116634796692611, 0.4633524534142185, ...]

• Loss: MultiVectorDistillKLDivLoss with these parameters:

  {
      "score_metric": "colbert_kd_scores",
      "normalize_scores": true,
      "temperature": 0.25,
      "size_average": true
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 2
• num_train_epochs: 1
• learning_rate: 3e-05
• warmup_steps: 0.05
• gradient_accumulation_steps: 2
• bf16: True
• per_device_eval_batch_size: 2
• load_best_model_at_end: True
• max_length: 180

All Hyperparameters

Click to expand

• per_device_train_batch_size: 2
• num_train_epochs: 1
• max_steps: -1
• learning_rate: 3e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.05
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 2
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: True
• fp16: False
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 2
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: True
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}
• max_length: 180

Training Logs

Epoch	Step	Training Loss	NanoMSMARCO_maxsim_ndcg@10	NanoNQ_maxsim_ndcg@10	NanoFiQA2018_maxsim_ndcg@10	NanoBEIR_mean_maxsim_ndcg@10
-1	-1	-	0.6012	0.5101	0.4836	0.5316
0.01	50	0.0165	-	-	-	-
0.02	100	0.0152	-	-	-	-
0.03	150	0.0149	-	-	-	-
0.04	200	0.0130	-	-	-	-
0.05	250	0.0149	-	-	-	-
0.06	300	0.0146	-	-	-	-
0.07	350	0.0148	-	-	-	-
0.08	400	0.0140	-	-	-	-
0.09	450	0.0128	-	-	-	-
0.1	500	0.0129	0.6621	0.6907	0.5652	0.6393
0.11	550	0.0125	-	-	-	-
0.12	600	0.0117	-	-	-	-
0.13	650	0.0119	-	-	-	-
0.14	700	0.0137	-	-	-	-
0.15	750	0.0134	-	-	-	-
0.16	800	0.0123	-	-	-	-
0.17	850	0.0122	-	-	-	-
0.18	900	0.0118	-	-	-	-
0.19	950	0.0116	-	-	-	-
0.2	1000	0.0131	0.6648	0.6959	0.5741	0.6450
0.21	1050	0.0105	-	-	-	-
0.22	1100	0.0114	-	-	-	-
0.23	1150	0.0105	-	-	-	-
0.24	1200	0.0108	-	-	-	-
0.25	1250	0.0113	-	-	-	-
0.26	1300	0.0126	-	-	-	-
0.27	1350	0.0101	-	-	-	-
0.28	1400	0.0101	-	-	-	-
0.29	1450	0.0106	-	-	-	-
0.3	1500	0.0107	0.6450	0.7251	0.5824	0.6508
0.31	1550	0.0097	-	-	-	-
0.32	1600	0.0101	-	-	-	-
0.33	1650	0.0100	-	-	-	-
0.34	1700	0.0103	-	-	-	-
0.35	1750	0.0101	-	-	-	-
0.36	1800	0.0095	-	-	-	-
0.37	1850	0.0104	-	-	-	-
0.38	1900	0.0092	-	-	-	-
0.39	1950	0.0096	-	-	-	-
0.4	2000	0.0088	0.6665	0.7539	0.6038	0.6747

Training Time

• Training: 21.2 minutes
• Evaluation: 2.0 minutes
• Total: 23.2 minutes

Framework Versions

• Python: 3.11.13
• Sentence Transformers: 5.7.0.dev0
• Transformers: 5.14.1
• PyTorch: 2.11.0+cu128
• Accelerate: 1.5.2
• Datasets: 3.5.0
• Tokenizers: 0.22.2

Additional Resources

• Sentence Transformers Documentation: the full documentation site, including training, evaluation, and pre-trained model catalogs.
• PyLate: the upstream library whose features were absorbed into Sentence Transformers for multi-vector / late-interaction models.

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultiVectorDistillKLDivLoss

@inproceedings{santhanam-etal-2022-colbertv2,
    title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction",
    author = "Santhanam, Keshav and Khattab, Omar and Saad-Falcon, Jon and Potts, Christopher and Zaharia, Matei",
    booktitle = "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies",
    year = "2022",
    publisher = "Association for Computational Linguistics",
}