thivy commited on
Commit
9318d88
·
verified ·
1 Parent(s): 987c931

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -252,13 +252,14 @@ This will show the top weighted tokens for each query, demonstrating the learned
252
 
253
  ### Training Datasets
254
 
255
- Retrieval-only datasets (ETI-format):
256
- - **NorQuAD** - Norwegian Question Answering
257
- - **ScandiQA** - Scandinavian Question Answering
258
- - **MKQA Norwegian** - Multilingual Knowledge Questions
259
- - **NoReC** - Norwegian Review Corpus
260
- - **NorNE** - Norwegian Named Entity Recognition
261
- - **SNL** - Store Norske Leksikon (Norwegian Encyclopedia)
 
262
 
263
  ### Hardware
264
  - **GPUs:** 2x NVIDIA H100
 
252
 
253
  ### Training Datasets
254
 
255
+ Retrieval-only datasets (query → document pairs):
256
+ - **DDSC** - Nordic Embedding Training Data (~182K pairs, retrieval task only, NO/DA/SV)
257
+ - **ETI** - Elektronisk Tjenesteinformasjon (~54K pairs, health/welfare domain, NO)
258
+ - **NorQuAD** - Norwegian Question Answering (~3.8K pairs, NO)
259
+ - **ScandiQA** - Scandinavian Question Answering (~20K pairs, NO/DA/SV)
260
+ - **Supervised-DA** - Danish supervised retrieval pairs (~93K pairs, DA)
261
+
262
+ **Total:** ~333K query-document pairs across Norwegian, Danish, and Swedish.
263
 
264
  ### Hardware
265
  - **GPUs:** 2x NVIDIA H100