Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,22 @@ The model was trained on balanced multilingual dataset.
|
|
| 34 |
|
| 35 |
If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Installation
|
| 39 |
|
|
|
|
| 34 |
|
| 35 |
If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
|
| 36 |
|
| 37 |
+
## Evaluation
|
| 38 |
+
|
| 39 |
+
The following metrics were obtained with multimodal re-ranking:
|
| 40 |
+
|
| 41 |
+
**Monolingual**
|
| 42 |
+
|
| 43 |
+
| Dataset | Recall@1 | Recall@5 | Recall@10 |
|
| 44 |
+
| :-------- | ------: | --------: | --------: |
|
| 45 |
+
| Zero-Shot Flickr | 0.558 | 0.813 | 0.874 |
|
| 46 |
+
| MS-COCO (train split was in training data) | 0.401 | 0.680 | 0.781 |
|
| 47 |
+
|
| 48 |
+
**Multilingual**
|
| 49 |
+
|
| 50 |
+
| English | German | Spanish | French | Italian | Russian | Japanese | Korean | Turkish | Chinese | Polish |
|
| 51 |
+
| -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------:
|
| 52 |
+
96.3 | 92.6 | 94.5 | 94.4 | 94.4 | 90.4 | 88.3 | 92.5 | 94.4 | 93.6 | 95.0 |
|
| 53 |
|
| 54 |
## Installation
|
| 55 |
|