---
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:1432
- loss:MultipleNegativesRankingLoss
base_model: denaya/indoSBERT-large
widget:
- source_sentence: 'Input-output domestik Indonesia: 17 sektor usaha, harga produsen,
data tahun 2016 (juta Rp)'
sentences:
- 'Impor Besi dan Baja Menurut Negara Asal Utama, 2017-2023 '
- 'IHK dan Rata-rata Upah per Bulan Buruh Hotel di Bawah Mandor (Supervisor), 1996-2014
(1996=100) '
- 'Tabel Input-Output Indonesia Transaksi Domestik Atas Dasar Harga Produsen (17
Lapangan Usaha), 2016 (Juta Rupiah) '
- source_sentence: 'Gaji bulanan: beda umur, beda jenis pekerjaan (9 sektor), 2017'
sentences:
- 'Rata-rata Upah/Gaji Bersih Sebulan Buruh/Karyawan/Pegawai Menurut Kelompok Umur
dan Lapangan Pekerjaan Utama di 9 Sektor (Rupiah), 2017 '
- 'Ekspor Rumput Laut dan Ganggang Lainnya menurut Negara Tujuan Utama, 2012-2023 '
- 'Rata-Rata Harga Valuta Asing Terpilih menurut Provinsi 2017 '
- source_sentence: Ringkasan aliran dana kuartal terakhir 2009 dalam Rupiah
sentences:
- 'Jumlah Perahu/Kapal, Luas Usaha Budidaya dan Produksi menurut Sub Sektor Perikanan,
2002-2016 '
- 'Jumlah Pendapatan Menurut Golongan Rumah Tangga (miliar rupiah) 2000, 2005, dan
2008 '
- 'Ringkasan Neraca Arus Dana, Triwulan IV, 2009, (Miliar Rupiah) '
- source_sentence: Berapa total transaksi (harga pembeli) untuk 9 sektor ekonomi di
Indonesia tahun 2005? (miliar rupiah)
sentences:
- 'Jumlah Rumah Tangga Perikanan Budidaya Menurut Provinsi dan Jenis Budidaya, 2000-2016 '
- 'Transaksi Total Atas Dasar Harga Pembeli 9 Sektor Ekonomi (miliar rupiah), 2005 '
- 'Perbandingan Indeks dan Tingkat Inflasi Desember 2023 Kota-kota di Luar Pulau
Jawa dan Sumatera dengan Nasional (2018=100) '
- source_sentence: Bagaimana kaitan antara pendidikan dan kegiatan mingguan penduduk
usia 15+ pada tahun 2022?
sentences:
- 'Persentase Perkembangan Distribusi Pengeluaran '
- 'Rata-rata Pendapatan Bersih Pekerja Bebas Menurut Provinsi dan Lapangan Pekerjaan
Utama (ribu rupiah), 2018 '
- 'Penduduk Berumur 15 Tahun Ke Atas Menurut Pendidikan Tertinggi yang Ditamatkan
dan Jenis Kegiatan Selama Seminggu yang Lalu, 2008-2024 '
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
- cosine_accuracy
- cosine_accuracy_threshold
- cosine_f1
- cosine_f1_threshold
- cosine_precision
- cosine_recall
- cosine_ap
- cosine_mcc
model-index:
- name: SentenceTransformer based on denaya/indoSBERT-large
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: eval
type: eval
metrics:
- type: cosine_accuracy@1
value: 0.9120521172638436
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.990228013029316
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.993485342019544
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.996742671009772
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.9120521172638436
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.3572204125950054
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.23778501628664495
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.13745928338762217
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.7097252402956855
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.7867346590488319
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.8052359035035943
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.8221312325947948
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.8348212945928647
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.9497052892818366
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.7729410950742827
name: Cosine Map@100
- task:
type: binary-classification
name: Binary Classification
dataset:
name: quora duplicates dev
type: quora_duplicates_dev
metrics:
- type: cosine_accuracy
value: 0.9914529914529915
name: Cosine Accuracy
- type: cosine_accuracy_threshold
value: 0.31953397393226624
name: Cosine Accuracy Threshold
- type: cosine_f1
value: 0.9850953206239168
name: Cosine F1
- type: cosine_f1_threshold
value: 0.30364981293678284
name: Cosine F1 Threshold
- type: cosine_precision
value: 0.988865692414753
name: Cosine Precision
- type: cosine_recall
value: 0.981353591160221
name: Cosine Recall
- type: cosine_ap
value: 0.9956970583311449
name: Cosine Ap
- type: cosine_mcc
value: 0.9791180702139771
name: Cosine Mcc
---
# SentenceTransformer based on denaya/indoSBERT-large
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [denaya/indoSBERT-large](https://huggingface.co/denaya/indoSBERT-large). It maps sentences & paragraphs to a 256-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [denaya/indoSBERT-large](https://huggingface.co/denaya/indoSBERT-large)
- **Maximum Sequence Length:** 256 tokens
- **Output Dimensionality:** 256 dimensions
- **Similarity Function:** Cosine Similarity
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Dense({'in_features': 1024, 'out_features': 256, 'bias': True, 'activation_function': 'torch.nn.modules.activation.Tanh'})
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("yahyaabd/allstats-search-large-bpstable-v1")
# Run inference
sentences = [
'Bagaimana kaitan antara pendidikan dan kegiatan mingguan penduduk usia 15+ pada tahun 2022?',
'Penduduk Berumur 15 Tahun Ke Atas Menurut Pendidikan Tertinggi yang Ditamatkan dan Jenis Kegiatan Selama Seminggu yang Lalu, 2008-2024 ',
'Persentase Perkembangan Distribusi Pengeluaran ',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 256]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
## Evaluation
### Metrics
#### Information Retrieval
* Dataset: `eval`
* Evaluated with [InformationRetrievalEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
| Metric | Value |
|:--------------------|:-----------|
| cosine_accuracy@1 | 0.9121 |
| cosine_accuracy@3 | 0.9902 |
| cosine_accuracy@5 | 0.9935 |
| cosine_accuracy@10 | 0.9967 |
| cosine_precision@1 | 0.9121 |
| cosine_precision@3 | 0.3572 |
| cosine_precision@5 | 0.2378 |
| cosine_precision@10 | 0.1375 |
| cosine_recall@1 | 0.7097 |
| cosine_recall@3 | 0.7867 |
| cosine_recall@5 | 0.8052 |
| cosine_recall@10 | 0.8221 |
| **cosine_ndcg@10** | **0.8348** |
| cosine_mrr@10 | 0.9497 |
| cosine_map@100 | 0.7729 |
#### Binary Classification
* Dataset: `quora_duplicates_dev`
* Evaluated with [BinaryClassificationEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.BinaryClassificationEvaluator)
| Metric | Value |
|:--------------------------|:-----------|
| cosine_accuracy | 0.9915 |
| cosine_accuracy_threshold | 0.3195 |
| cosine_f1 | 0.9851 |
| cosine_f1_threshold | 0.3036 |
| cosine_precision | 0.9889 |
| cosine_recall | 0.9814 |
| **cosine_ap** | **0.9957** |
| cosine_mcc | 0.9791 |
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 1,432 training samples
* Columns: sentence_0, sentence_1, and label
* Approximate statistics based on the first 1000 samples:
| | sentence_0 | sentence_1 | label |
|:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:-----------------------------|
| type | string | string | int |
| details |
Average monthly net wage/salary of employees by age group and type of work (Rupiah), 2018 | Rata-rata Upah/Gaji Bersih Sebulan Buruh/Karyawan/Pegawai Menurut Kelompok Umur dan Jenis Pekerjaan (Rupiah), 2018 | 1 |
| Cek average real wage buruh industri pengolahan (level bawah) sekitar tahun 2009 | Rata-rata Upah Riil Per Bulan Buruh Industri Pengolahan di Bawah Mandor, 2005-2014 (1996=100) | 1 |
| Dimana saya bisa lihat rekapitulasi dokumen RPB kabupaten/kota? | Rekap Dokumen RPB Kabupaten/Kota | 1 |
* Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `num_train_epochs`: 30
- `fp16`: True
- `multi_dataset_batch_sampler`: round_robin
#### All Hyperparameters