BFTree commited on
Commit
05f427f
·
verified ·
1 Parent(s): 3761d38

Improve model card

Browse files
Files changed (1) hide show
  1. README.md +11 -15
README.md CHANGED
@@ -57,13 +57,13 @@ similarity over normalized embeddings.
57
 
58
  ## Training
59
 
60
- The base revision is `d4aa6901d3a41ba39fb536a557fa166f842b0e09`. We used
61
- 40 reviews sampled from the training split to select the epoch count. Recall@20
62
- is the primary metric, with Recall@100 and Recall@200 used as tie-breakers. The
63
- released checkpoint was retrained for one epoch using the full training split
64
- with Multiple Negatives Ranking Loss, batch size 64, learning rate 2e-5,
65
- maximum sequence length 512, and seed 718. After excluding articles linked to
66
- a test review, 334 of the 336 training reviews contribute positive pairs.
67
 
68
  There are 5,585 constructed training pairs. The sentence-transformers training
69
  loader used 5,568 examples in complete batches during the epoch; this accounts
@@ -74,14 +74,10 @@ for the smaller sample count shown by automatically generated trainer metadata.
74
  All metrics are macro-averaged over the 86 held-out reviews after removing the
75
  source review itself from each ranking.
76
 
77
- | K | Recall@K | Precision@K |
78
- |---:|---:|---:|
79
- | 5 | 24.0% | 47.9% |
80
- | 10 | 38.8% | 42.0% |
81
- | 20 | 53.5% | 34.0% |
82
- | 50 | 75.3% | 22.6% |
83
- | 100 | 84.2% | 14.0% |
84
- | 200 | 91.7% | 8.4% |
85
 
86
  The source-review split is disjoint, and every article linked to a test review
87
  is excluded as a positive retriever-training example.
 
57
 
58
  ## Training
59
 
60
+ We used 40 reviews sampled from the training split to select the epoch count.
61
+ Recall@20 is the primary metric, with Recall@100 and Recall@200 used as
62
+ tie-breakers. The released checkpoint was retrained for one epoch using the
63
+ full training split with Multiple Negatives Ranking Loss, batch size 64,
64
+ learning rate 2e-5, maximum sequence length 512, and seed 718. After excluding
65
+ articles linked to a test review, 334 of the 336 training reviews contribute
66
+ positive pairs.
67
 
68
  There are 5,585 constructed training pairs. The sentence-transformers training
69
  loader used 5,568 examples in complete batches during the epoch; this accounts
 
74
  All metrics are macro-averaged over the 86 held-out reviews after removing the
75
  source review itself from each ranking.
76
 
77
+ | Metric | K=5 | K=10 | K=20 | K=50 | K=100 | K=200 |
78
+ |:--|--:|--:|--:|--:|--:|--:|
79
+ | Recall@K | 24.0% | 38.8% | 53.5% | 75.3% | 84.2% | 91.7% |
80
+ | Precision@K | 47.9% | 42.0% | 34.0% | 22.6% | 14.0% | 8.4% |
 
 
 
 
81
 
82
  The source-review split is disjoint, and every article linked to a test review
83
  is excluded as a positive retriever-training example.