cpral commited on
Commit
1cdc264
·
verified ·
1 Parent(s): a05e5ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -10,3 +10,27 @@ base_model:
10
 
11
  <img width="600px" src="https://huggingface.co/deepreinforce-ai/Ornith-1.0-397B/resolve/main/assets/ornith_logo.png">
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  <img width="600px" src="https://huggingface.co/deepreinforce-ai/Ornith-1.0-397B/resolve/main/assets/ornith_logo.png">
12
 
13
+ ```
14
+ -- A perplexity: 3.20393975
15
+ -- B perplexity: 3.26597043
16
+ -- A label in top-K:
17
+ K = 1: 0.7186
18
+ K = 2: 0.8140
19
+ K = 3: 0.8549
20
+ K = 4: 0.8786
21
+ K = 5: 0.8937
22
+ -- B label in top-K:
23
+ K = 1: 0.7141
24
+ K = 2: 0.8116
25
+ K = 3: 0.8527
26
+ K = 4: 0.8767
27
+ K = 5: 0.8923
28
+ -- Top-K agreement, A vs B:
29
+ K = 1: 0.9422
30
+ K = 2: 0.7667
31
+ K = 3: 0.5596
32
+ K = 4: 0.3816
33
+ K = 5: 0.2486
34
+ -- KL divergence (A, B): 0.04249165
35
+ -- KL divergence (B, A): 0.03919449
36
+ ```