SaylorTwift HF Staff commited on
Commit
ee66549
·
verified ·
1 Parent(s): 98db59b

Add evaluation results

Browse files
Files changed (1) hide show
  1. .eval_results/ornith-1.5-9b.yaml +65 -0
.eval_results/ornith-1.5-9b.yaml ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 70.6
5
+ date: "2026-08-18"
6
+ source:
7
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
8
+ name: "Ornith-1.5-9B model card"
9
+
10
+ - dataset:
11
+ id: ScaleAI/SWE-bench_Pro
12
+ task_id: SWE_Bench_Pro
13
+ value: 47.5
14
+ date: "2026-08-18"
15
+ source:
16
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
17
+ name: "Ornith-1.5-9B model card"
18
+
19
+ - dataset:
20
+ id: SWE-bench/SWE-bench_Multilingual
21
+ task_id: swe_bench_multilingual_%_resolved
22
+ value: 54.4
23
+ date: "2026-08-18"
24
+ source:
25
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
26
+ name: "Ornith-1.5-9B model card"
27
+
28
+ - dataset:
29
+ id: cais/hle
30
+ task_id: hle
31
+ value: 20.2
32
+ date: "2026-08-18"
33
+ source:
34
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
35
+ name: "Ornith-1.5-9B model card"
36
+ notes: "No tools."
37
+
38
+ - dataset:
39
+ id: cais/hle
40
+ task_id: hle
41
+ value: 30.5
42
+ date: "2026-08-18"
43
+ source:
44
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
45
+ name: "Ornith-1.5-9B model card"
46
+ notes: "With tools."
47
+
48
+ - dataset:
49
+ id: Idavidrein/gpqa
50
+ task_id: diamond
51
+ value: 86.4
52
+ date: "2026-08-18"
53
+ source:
54
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
55
+ name: "Ornith-1.5-9B model card"
56
+
57
+ - dataset:
58
+ id: claw-eval/Claw-Eval
59
+ task_id: general
60
+ value: 66.5
61
+ date: "2026-08-18"
62
+ source:
63
+ url: https://huggingface.co/ornith-ai/Ornith-1.5-9B
64
+ name: "Ornith-1.5-9B model card"
65
+ notes: "Model card reports one aggregate score without a split breakdown; mapped to the general split."