rogermt commited on
Commit
1a555f7
·
verified ·
1 Parent(s): 8ea86ca

Update KAGGLE_SUBMIT.md with current status and v4 instructions

Browse files
Files changed (1) hide show
  1. medal-solvers/KAGGLE_SUBMIT.md +31 -17
medal-solvers/KAGGLE_SUBMIT.md CHANGED
@@ -1,6 +1,6 @@
1
  # Kaggle Submission Instructions
2
 
3
- ## Current Status: LB 6053.17 (V17), Bronze threshold: 6055.14
4
 
5
  ## How to Submit (Kaggle Notebook)
6
 
@@ -25,26 +25,40 @@ os.chdir('/kaggle/working/neurogolf-solver/medal-solvers')
25
  ## What swap_and_submit.py does:
26
  1. Opens submission-6043.zip (base submission)
27
  2. Auto-discovers ALL .onnx files in `optimized/` folder:
28
- - `optimized/task255.onnx` (11.570 pts, +4.93 from original)
29
- - `optimized/task285.onnx` (8.818 pts, +2.83 from original)
30
- - `optimized/task319.onnx` (11.244 pts, +3.32 from original)
 
31
  3. Validates each model against task data (0 failures required)
32
  4. Creates new submission.zip with replaced models
33
 
34
- ## Score Budget
35
 
36
- | Task | Original | Optimized | Gain | Status |
37
- |------|----------|-----------|------|--------|
38
- | 285 | 5.98 | 8.82 | +2.83 | ✅ Confirmed on Kaggle |
39
- | 255 | 6.64 | 11.57 | +4.93 | ✅ In submission |
40
- | 319 | 7.92 | 11.24 | +3.32 | ✅ In submission |
41
- | **Total** | | | **+11.08** | **LB: 6053.17** |
42
 
43
- ## Gap to Bronze: 1.97 pts
44
 
45
- To close the gap, would need to optimize another task model.
46
- Largest models with most optimization potential:
47
- - task209.onnx (1.29MB), task366.onnx (1.27MB), task084.onnx (1.13MB)
48
- - task076.onnx (949KB), task233.onnx (939KB), task153.onnx (862KB)
49
 
50
- Each would require reverse-engineering the task rule (like we did for 255/285/319).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Kaggle Submission Instructions
2
 
3
+ ## Current Status: LB 6059.08 (V25), Target: 6100
4
 
5
  ## How to Submit (Kaggle Notebook)
6
 
 
25
  ## What swap_and_submit.py does:
26
  1. Opens submission-6043.zip (base submission)
27
  2. Auto-discovers ALL .onnx files in `optimized/` folder:
28
+ - `optimized/task084.onnx` (~12 pts, +2.56 from base)
29
+ - `optimized/task153.onnx` (**V4: 14.0 pts local**, fixes Kaggle discrepancy)
30
+ - `optimized/task255.onnx` (11.570 pts, +4.93 from base)
31
+ - `optimized/task319.onnx` (11.580 pts, +3.66 from base)
32
  3. Validates each model against task data (0 failures required)
33
  4. Creates new submission.zip with replaced models
34
 
35
+ ## Task 153 V4 — Key Change
36
 
37
+ V4 eliminates the multi-dimensional Gather `[9,3,3]` pattern that caused
38
+ the Kaggle scoring discrepancy (13.83 local vs 7.92 Kaggle in V3).
 
 
 
 
39
 
40
+ **Expected impact**: If Kaggle matches local, task153 goes from ~7.92 → ~14 = **+6 pts**
41
 
42
+ ## Score Budget (with V4)
 
 
 
43
 
44
+ | Task | Base | V25 LB | V4 Expected | Expected Gain vs V25 |
45
+ |------|------|--------|-------------|---------------------|
46
+ | 084 | ~9.4 | ~12 | ~12 | — |
47
+ | 153 | 4.91 | ~7.92 | ~14.0 | **+6.0** |
48
+ | 255 | 6.64 | 11.57 | 11.57 | — |
49
+ | 285 | 5.98 | 8.82 | 8.82 | — |
50
+ | 319 | 7.92 | 11.58 | 11.58 | — |
51
+ | **Total Expected** | | **6059.08** | **~6065** | **+6** |
52
+
53
+ ## Remaining Gap After V4: ~35 pts to 6100
54
+
55
+ Need to optimize 5-7 more tasks at +5 pts each to reach 6100.
56
+ Priority targets: task366, task025, task158, task118, task209.
57
+
58
+ ## Important Notes
59
+
60
+ - **task285.onnx** is NOT in the optimized/ folder — it was already included
61
+ in the original V13 submission. The base zip (submission-6043.zip) already
62
+ uses the optimized task285.
63
+ - Always validate before submitting: a model with ANY failures scores only 1.0!
64
+ - File size limit per model: 1,509,949 bytes