Hugging Face's logo

Spaces:
Yashp2003
/
repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks
Running

App Files Community
Yashp2003 commited on
Commit
d8dc675
·
verified ·
1 Parent(s): f564b4c

Update logbook: Reproduction: SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?

Browse files
Files changed (4) hide show
  1. logbook.json +3 -9
  2. pages/conclusion/page.md +1 -1
  3. pages/executive-summary/page.md +1 -0
  4. pages/index.md +0 -1
logbook.json CHANGED
@@ -10,7 +10,7 @@
10
  "icml2026-repro",
11
  "paper-uEVTdoAbnK"
12
  ],
13
- "updated_at": "2026-07-20T03:57:47+00:00",
14
  "root": {
15
  "slug": "index",
16
  "title": "Reproduction: SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?",
@@ -57,15 +57,9 @@
57
  "title": "Conclusion",
58
  "file": "pages/conclusion/page.md",
59
  "children": []
60
- },
61
- {
62
- "slug": "repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks",
63
- "title": "repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks",
64
- "file": "pages/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks/page.md",
65
- "children": []
66
  }
67
  ]
68
  },
69
- "agent_view_tokens": 6976,
70
- "revision": "1784519867604278223"
71
  }
 
10
  "icml2026-repro",
11
  "paper-uEVTdoAbnK"
12
  ],
13
+ "updated_at": "2026-07-20T04:02:50+00:00",
14
  "root": {
15
  "slug": "index",
16
  "title": "Reproduction: SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?",
 
57
  "title": "Conclusion",
58
  "file": "pages/conclusion/page.md",
59
  "children": []
 
 
 
 
 
 
60
  }
61
  ]
62
  },
63
+ "agent_view_tokens": 6677,
64
+ "revision": "1784520170898420245"
65
  }
pages/conclusion/page.md CHANGED
@@ -16,7 +16,7 @@
16
 
17
  ---
18
  <!-- trackio-cell
19
- {"type": "artifact", "id": "cell_repro_bundle", "created_at": "2026-07-20T02:31:54+00:00", "title": "Reproduction bundle", "type": "dataset", "path": "https://huggingface.co/buckets/Yashp2003/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks-artifacts#repro-bundle"}
20
  -->
21
  📦 **Reproduction bundle** (HF Bucket): [repro-bundle](https://huggingface.co/buckets/Yashp2003/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks-artifacts#repro-bundle)
22
 
 
16
 
17
  ---
18
  <!-- trackio-cell
19
+ {"type": "artifact", "id": "cell_repro_bundle", "created_at": "2026-07-20T02:31:54+00:00", "title": "Reproduction bundle", "path": "https://huggingface.co/buckets/Yashp2003/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks-artifacts#repro-bundle"}
20
  -->
21
  📦 **Reproduction bundle** (HF Bucket): [repro-bundle](https://huggingface.co/buckets/Yashp2003/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks-artifacts#repro-bundle)
22
 
pages/executive-summary/page.md CHANGED
@@ -24,6 +24,7 @@
24
  {"type": "figure", "id": "cell_21b13878865b", "created_at": "2026-07-20T03:56:53+00:00", "title": "Reproduction poster", "pinned": true, "pinned_at": "2026-07-20T03:57:36+00:00"}
25
  -->
26
  ````html
 
27
  <!DOCTYPE html>
28
  <html lang="en">
29
  <head>
 
24
  {"type": "figure", "id": "cell_21b13878865b", "created_at": "2026-07-20T03:56:53+00:00", "title": "Reproduction poster", "pinned": true, "pinned_at": "2026-07-20T03:57:36+00:00"}
25
  -->
26
  ````html
27
+ <!-- poster_embed.html : reproduction poster for SWE-Bench Pro (ICML 2026, uEVTdoAbnK) -->
28
  <!DOCTYPE html>
29
  <html lang="en">
30
  <head>
pages/index.md CHANGED
@@ -13,4 +13,3 @@
13
  | [Claim 4: All SWE-Bench Pro tasks underwent human verification for adequate context.](#/claim-4-all-swe-bench-pro-tasks-underwent-human-verification-for-adequate-context) |
14
  | [Claim 5: SWE-Bench Pro is a contamination-resistant testbed spanning business apps, B2B services, and dev tools.](#/claim-5-swe-bench-pro-is-a-contamination-resistant-testbed-spanning-business-apps-b2b-services-and-dev-tools) |
15
  | [Conclusion](#/conclusion) |
16
- | [repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks](#/repro-swe-bench-pro-can-ai-agents-solve-long-horizon-software-engineering-tasks) |
 
13
  | [Claim 4: All SWE-Bench Pro tasks underwent human verification for adequate context.](#/claim-4-all-swe-bench-pro-tasks-underwent-human-verification-for-adequate-context) |
14
  | [Claim 5: SWE-Bench Pro is a contamination-resistant testbed spanning business apps, B2B services, and dev tools.](#/claim-5-swe-bench-pro-is-a-contamination-resistant-testbed-spanning-business-apps-b2b-services-and-dev-tools) |
15
  | [Conclusion](#/conclusion) |