SWE-bench

community

https://swe-bench.com

AI & ML interests

None defined yet.

Recent Activity

john-b-yang authored a paper 6 days ago

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

john-b-yang authored a paper 6 days ago

OpenThoughts: Data Recipes for Reasoning Models

john-b-yang authored a paper 6 days ago

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

View all activity

SWE-bench 's datasets 17

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 87

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 125

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 476

SWE-bench/SWE-bench_Verified

Benchmark • Updated Feb 27 • 500 • 61.9k • 80

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 1.13k

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 247 • 2

SWE-bench/SWE-smith-js

Viewer • Updated Jan 20 • 6.07k • 784

SWE-bench/SWE-smith-py

Viewer • Updated Dec 18, 2025 • 50.9k • 3.08k • 5

SWE-bench/SWE-smith-go

Viewer • Updated Dec 18, 2025 • 8.21k • 1.83k

SWE-bench/SWE-smith-php

Viewer • Updated Dec 18, 2025 • 1 • 53

SWE-bench/SWE-smith

Viewer • Updated Dec 14, 2025 • 59.1k • 19.9k • 51

SWE-bench/SWE-bench_Not_Verified

Viewer • Updated Sep 16, 2025 • 1.79k • 28

SWE-bench/SWE-bench_Multilingual

Viewer • Updated Aug 26, 2025 • 300 • 391k • 7

SWE-bench/SWE-smith-trajectories

Viewer • Updated Jul 19, 2025 • 76k • 3.53k • 60

SWE-bench/SWE-bench_Multimodal

Viewer • Updated Apr 29, 2025 • 612 • 7.79k • 9

SWE-bench/SWE-bench_Lite

Viewer • Updated Apr 29, 2025 • 323 • 29.4k • 14

SWE-bench/SWE-bench

Viewer • Updated Apr 29, 2025 • 21.5k • 7.29k • 29