SWE-bench

community

https://swe-bench.com

AI & ML interests

None defined yet.

Recent Activity

john-b-yang authored a paper 18 days ago

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

john-b-yang authored a paper 18 days ago

OpenThoughts: Data Recipes for Reasoning Models

john-b-yang authored a paper 18 days ago

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

View all activity

SWE-bench 's datasets 17

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 107

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 219

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 303

SWE-bench/SWE-bench_Verified

Benchmark • Updated Feb 27 • 500 • 74.7k • 94

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 1.14k

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 330 • 2

SWE-bench/SWE-smith-js

Viewer • Updated Jan 20 • 6.07k • 530

SWE-bench/SWE-smith-py

Viewer • Updated Dec 18, 2025 • 50.9k • 3.33k • 5

SWE-bench/SWE-smith-go

Viewer • Updated Dec 18, 2025 • 8.21k • 1.48k

SWE-bench/SWE-smith-php

Viewer • Updated Dec 18, 2025 • 1 • 93

SWE-bench/SWE-smith

Viewer • Updated Dec 14, 2025 • 59.1k • 18.7k • 52

SWE-bench/SWE-bench_Not_Verified

Viewer • Updated Sep 16, 2025 • 1.79k • 41

SWE-bench/SWE-bench_Multilingual

Viewer • Updated Aug 26, 2025 • 300 • 563k • 14

SWE-bench/SWE-smith-trajectories

Viewer • Updated Jul 19, 2025 • 76k • 3.93k • 61

SWE-bench/SWE-bench_Multimodal

Viewer • Updated Apr 29, 2025 • 612 • 3.79k • 10

SWE-bench/SWE-bench_Lite

Viewer • Updated Apr 29, 2025 • 323 • 32.4k • 17

SWE-bench/SWE-bench

Viewer • Updated Apr 29, 2025 • 21.5k • 8.69k • 30