SWE-bench

community

https://swe-bench.com

AI & ML interests

None defined yet.

Recent Activity

john-b-yang authored a paper 24 days ago

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

john-b-yang authored a paper 24 days ago

OpenThoughts: Data Recipes for Reasoning Models

john-b-yang authored a paper 24 days ago

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

View all activity

SWE-bench 's datasets 17

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 120

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 262

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 219

SWE-bench/SWE-bench_Verified

Benchmark • Updated Feb 27 • 500 • 70.3k • 94

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 862

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 264 • 2

SWE-bench/SWE-smith-js

Viewer • Updated Jan 20 • 6.07k • 242

SWE-bench/SWE-smith-py

Viewer • Updated Dec 18, 2025 • 50.9k • 3.11k • 5

SWE-bench/SWE-smith-go

Viewer • Updated Dec 18, 2025 • 8.21k • 1.16k

SWE-bench/SWE-smith-php

Viewer • Updated Dec 18, 2025 • 1 • 86

SWE-bench/SWE-smith

Viewer • Updated Dec 14, 2025 • 59.1k • 18.8k • 52

SWE-bench/SWE-bench_Not_Verified

Viewer • Updated Sep 16, 2025 • 1.79k • 34

SWE-bench/SWE-bench_Multilingual

Viewer • Updated Aug 26, 2025 • 300 • 655k • 17

SWE-bench/SWE-smith-trajectories

Viewer • Updated Jul 19, 2025 • 76k • 4.05k • 61

SWE-bench/SWE-bench_Multimodal

Viewer • Updated Apr 29, 2025 • 612 • 2.03k • 10

SWE-bench/SWE-bench_Lite

Viewer • Updated Apr 29, 2025 • 323 • 34.3k • 19

SWE-bench/SWE-bench

Viewer • Updated Apr 29, 2025 • 21.5k • 10.1k • 30