openai/SWELancer-Benchmark

This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"

Archived by OpenAI 135 forks Created Feb 2025 View on GitHub

Stars
1,428
<1% of openai's stars
Rank
#47,976
of 847,070 repos, top 6%

Among 847,070 repos

1k–1.6k stars: 23,510 repos, including SWELancer-Benchmark

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #47,942
Next milestone
+5,802 stars to reach the top 1%
Popular
One of 66,291 repos with 1k+ stars
Yearly average
828 stars a year since Feb 2025

Stars counted Recounted daily Next count around