openai/ SWELancer-Benchmark
This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"
Archived by OpenAI 135 forks Created Feb 2025 View on GitHub
- Stars
- 1,428
- <1% of openai's stars
- Rank
- #47,976
- of 847,070 repos, top 6%
Among 847,070 repos
1k–1.6k stars: 23,510 repos, including SWELancer-Benchmark
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #47,942
- Next milestone
- +5,802 stars to reach the top 1%
- Popular
- One of 66,291 repos with 1k+ stars
- Yearly average
- 828 stars a year since Feb 2025