open-compass

OpenCompass Joined Aug 2023 View on GitHub

Stars: 15,682; across 43 public repos
Rank: #2,447; of 94,827 organizations, top 3%; Down 114 places this week

Repositories with 50+ stars

open-compass's repositories with their overall rank
Rank	Repository	Language	Stars
8,018	opencompass OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding,...	Python	7,583
14,606	VLMEvalKit Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks	Python	4,480
84,741	MixtralKit A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI	Python	768
135,796	LawBench Benchmarking Legal Knowledge of Large Language Models	Python	457
189,431	T-Eval [ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step	Python	313
189,933	MMBench Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"		312
286,750	AgentCompass [EMNLP 2026] AgentCompass is an extensible open-source evaluation infrastructure for systematically assessing LLM/VLM agent capabilities.	Python	191
327,195	BotChat Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.	Jupyter Notebook	163
344,670	GTA [NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2	Python	153
372,822	DevEval A Comprehensive Benchmark for Software Development.	Python	139
398,367	GAOKAO-Eval	Jupyter Notebook	128
413,996	CompassJudger The All-in-one Judge Models introduced by Opencompass		122
427,929	MathBench [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset		117
433,717	MMBench-GUI Official repo of "MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents". It can be used to evaluate a GUI agent with a hierarchical manner across multiple platforms,...	Python	115
516,721	OpenFinData		92
626,825	CompassVerifier [EMNLP 2025] CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward	Jupyter Notebook	72
663,603	ANAH [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO	Python	67
763,364	Ada-LEval The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"	Python	56
809,321	GenEditEvalKit The first unified, efficient, and extensible evaluation toolkit for evaluating image generation and editing models across multiple benchmarks.	Jupyter Notebook	52
821,538	CriticEval [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs	Python	51

Among 94,827 organizations

10k–16k stars: 1,461 organizations, including open-compass

top 50%top 10%top 1%top 0.1%

Stars along the bottom, and organizations in each band on a log scale

Where the stars are

opencompass 7.6k, 48%VLMEvalKit 4.5k, 29%MixtralKit 768, 5%LawBench 457, 3%T-Eval 313, 2%MMBench 312, 2%

Smaller repos 251, 2%

AgentCompass 191, 1%BotChat 163, 1%

3 more repos 159, 1%

GTA 153, 1%DevEval 139, 1%GAOKAO-Eval 128, 1%CompassJudger 122, 1%MathBench 117, 1%MMBench-GUI 115, 1%OpenFinData 92, 1%CompassVerifier 72, <1%ANAH 67, <1%

Languages

Python 14.4k stars, 92% · 12 repos
Jupyter Notebook 415 stars, 3% · 4 repos

When they were made

20 repos with 50+ stars, made between 2023 and 2026

101001k10k MixtralKitVLMEvalKitopencompass

Quick stats

Next rank: +6 stars to reach #2,445
Next milestone: +19,291 stars to reach the top 1%
Public repos: 43, 20 with 50+ stars
Popular repos: 14 over 100 stars, 2 over 1k stars
Top repo: opencompass, #8,018 of all repos, 48% of stars
Smaller repos: 251 stars from repos under 50