duoan/
🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models
by Victor An Python MIT licence 46 forks Created Jan 2026 View on GitHub
- Stars
- 381
- 7% of duoan's stars
- Rank
- #160,037
- of 852,204 repos, top 19%
- In Python
- #30,207
- of 173,304 repos, top 18%
Among 852,204 repos
250–400 stars: 77,420 repos, including mega-data-factory
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #159,672
- Next milestone
- +386 stars to reach the top 10%
- Popular
- One of 490,852 repos with 100+ stars