SkyworkAI/
MoH: Multi-Head Attention as Mixture-of-Head Attention
by Skywork Python Apache-2.0 licence 14 forks Created Oct 2024 View on GitHub
- Stars
- 313
- 1% of SkyworkAI's stars
- Rank
- #189,431
- of 847,086 repos, top 23%
- In Python
- #36,115
- of 172,210 repos, top 21%
Among 847,086 repos
250–400 stars: 77,108 repos, including MoH
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #188,906
- Next milestone
- +43 stars to reach the top 20%
- Popular
- One of 488,402 repos with 100+ stars
- Yearly average
- 150 stars a year since Oct 2024