meta-pytorch/ dist_moe
Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs
by Meta PyTorch Python BSD-3-Clause licence 15 forks Created Sept 2026 View on GitHub
- Stars
- 76
- <1% of meta-pytorch's stars
- Rank
- #603,897
- of 852,119 repos, top 71%
- In Python
- #121,914
- of 173,305 repos, top 71%
Among 852,119 repos
63–100 stars: 217,631 repos, including dist_moe
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #597,845
- Next milestone
- +2 stars to reach the top 70%