meta-pytorch/dist_moe

Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs

by Meta PyTorch Python BSD-3-Clause licence 15 forks Created Sept 2026 View on GitHub

Stars
76
<1% of meta-pytorch's stars
Rank
#603,897
of 852,119 repos, top 71%
In Python
#121,914
of 173,305 repos, top 71%

Among 852,119 repos

Compare with

63–100 stars: 217,631 repos, including dist_moe

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #597,845
Next milestone
+2 stars to reach the top 70%

Stars counted Recounted daily Next count around