vipshop/ffpa-attn

Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.

by 唯品会 Python Apache-2.0 licence 29 forks Created Nov 2024 View on GitHub

Stars
348
2% of vipshop's stars
Rank
#173,411
of 851,979 repos, top 21%
In Python
#32,849
of 173,293 repos, top 19%

Among 851,979 repos

Compare with

250–400 stars: 77,404 repos, including ffpa-attn

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #172,973
Next milestone
+8 stars to reach the top 20%
Popular
One of 490,661 repos with 100+ stars
Yearly average
178 stars a year since Nov 2024

Stars counted Recounted daily Next count around