epfml/collaborative-attention

Code for Multi-Head Attention: Collaborate Instead of Concatenate

by EPFL Machine Learning and Optimization Laboratory Python Apache-2.0 licence 22 forks Created Jun 2020 View on GitHub

Stars
152
2% of epfml's stars
Rank
#346,525
of 847,086 repos, top 41%
In Python
#68,154
of 172,210 repos, top 40%

Among 847,086 repos

Compare with

100–160 stars: 154,379 repos, including collaborative-attention

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #344,670
Next milestone
+5 stars to reach the top 40%
Popular
One of 488,402 repos with 100+ stars
Yearly average
24 stars a year since Jun 2020

Stars counted Recounted daily Next count around