codefuse-ai/ ModelCache
A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
by codefuse-ai Python Other licence 66 forks Created Nov 2023 View on GitHub
- Stars
- 933
- 8% of codefuse-ai's stars
- Rank
- #70,602
- of 847,086 repos, top 9%
- In Python
- #12,801
- of 172,210 repos, top 8%
Among 847,086 repos
630–1k stars: 35,494 repos, including ModelCache
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #70,532
- Next milestone
- +6,300 stars to reach the top 1%
- Popular
- One of 488,402 repos with 100+ stars
- Yearly average
- 308 stars a year since Nov 2023