codefuse-ai/ModelCache

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

by codefuse-ai Python Other licence 66 forks Created Nov 2023 View on GitHub

Stars
933
8% of codefuse-ai's stars
Rank
#70,602
of 847,086 repos, top 9%
In Python
#12,801
of 172,210 repos, top 8%

Among 847,086 repos

Compare with

630–1k stars: 35,494 repos, including ModelCache

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #70,532
Next milestone
+6,300 stars to reach the top 1%
Popular
One of 488,402 repos with 100+ stars
Yearly average
308 stars a year since Nov 2023

Stars counted Recounted daily Next count around