bentoml

BentoML Joined Apr 2019 View on GitHub

Repositories with 50+ stars

bentoml's repositories with their overall rank
Rank	Repository	Language	Stars
4,340	OpenLLM Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.	Python	12,589
6,599	BentoML The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!	Python	8,935
77,929	Yatai Model Deployment at Scale on Kubernetes 🦄️	TypeScript	839
156,180	BentoDiffusion BentoDiffusion: A collection of diffusion models served with BentoML	Python	390
259,984	comfy-pack A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.	Python	215
272,547	llm-optimizer Benchmark and optimize LLM inference across frameworks with ease	Python	203
275,972	stable-diffusion-server Deploy Your Own Stable Diffusion Service	Python	200
308,360	bentoctl Fast model deployment on any cloud 🚀	Python	175
308,360	BentoVLLM Self-host LLMs with vLLM and BentoML	Python	175
360,099	gallery BentoML Example Projects 🎨		145
381,787	BentoVoiceAgent Build Phone Calling Voice Agent fully powered by open source models.	Python	135
648,250	openllm-models	Python	69
663,603	CLIP-API-service CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search	Jupyter Notebook	67
723,126	BentoOCR Turn any OCR models into online inference API endpoint 🚀 🌖	Python	60
742,438	llm-bench	Python	58
809,321	rag-tutorials a series of tutorials implementing rag service with BentoML and LlamaIndex	Python	52

16k–25k stars: 924 organizations, including bentoml

top 50%top 10%top 1%top 0.1%

Stars along the bottom, and organizations in each band on a log scale

Smaller repos 559, 2%

5 more repos 306, 1%

16 repos with 50+ stars, made between 2019 and 2025

101001k10k100k YataiBentoMLOpenLLM