GitHub Author
vllm-project
vllm-project has 2 repositories in the Setuproll index, worth 97,538 stars between them. The work sits in LLM Apps and Prompts. The code is mostly Go and Python.
View profile on GitHub2Repos
97.5kStars
2Categories
Languages
Go1Python1
Ranked by stars
Showing 2 of 2
01
A high-throughput and memory-efficient inference and serving engine for LLMs
02
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Other authors in LLM Apps