GitHub Author
vllm-project
vllm-project has 2 repositories in the Setuproll index, worth 88,106 stars between them. The work sits in LLM Apps and Prompts. The code is mostly Go and Python.
View profile on GitHub2Repos
88.1kStars
2Categories
Languages
Go1Python1
Ranked by stars
Showing 2 of 2
01
A high-throughput and memory-efficient inference and serving engine for LLMs
02
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Other authors in LLM Apps