You Kaizhao
Kaichao You is a core maintainer of vLLM, the leading open-source LLM inference engine, and a co-founder of Inferact, a startup building a universal AI inference layer. He is known for his work on making LLM inference faster and cheaper through the vLLM project, which runs on hundreds of thousands of GPUs worldwide and is used in production by major technology companies. Inferact, backed by a16z, Sequoia, and ZhenFund, aims to grow vLLM as the world's AI inference engine while developing a next-generation commercial inference engine.
“Like a16z — they provided a grant to the vLLM project back in 2023. In 2024, Sequoia and Zhenfund also donated money to us in the form of an open-source community. When we finally told them we had decided to start a company, they were quite straightforwardly ready — 'My money is already prepared. You've finally decided.'”
Source→AI-extracted from podcast / newsletter / paper summaries. May contain errors.