Ecosyste.ms sponsors
An open API service aggregating public data about GitHub Sponsors.
An open API service aggregating public data about GitHub Sponsors.
Training by day, inference by night.
Funding Links: https://github.com/sponsors/merrymercy
👋 Hey there! I'm Lianmin Zheng.
Open Source Projects
I am leading or co-leading the development of the following projects with a talented team and a passionate community of contributors.
SGLang: an efficient interface and runtime for interaction with LLMs.
FastChat: an open platform for training, serving, and evaluating large language model based chatbots. It powers our LMSYS projects such as Vicuna and Chatbot Arena.
Vicuna: an open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.
Chatbot Arena: benchmarking LLMs in the wild with Elo ratings.
Alpa: an auto-parallelizer for training and serving large-scale neural networks.
Besides, I am fortunate to have made significant contributions to the following projects.
TVM: an end-to-end deep learning compiler.
FlexGen: high-throughput generative inference of large language models with a single GPU.
About me
My interests are scalable and accelerated systems for machine learning. You can find me on:
My website
Google Scholar
Twitter
🎉 If you are using any of my open-source projects and would like to show your appreciation, you can sponsor me on this page to support the future development of these projects.
SGLang is a fast serving framework for large language models and vision language models.
Language: Python - Stars: 7215An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Language: Python - Stars: 37463Running large language models on a single GPU for throughput-oriented scenarios.
Language: Python - Stars: 9254Training and serving large-scale neural networks with auto parallelization.
Language: Python - Stars: 3094