Ecosyste.ms sponsors
An open API service aggregating public data about GitHub Sponsors.
An open API service aggregating public data about GitHub Sponsors.
LLM Inference Acceleration
Funding Links: https://github.com/sponsors/zhyncs
🔠I am a software engineer on the Model Performance Team at Baseten. I used to work at Meituan, using Tensorflow, TensorRT for CTR GPU Inference and PyTorch for LLM GPU Inference.
💻 Open Source: Team Member at LMSYS Org, working on SGLang, and a committer for both FlashInfer and LMDeploy.
👀 If you're interested in learning more about my experiences and SGLang, I recommend checking out my talk about SGLang at GPU MODE.