zhyncs
LLM Inference Acceleration
Funding Links: https://github.com/sponsors/zhyncs
- Kind: user
- Followers: 46
- Following: 0
- Total stars: 18
- Repositories count: 11
- Created at: 2023-06-04T03:24:05.552Z
- Updated at: 2024-05-01T11:06:24.861Z
- Last synced at: 2024-05-01T11:06:18.595Z
GitHub Sponsors Profile
🔠I am a software engineer on the Model Performance Team at Baseten. I used to work at Meituan, using Tensorflow, TensorRT for CTR GPU Inference and PyTorch for LLM GPU Inference.
💻 Open Source: Team Member at LMSYS Org, working on SGLang, and a committer for both FlashInfer and LMDeploy.
👀 If you're interested in learning more about my experiences and SGLang, I recommend checking out my talk about SGLang at GPU MODE.
- Current Sponsors: 2
- Past Sponsors: 0
- Total Sponsors: 2
- Minimum Sponsorship: $1.00
Active Sponsors
Past Sponsors
haishaw
Sponsor Breakdown
- User: 1
Past Sponsorships
View All
tw93
Sponsorship Breakdown by Kind
- User: 1