compilade
Funding Links: https://github.com/sponsors/compilade
- Location: Montréal, Canada
- Kind: user
- Followers: 44
- Following: 0
- Total stars: 4
- Repositories count: 4
- Created at: 2023-05-16T16:30:30.553Z
- Updated at: 2025-03-25T22:33:41.370Z
- Last synced at: 2025-03-25T22:33:41.369Z
GitHub Sponsors Profile
Support my work on llama.cpp related to memory optimizations (also for the convert scripts), fast ternary packing, Mamba, Mamba-2, Jamba, and other recurrent models.
I've also been exploring with rounding algorithms to improve k-quants.
I study in Electrical Engineering, but I like to work on ML in my free time. I like to work on problems where both low-level and high-level concepts need to be considered.
Large external storage is very useful when testing the conversion script(s).
Sometimes, when working on (de)quantization schemes, I need to test things on hardware with specific instruction set extensions and/or GPUs, in which case I temporarily rent a cloud instance, but I generally prefer to use local hardware.
- Current Sponsors: 2
- Past Sponsors: 0
- Total Sponsors: 2
- Minimum Sponsorship: $1.00
Active Sponsors
Past Sponsors
ggerganov
Sponsor Breakdown
- User: 1