Ecosyste.ms sponsors
An open API service aggregating public data about GitHub Sponsors.
An open API service aggregating public data about GitHub Sponsors.
SaaS Products. Distributed systems. Big Data.
Funding Links: https://github.com/sponsors/nickpoorman
Thanks for considering being my sponsor. A large part of my time is dedicated to building open source tooling around data and event architectures. I have experience with growing engineering organizations, large customer data platforms, machine learning, and even craft beer. I've dug deep into Apache Arrow Project and event architectures.
Now my goal is to make SaaS developers and data engineers more productive by solving hard problems and providing a lot of what is re-invented with every new project.
Here are a few of my recent open-source projects in the areas I've been focusing on. Your support encourages me to continue dedicating time on improving them.
https://github.com/hyperscalr/fallbaq - A distributed, clustered, replicated log and queue service with security, retries, and back-off capabilities. I am dedicating the majority of my efforts to this and am now working on it full-time.
https://github.com/gomem/gomem - Data tooling for Apache Arrow in Go - including a DataFrame implementation
https://github.com/nickpoorman/pytasks - Run Python inside a Go process (ooohhhh ahhhhh)
https://github.com/nickpoorman/go-py-arrow-bridge - Share pointers directly between Apache Arrow buffers between Python and Go - i.e. Manipulate data in Python and then do things with it in Go without having to serialize it over the language boundary. This way you can use Go and continue to use your favorite data science libraries in Python.
https://github.com/pantry-io/pantry - A horizontally scalable, disk persisted, the no-worry solution to dealing with high-volume event streams. Think Kafka but without the bloat. Read more about it here p1 and here p2.
I recently started @Hypersclar to fully dedicate my efforts towards building these projects out. Please feel free to reach out if you have a need for anything these tools are not currently providing.
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
Language: C++ - Stars: 14667Various packages for working with Apache Arrow in Go, including a DataFrame implementation.
Language: Go - Stars: 26Bridge between Go and Python to facilitate zero-copy using Apache Arrow
Language: Go - Stars: 18A simple to maintain background job and message queue service. https://nickpoorman.com/2020-07-26-data-pipelines-part-2-retries/
Language: Go - Stars: 6Python task execution in Go
Language: Go - Stars: 2