Profile avatar
galiglobal.com
I have a passion for building data streaming platforms. I'm a software engineer at New Relic, and a Java developer who's enthusiastic with Apache Kafka and Flink. Rust aficionado. Plus, I'm a big fan of reducing my carbon footprint 🌱
115 posts 564 followers 125 following
Regular Contributor
Active Commenter
Posts 26 Comments 24

I'm one of those annoying engineers always pushing to make our internal tooling available for customers. It has been a long journey but I'm very proud of New Relic Queues & Streams finally being released! docs.newrelic.com/docs/message...

submitted 1 day ago • 1 comment

Recruiter email: > As we move into phase 2 of the AI ecosystem Next message: > To ensure a fair evaluation across candidates, we ask that candidates do not use Generative AI tools when solving the problems in question

submitted 8 days ago • 2 comments

My way of dealing with spam and robocalls: 1. Answer the call. 2. Mute yourself immediately and wait. 3. Once they give up, mark the number as spam. After five to ten calls, they will remove your number from the list.

submitted 8 days ago • 0 comments

Still grinding away on my Current London submissions! Hopefully, you're not in the same boat but if you haven't submitted yet, you've still got a few hours left! As a member of the Program Committee, I'm excited to see what innovative ideas come through. Submit now! sessionize.com/current-lond...

submitted 9 days ago • 0 comments

Could someone here invite me to lobste.rs? 🙏 BlueSky and Lobsters are all I need.

submitted 10 days ago • 0 comments

"We utilize the ‘island model’ for deploying our Flink jobs, where all dependencies for a given application reside within a single region" After 4 years using this approach, it's my default choice nowadays (but isolating at the AZ level instead of region). netflixtechblog.com/introducing-...

submitted 10 days ago • 0 comments

Low-Overhead, Zero-Instrumentation, Continuous Profiling for OpenTelemetry. This is very promising (and pretty cool) m.youtube.com/watch?v=WtND...

submitted 10 days ago • 0 comments

Reading about Phi Accrual Failure Detector in the Database Internals book, it seems a perfect fit to detect slow Kafka brokers early and take them out of the cluster before they affect clients/other brokers

submitted 14 days ago • 0 comments

State download times from ~15s to ~8.5s using s5cmd 🤯 cwiki.apache.org/confluence/d...

submitted 14 days ago • 0 comments

Other frameworks: Apache Flink is too heavy and it requires a cluster Apache Flink: let's process 100MB/s of data in Kafka with only 100 MB of memory heap and only one single JVM instance 😎 Great (and useful) talk! www.youtube.com/watch?v=04pw...

submitted 15 days ago • 0 comments

Great read! Found 7 different Rust Streaming Engines so far, though all have limited adoption vs Apache Flink. Hoping to see one join a foundation to consolidate community efforts and drive wider adoption

submitted 17 days ago • 0 comments

Iceberg FileIO is very interesting to optimize Object Storage reads/writes. I'm working on similar optimizations but the edge cases are tricky. I wonder if someone has already used it without Iceberg for similar use cases www.tabular.io/blog/iceberg...

submitted 17 days ago • 0 comments

From the last Cloudfare incident: > On-call attempts to re-enable the R2 Gateway service using our internal admin tooling, however this tooling was unavailable because it relies on R2. In distributed system there's no "always available" system but it's a useful assumption with object storage

submitted 19 days ago • 1 comment

Revolutionizing Failure Management in Apache Flink: Meet FLIP-304's Pluggable Failure Enrichers ❤️ www.confluent.io/blog/flip-30...

submitted 20 days ago • 0 comments

The YCombinator Requests for Startups is pretty interesting. It seems that being a System Engineer is going to be cool again www.ycombinator.com/rfs

submitted 21 days ago • 0 comments

New features in the State Reader API of Spark Structured Streaming for auditing, exploring, and visualizing state changes. Interesting stuff also needed for Apache Flink (hopefully FLIP-423 will help with that making the state queryable again) www.databricks.com/blog/announc...

submitted 21 days ago • 1 comment

✍️ Blog++: Just published how I use MinIO + OpenTelemetry Collector for local monitoring to test different approaches optimising S3 cost in our pipelines www.galiglobal.com/blog/2025/20...

submitted 22 days ago • 0 comments

API First is the Scrum version of Individual Contributors

submitted 23 days ago • 0 comments

LLMs are impressive knowledge tools, but experience is still king

submitted 23 days ago • 0 comments

The Curse of Replication Saturation in Apache Kafka. It's correlated with some of the reliability work we did in New Relic to solve the problem of slow volumes. Highly recommended if you are a heavy user of Kafka www.linkedin.com/pulse/curse-...

submitted 27 days ago • 0 comments

Open source will always win 💯

submitted 28 days ago • 0 comments

My favorite footguns I observe people doing when building software systems:

submitted 28 days ago • 0 comments

Amazon S3 Metadata is now GA, happy to see that speed of innovation in S3. It isn't suitable for streaming (minutes latency), but it seems great for discovery/analytics aws.amazon.com/about-aws/wh...

submitted 29 days ago • 2 comments

How electricity grid pricing works, and how it is affected by renewables www.theclimatebrink.com/p/an-explana...

submitted 31 days ago • 0 comments

Cool OpenTelemetry extension: Monitor your Java application's environmental impact alongside its performance. Combines resource demand tracking (CPU, memory, network, storage) with Cloud Carbon Footprint coefficients to calculate precise carbon emissions per API call github.com/RETIT/opente...

submitted 31 days ago • 0 comments

A week full of meetings in the India office. Not even one slide, only whiteboard. That's the way

submitted 33 days ago • 1 comment