Profile avatar
maninekkalapudi.io
Plays with data and code. Data Engineer and infra enthusiast Socials: linktr.ee/maninekkalapudi
482 posts 285 followers 604 following
Regular Contributor
Active Commenter

There is going to be a cottage industry in cleaning up and patching applications built by ding-dongs with AI Agents who have no idea how the code works.

Thus begins Apple's quarterly ritual

uv is one year old today. Hard to believe its only been a year. The growth, adoption, and impact surpassed my wildest expectations. Happy birthday, uv! 🥳

Chat, my scrum master has VSCode, anaconda, sypder, terminal apps opened on his system and I see a lot of chrome tabs opened. A LOT! All on SQL! He is LOCKED IN!🤯 AM IN TROUBLE!? My estimates are in deep trouble I'M SCARED!🫣 #dataBS

At scale, a non-deterministic system (Agents of Agents) accumulates uncertainties until failure is inevitable. The true cost isn’t just downtime—it’s human productivity spent wrestling with the chaos. [like code debugging]

Last week's read 📖 Streaming goodness all the way. My idea on the topic is streaming ≈ Kafka I see a lot of seminal choices made in Kafka that set a pretty good standards for streaming. Log based message broker solves serializability concerns a lot #dataBS #dataengineering

This is how @duckdb.org wins!❤️

Tiny TIL: I just figured out how to run pytest with a different Python version against my pyproject.toml/setup.py projects using uv run uv run --python 3.12 --with '.[test]' pytest til.simonwillison.net/pytest/pytes...

Today’s read📖 Completed Batch Processing/MapReduce(MR) chapter Eventhough I was familiar with the topic the historical context helped me understand the design decisions went into it #dataBS #dataengineering

#datasky and #rstats: Can anybody suggest good datasets (or databases where datasets exist) that are interesting, timeless and not too geographically specific? They'll also need to be licensed so they can be used commercially (such as a creative commons license). ...

Today's read!📖 Continuing warm hugs from the old friend. We talked all the things MapReduce has been over the years I said "you dealt with a lot of complicated given to you and processed them separately. But you dumped a lot of it while going through it" So, we good 👍 #dataBS #dataengineering

People say we don't need data engineers are the people that do this kind of hacky shit and call it AI🤦

Power nap >>>>>> AI I was stuck with a problem throughout last week. Tried lots of things and got fed up with myself after trying Claude + other AI tools I was not getting the problem statement right and it was a simple one #dataBS

New chapter day📖 Batch processing and MapReduce!? Hello old friends 👋 #dataBS #dataengineering

ai agents are still software

Evening walks ❤️

I have always wondered, Does technology, especially computers; solved problems for good? I mean when we introduce a solution to a problem with tech and computers, was there any chance that those are considered as standards and we don't really mess with them anymore?