Profile avatar
jankaul.bsky.social
71 posts 63 followers 82 following
Getting Started
Active Commenter

So #databs, who wants to try S3Tables? I've created a Datafusion distribution with support for S3Tables that you can run from the command line. This is all you need: frostbow -u arn:aws:s3tables:us-east-1:123456789:bucket/my-bucket-prefix Check it out the example: github.com/JanKaul/fros...

Does anybody have an idea how S3 Tables can achieve 3x performance compared to regular Iceberg tables on S3? Does it work similar to the object-store file layout? iceberg.apache.org/docs/latest/... #databs

Join me tomorrow for my talk: "Dashtool - A data build tool to use Iceberg Materialized Views for data transformations" as part of the Open Source Analytics Community Series. December 3rd, 15:00 UTC us02web.zoom.us/w/8299438519... Passcode: 299889

This has been a long time coming. After the concerted efforts many engineers from across companies and across continents, posted some great benchmark results datafusion.apache.org/blog/2024/11...

There is a discussion on the Top 2025 Data Trends with Matt Housley today. Could be interesting. #databs www.linkedin.com/events/top20...

I recently gave a talk about Iceberg Materialized Views at Chill Data Summit London. I think Iceberg Materialized Views can really revolutionize the way we approach data transformations. Watch the recording here: youtu.be/bDxUeReHyHQ?...