datateam.bsky.social - Profile | ThreadSky | a Reddit-style client for Bluesky

data doesn't lie, politicians do

submitted 20 hours ago • 2 comments

Data teams don’t move fast. They wait. They wait for dbt runs. They wait for queries. They wait to see if something breaks. Stop testing in production. Start testing like an engineer. 🔗 dlthub.com/blog/staging #databs #dataengineering

submitted 20 hours ago • 0 comments

Stop waiting on your warehouse. dlt+ Cache lets you run dbt models, test data, and debug transformations instantly—with DuckDB, Iceberg, Snowflake, BigQuery, ClickHouse & more. Fast. Composable. No waste. 🔗 dlthub.com/blog/cache

submitted 1 day ago • 0 comments

Is your job going to be replaced by AI? Probably. But just as we’ve moved on from writing assembly code, our roles are evolving rather than vanishing. Embrace change, hone your expertise, and be proactive about learning. As the saying goes, "when the student is ready, a teacher will appear."

submitted 2 days ago • 0 comments

New in early access: dlt+ Project & Cache! ⚡ Test transformations locally before loading 💰 Reduce cloud costs, iterate faster 💡 Define & manage pipelines in YAML Try it out! 🔗 dlthub.com/blog/dltplus... #DataEngineering #databs

submitted 5 days ago • 0 comments

check it out!

submitted 6 days ago • 0 comments

🚀 Live Event w MotherDuck & dltHub: Fast & Scalable Analytics Pipelines 📅 Feb 26 | 17:00 CET | Zoom 🔹 Easy data ingestion 🔹 Custom ETL pipelines in Python 🔹 Smooth transition from DuckDB to MotherDuck 🔥 Live demo + Q&A! 🔗 Register: lu.ma/79a7lysr?utm... #databs

submitted 12 days ago • 0 comments

Testing in production isn’t a rite of passage, it’s a failure of process. 💰 Every test query = vendor profit 🚨 Every mistake = production issue 😩 Every debug run = rerunning the entire pipeline Staging for data is here dlthub.com/blog/staging #dataengineering #databs

submitted 15 days ago • 0 comments

Debezium + CDC + Python + dlt → Real-time PostgreSQL replication, no Kafka. 🔥 New blog by OSS contributor Ismail Simsek → A Python-native CDC pipeline for PostgreSQL & DuckDB. ✅ No Kafka ✅ Python-first ✅ Step-by-step guide Read it now → dlthub.com/blog/debeziu... #dataengineering

submitted 16 days ago • 0 comments

Breaking into data engineering? Join our Data Talks Club Data Engineering Zoom camp workshop and learn how to load data like a pro lu.ma/quyfn4q8

submitted 17 days ago • 0 comments

Writing Iceberg or Delta on filesystem/buckets? dlt supports both: dlthub.com/docs/dlt-eco... And if you wanna Bring Your Own Compute Engine, dlt supports that too (via ibis) dlthub.com/blog/datasets #databs #dataengineering #datasky

submitted 22 days ago • 1 comment

🔥 The biggest lie in data engineering? "This tool will make your life easier." Commoditized tools are built for selling, not engineers. They hide complexity & costs, locking you in. The alternative? Democratization, flexibility, and control. read more: dlthub.com/blog/goodbye... #databs

submitted 27 days ago • 0 comments

𝐇𝐨𝐰 𝐝𝐨 𝐲𝐨𝐮 𝐫𝐮𝐧 𝐝𝐥𝐭 𝐨𝐧 𝐀𝐖𝐒 𝐥𝐚𝐦𝐛𝐝𝐚? (tldr - 100x cheaper than Saas) Here are code templates: Github: github.com/codingcyclis... Blog: dlthub.com/blog/dlt-aws... We use GCP ourselves: dlthub.com/blog/dlt-seg... #databs

submitted 34 days ago • 0 comments

2x your data ingestion pipeline development speed with Cursor AI. Mooncoon 🦝, a consulting partner at dltHub, shares a step by step tutorial how to do it. See the guide + git repo here: dlthub.com/blog/mooncoon

submitted 35 days ago • 0 comments

✨ OSS Enterprise success story time! Stellantis (14 car brands including Jeep & Maserati) is using @dlt to: - Cut 60+ data tools down to 4 - Speed up pipelines by 66% - Onboard devs in 2hrs Open source eating enterprise, one pipeline at a time 🚀 Check it out here! www.youtube.com/watch?v=Kj3E...

submitted 35 days ago • 0 comments

Tired of juggling tools & formats to access data? With dlt’s universal interface, you can: 🔄 Switch between local & cloud with ease ⚡ Test data w/o touching prod 🚀 Build portable, scalable pipelines dlthub.com/blog/datasets #databs

submitted 36 days ago • 0 comments

Fed up with scaling struggles & custom API chaos? 😤 Meet the DLT REST API Source: ⚙️ Python-native configs 🧠 Auto schema detection 💼 Multi-source compatibility From POS systems to HR analytics, simplify pipelines. Watch Willi’s demo here: www.youtube.com/watch?v=9hZL...

submitted 37 days ago • 0 comments

Data platforms deserve SDLC best practices 🚀 ✅ Feature branches ✅ CI checks for every PR ✅ Seamless CD to prod ✅ Full lineage in Dagster UI Built w/: 🔧 dltHub - ELT made simple 💡 dbt - Transformations redefined ⚙️ Dagster - Asset-based orchestration from community: medium.com/@jairus-m/th...

submitted 48 days ago • 0 comments

Working with spatial data in PostgreSQL? 🌍 dlthub + PostGIS makes it simple: ✅ Load WKT or WKB formats ✅ Handle SRIDs (default 4326) ✅ Spatial queries made easy Just CREATE EXTENSION postgis; & go! 🚀 Geometry, simplified. What’s your next spatial project? #GIS dlthub.com/docs/dlt-eco...

submitted 48 days ago • 0 comments

Are you back from vacation? I'm sorry, me too. Now, where did we leave off? Oh yes, a tribute to our community! Check out this comprehensive list of demos and write ups done by our community last year! dlthub.com/blog/2024-re...

submitted 51 days ago • 0 comments

nice writeup on dlt +dagster medium.com/@veligokayso...

submitted 51 days ago • 0 comments

I've had a crazy few days with my advent calendar of code, looking at Tobiko's SQLMesh with @duckdb.org. Yesterday, I mentioned in my post that I needed to bring in some data from @bsky.app's HTTP endpoints, and I was going to try using dltHub. davidsj.substack.com/p/dlt-windsu...

submitted 84 days ago • 1 comment

You can now query dlt data before loading dlthub.com/docs/general...

submitted 69 days ago • 1 comment

Talk to a github repo, the variant you can just try try here: github-assistant.com 📖 Learn how it works: lnkd.in/es-JQraG Shout out to Relta.dev team for making this demo

submitted 71 days ago • 0 comments

Your data's so dirty, we call the extraction pipeline the "sewage treatment plant". #dataroast

submitted 72 days ago • 0 comments

Forget about manually writing dbt models. Meet dbt-gen: AI-generated models that work like magic (but with real results). Save time, avoid errors, and focus on the data that matters. Curious? 👉 dlthub.com/blog/dbt-gen

submitted 78 days ago • 0 comments

Google announced it's working on making Python faster! jokes aside, check out this progress #databs www.hpcwire.com/2024/12/09/g...

submitted 79 days ago • 1 comment

Docker for data? If you go to a docker conference you will hear "portability" "fast onboarding" "lower cognitive load" "implicit access" "microservices" "decentralisation" Who does this for data? check out these 2 new products in the space: dlthub.com/blog/tower

submitted 79 days ago • 0 comments

Customer support bots: wasting my time with relentless efficiency 👍

submitted 80 days ago • 0 comments

Check out this cool exploration by @jayatillake.bsky.social of dlt+sqlmesh! davidsj.substack.com/p/sqlmesh-in...

submitted 82 days ago • 0 comments

How does a country elect a psychotic fascist president who believes H2O is a conspiracy? 66.000 fake Tik tok accounts and advertising money sponsored by the axis of evil. How did you get yours? Today I'm voting against him. www.euronews.com/my-europe/20...

submitted 82 days ago • 1 comment

Our ELT with DLT workshop is back, as a self paced course! So if you wanna learn some durable knowledge this holiday season, sign up for the course! If you submit homework by 17th Jan, we will grade it and grant certificates. Sign up here! dlthub.com/events #DataEngineering #databs #python #etl

submitted 83 days ago • 0 comments