dagster.io - Profile | ThreadSky | a Reddit-style client for Bluesky

Joe Naso and I just published an e-book covering the essential topics needed to build a data platform! Check it out if you're looking to learn more about data modeling, ingestion patterns, and common data architectures. dagster.io/how-to-build...

submitted 1 day ago • 0 comments

📚 NEW EBOOK: Data Platform Fundamentals While every organization's technical stack may differ, the underlying patterns and principles for success remain consistent. Download the ebook today! dagster.io/how-to-build...

submitted 1 day ago • 0 comments

🔍 NEW BLOG: From Prototype to Production - Building AI Products That Scale with Dagster The AI revolution isn't just about models—it's about engineering practices that make AI reliable in production. Read the full post on building AI applications that scale today! https://buff.ly/3QwvtcL

submitted 1 day ago • 0 comments

Our Chief Dashboard Dashboard officer goes into the unkept promise of the modern data stack and how we are addressing these issues and making it easier than ever to build and manage a data platform where you aren't drowning in reactive work. https://buff.ly/3Ezuo1m

submitted 12 days ago • 0 comments

Community Spotlight! 🌟 Jurgita Motus shares a practical guide on combining these tools, complete with code examples and real implementation insights from their experience. See how they orchestrate quality checks at scale. https://buff.ly/4aS5Kow

submitted 15 days ago • 0 comments

Tomorrow's the day! Don't miss our in-depth AI Development Deep Dive happening February 11 at 9 a.m. PT with the Not Diamond Team. If you're looking to optimize your AI costs while boosting accuracy, this is your chance to learn directly from the experts. https://buff.ly/3EjhlAK

submitted 16 days ago • 0 comments

We're proud to announce that Dagster has achieved Snowflake Ready Technology Partner status, validating our integration through comprehensive third-party testing. This certification demonstrates our commitment to delivering enterprise-grade performance, reliability, and security.

submitted 22 days ago • 1 comment

Are you ready to get into the weeds on AI development best practices to reduce costs and improve accuracy? Join us on a Deep Dive on February 11 at 9 a.m. PT with the Not Diamond Team. https://buff.ly/3EjhlAK

submitted 23 days ago • 0 comments

The new Dagster docs experience is here, complete with dark mode! This makes it easier than ever to get started with Dagster. Our focus was on creating a more user-friendly docs structure to ensure that all of the information you need is available within just a few clicks https://buff.ly/4awa90j

submitted 33 days ago • 0 comments

Watch our Developer Advocate, Alex Noonan, build a RAG system from scratch using Dagster. Our abstractions handle the complex parts of working with LLMs, so you can focus on building production-grade applications that deliver real value. https://buff.ly/3DZNu0i

submitted 36 days ago • 0 comments

In case you missed our deep dive into "Shifting Left and Moving Forward with MotherDuck," the recording is now live on YouTube! https://buff.ly/4hfq5Gd

submitted 41 days ago • 0 comments

Join us tomorrow where @alexnoonan.bsky.social, @matsonj.com, and @colton.boo will discuss: 🦆 Building an end-to-end data platform ingesting Bluesky data into MotherDuck, and PowerBI 👈 Shifting Left in Data Engineering 🧠 And AI-powered Data Engineering best practices lp.dagster.io/deep-dive-sh...

submitted 43 days ago • 1 comment

Community Spotlight! Georg Heiler shared a powerful template that brings together some of the best open-source tools in data engineering: DuckDB, Dagster, dbt, and Rust-based tooling for ensuring code quality and Pixi for dependency management. https://buff.ly/4feldk6

submitted 49 days ago • 1 comment

Did you know Dagster asset checks can directly access data from an asset using the built-in I/O manager. Here's a quick snippet showing how it's done!

submitted 50 days ago • 0 comments

Houston Data Practitioners Meetup on December 20th! Join us from 8:30 to 9:30 AM at The Ion, where we'll be diving into all things data engineering. https://buff.ly/3P1WsMD

submitted 69 days ago • 0 comments

Check out this guide from Gianfranco Demarco on setting up interactive debugging with Dagster in Docker! - Debug your assets directly in containerized environments - Bridge the gap between development and deployment - Step through both your code AND Dagster's internals https://buff.ly/4g3rjnU

submitted 76 days ago • 0 comments

🚀 Ready to transform your data team from firefighters to innovators? Join us on December 19th with Edson Nogueria, who will reveal how Artefact built a modern, proactive data platform using Dagster, dbt, and dlt. https://buff.ly/4guDdao.

submitted 76 days ago • 0 comments

Integrations with Looker, Power BI, Tableau, and Sigma are now live! With Dagster, you can have full end-to-end lineage and control of your data platform. Broken dashboards and stale data are a major pain point for data teams and a source of reactive work. https://buff.ly/4fwEEo3

submitted 76 days ago • 0 comments

Community Spotlight! Edson Noreiga shares a practical solution for managing concurrency limits at the asset level in Dagster, addressing a common challenge data engineers face. Read the full post here! https://buff.ly/3CTE3Pe

submitted 77 days ago • 0 comments

Data Engineering doesn't have to be a drag Join us at AWS re:Invent to discover how Dagster is revolutionizing data engineering. Stop wrestling with complex pipelines and start building robust, scalable data platforms.

submitted 97 days ago • 0 comments

Enchanted to share how Servco revolutionized its data infrastructure. The team, led by Tausif Islam and Sam Ikemoto, tackled a common enterprise challenge: moving from siloed, on-premise systems to a modern cloud-native platform. https://buff.ly/3OecYst

submitted 99 days ago • 0 comments

Data Platform Week starts today! Tune in to learn more about what we believe is important in building data platforms, and how new Dagster features support it!

submitted 100 days ago • 1 comment

To foster growth and collaboration within the Dagster ecosystem, we created a specialized repository for users to share their custom integrations without managing their packages' build or release process. We currently have packages for Hex, Hightouch, Modal, and Not-Diamond in this repository.

submitted 104 days ago • 1 comment

Dagster commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying Dagster+ Pro. Read the full report here https://buff.ly/3O7bf8d

submitted 105 days ago • 0 comments

Dagster 1.9 Spooky is out! This was a big, maybe even monstrous, release. Read the full release here: https://buff.ly/4fwEEo3

submitted 113 days ago • 1 comment

If you missed the Deep Dive on AI Agents with Olivier Dupuis, the recording is now on YouTube! This project is a great use case for those interested in leveraging AI agents in Dagster. Olivier discusses how to leverage AI agents for research aggregation and processing.

submitted 114 days ago • 0 comments