loppsean.bsky.social - Profile | ThreadSky | a Reddit-style client for Bluesky

Are people calling the Nvidia cosmos paper the next "attention is all you need" but for physical AI systems?

submitted 51 days ago • 0 comments

tldr www.youtube.com/watch?v=TRCJ... End of year we tend to reflect on "Best of...". I've been thinking of _craft excellence_, eg cases where someone produces a masterpiece, an example of them just being excellent at their craft.

submitted 69 days ago • 1 comment

Day 18, happy holidays friends! youtu.be/GjndggmuhCs

submitted 70 days ago • 0 comments

Day 17! Today's challenge is about conditional branching in data pipelines youtu.be/MgkniMnmhMU

submitted 71 days ago • 0 comments

Day 16! youtu.be/mrlFdKJlosY (sorry for no video on day 15... life ya know)

submitted 71 days ago • 0 comments

Day 14 and mayyybbbbee my favorite day so far. Dynamic code gen and peeling back the onion on ways to combine different Python parallelization "layers" .... what more could you want for a Monday? youtu.be/azfCDBKTIoQ

submitted 74 days ago • 1 comment

Lucky Day 13 - all about incremental data processing youtu.be/_WSOaE5mr4g

submitted 77 days ago • 0 comments

@loppsean.bsky.social's walk through of asset checks in Day 11 is awesome, do check it out! In some cases, you might not want to re-read in the asset data (or you might even want to compare across previous materializations!) In my example, I use Dagster's metadata system to do just that.

submitted 78 days ago • 1 comment

Day 11! The diff between orchestration and data orchestration? Your code can stay the same, still work, but the data can change and break everything! youtu.be/ugS1KQhxWrA

submitted 79 days ago • 0 comments

For day 10 of 30 days of orchestration, one of my fave topics: materializing assets in different environments using resources! In my solution to day 10, I added an environment variable, DAGSTER_PROD_DEPLOY, which determines whether to use the folder `data_prod` or `data_dev` if it is not present.

submitted 79 days ago • 1 comment

Day 10! Data engineers + Pydantic classes = goodness. youtu.be/f_XfLTlHS-s

submitted 80 days ago • 0 comments

Day 9! youtu.be/g4oABNiIOmw

submitted 81 days ago • 0 comments

Daty 8, happy Friday! youtu.be/iroAyNM0kxA

submitted 83 days ago • 0 comments

Day 7! youtu.be/u9V0As2RZ5k

submitted 85 days ago • 0 comments

Day 6! youtu.be/RSUk6DU531w

submitted 86 days ago • 0 comments

Day 5! youtu.be/jNCaAYA-MVU

submitted 87 days ago • 0 comments

Day 4! (Its not too late to catch up!) youtu.be/Jaann2QiGwQ

submitted 88 days ago • 0 comments

Day 3! youtu.be/xUJTal1cq0Y Learn about more complex DAG scheduling, and get a sneak peek of holiday Daggie

submitted 93 days ago • 0 comments

Here is my solution: github.com/cnolanminich... For this one, I wanted to play with the new `target` argument 🤩 For the super common scenario of having one job per schedule, add a "target" argument and select the assets you want -- in my case "asset_one" and everything downstream #dataBS

submitted 94 days ago • 0 comments

Me trying to figure out Power BI pricing To share content and collaborate in Microsoft Fabric, your organization needs to have an F or P capacity, and at least one per-user license.

submitted 94 days ago • 2 comments

Day 2! Its a holiday week, lets talk how you accommodate business schedules with cron youtu.be/Wja1EmyIexE

submitted 94 days ago • 0 comments

I've spent time in all 3 cloud provider consoles, unequivocally Azure is the worst. I don't mean to offend ... If I am.... DM me. Maybe you can show me the ropes? Example: the organization > account > subscription hierarchy, when applied to roles, is insane. I am sudo. Respect my authority!

submitted 94 days ago • 1 comment

Lets GO! Day 1 of 30 days of orchestration youtu.be/RP6B1wXug_0 This will certainly be the most contentious video, because it starts by creating a Python environment (and of course, includes debugging said environment live).

submitted 95 days ago • 2 comments

youtu.be/A3VUD1dRfvA

submitted 98 days ago • 1 comment

There are two types of Git commit messages: 8:00am: ae678pt: "as described in the linked RFC, implementing changes to the partition strategy to reduce hotspots in our cluster index" 4:49pm: stcm98: "f-ing typos, try again. pleeeeease pass"

submitted 99 days ago • 0 comments

ok friends. if you do cron, airflow, dagster... _please_ watch this 5 minute snippet its the crux of everything we at Dagster have been working on for redefining DAG automation, and I think it could save you from a lot of PITA headaches youtu.be/Z77s50b_Sks?...

submitted 99 days ago • 2 comments

Sometimes people want to know what a sales engineer does Its this www.youtube.com/watch?v=hNuu...

submitted 100 days ago • 0 comments

Another DOGE suggestion Require 401k providers to give you the option to initiate a rollover to another firm without talking to their shitty sales team and _faxing_ forms.

submitted 101 days ago • 1 comment

Week of cool @dagster.io releases going on right now! 📆 dagster.io/data-platfor... (this link will have you register, give you a cal invite, and you can watch the videos via a live stream each day) OR ⏩ DM me and I'll send you the youtube videos when they're uploaded later on

submitted 101 days ago • 1 comment

I'm obsessed with everything about this video. If a prospect stops responding to me, I'm just gonna send them this link. youtu.be/Am7kr_lLbsw?...

submitted 101 days ago • 2 comments

The real DOGE would be eliminating SAS and paper submissions ... iykyk (Too soon, serious, or scary to shit post about... perhaps) But really, in the year of our lord 2024, people still can't decide how to validate R (a pharma once told me they mailed in the printed out source code of R core)

submitted 101 days ago • 1 comment