I use YAML mostly at work for some internal projects and some for personal dbt-based transformations. I aim to reduce duplication by reusing the definitions & automating the YAML generation where possible. Started experimenting with PKL (https://github.com/apple/pkl) and CUE (https://cuelang.org/)
TIL about both CUE & PKL ty. I sometimes wonder too if we've strayed too far from simply embedding Python et. al DSLs in data tooling, esp now that we have better typechecking solutions. A decent amount of infra tooling is swinging back in that direction, away from declarative config, for example.
Yeah that's correct. I tested Starlark (https://github.com/bazelbuild/starlark) the other day and thought I could use Python instead. I'm mostly interested in the IDE integrations (VSCode + Intellij) but TBH Python has first-class support in both IDEs and it's hard to beat.
When I hand-write too much duplicated YAML, I feel like I'm too smart for the task but then after trying out these fancy config languages I feel like I'm too dumb to use them. 🫠
Comments