I like this simple little pattern for exporting incremental data to our data warehouse. Simple exported_at date compared to updated_at with a --force flag on the job in case we need to ever export the whole file. Now it can just run ever (x).
Comments
Log in with your Bluesky account to leave a comment
Comments