I'd like to share DSO, a command line helper to build reproducible data science projects with ease. It is an opinionated way to organize data science projects, built around data version control (DVC). github.com/Boehringer-I... - ThreadSky

About ThreadSky

grst.bsky.social • 22 days ago

I'd like to share DSO, a command line helper to build reproducible data science projects with ease.

It is an opinionated way to organize data science projects, built around data version control (DVC).

https://github.com/Boehringer-Ingelheim/dso/

Comments

grst.bsky.social•22 days ago

It brings together the best tools:
- git, for code versioning
- dvc, for data versioning and tracking inputs and outputs
- jinja2, for templates
- uv, for Python dep mgmt
- quarto, for authoring reports
- hiyapyco, for hierarchical YAML config
- pre-commit, for linting

grst.bsky.social•22 days ago

One of my favorite features: automated watermarking of all plots in a quarto report. Nobody gonna publish my plots anymore before I think they are ready.

grst.bsky.social•22 days ago

We built this at @boehringerglobal.bsky.social to meet the quality standards required for biomarker analysis in clinical trials.

But I think this is useful for any kind of data analysis project.

grst.bsky.social•22 days ago

If you want to learn more, I'll be presenting this at a @nf-co.re bytesize talk: https://nf-co.re/events/2025/bytesize_dso

grst.bsky.social•22 days ago

Finally, many thanks to my colleagues @alexpeltzer.bsky.social, Daniel Schreyer and Tom Schwarzl for testing, adopting, and contributing to DSO.

methylrot.bsky.social•22 days ago

IIRC dvc keeps a copy of your datasets every time you make changes, has storage space been an issue while changing big datasets a lot?

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply