https://pubmed.ncbi.nlm.nih.gov/download/#api so it looks like pubmed has a couple different ways to stream the data, probably worth seeing if anyone trustworthy has been using the FTP daily updates to keep a backlog
otherwise there's the API which seems to use some proprietary tooling but nothing too wild
Someone found a batch downloader script for pubmed on github, so this is certainly doable.
There's also https://scholar.archive.org. The good news is the scholar archive already has most of everything backed up. The bad news is it definitely doesn't have everything.
That is good to hear! If you need any computery things, let me know any time. I owe it to you; your writing has been indispensable in discovering my identity ♥
Aww, thank you for the offer! But seriously, it was a gift to write it all, and I mean that--I neither need nor want any payback, other than trans folks helping each other in that respect. 💜🏳️⚧️💜
Comments
otherwise there's the API which seems to use some proprietary tooling but nothing too wild
There's also https://scholar.archive.org. The good news is the scholar archive already has most of everything backed up. The bad news is it definitely doesn't have everything.