I figured out how to use @tailscale.com and an Apple TV to run a GitHub Actions scraper that routes traffic through my home network - TIL here: til.simonwillison.net/tailscale/ta... - ThreadSky

About ThreadSky

simonwillison.net • 15 hours ago

I figured out how to use @tailscale.com and an Apple TV to run a GitHub Actions scraper that routes traffic through my home network - TIL here: https://til.simonwillison.net/tailscale/tailscale-github-actions

Comments

simonwillison.net•15 hours ago

I'm scraping https://doge.gov - they're all about "transparency" so it was a little annoying that Cloudflare was blocking my scraper when it ran unassisted on GitHub Actions

Here's my git scraping repo: https://github.com/simonw/scrape-doge-gov

hugowett.bsky.social•10 hours ago

Nice! You noted in a comment that the Tailscale setup took 2 minutes. Is that normal @apenwarr.ca ? In Lambda-style setups that’s amortised across invokes, but it would be kind of expensive (dev waiting time) for GH builds that may take about 2 min themselves.

apenwarr.ca•4 hours ago

People often say things like “I set up Tailscale for the first time in only five minutes!” which includes learning time as well as node registration time. The latter on its on is usually in the hundreds of milliseconds or less :)

hugowett.bsky.social•3 hours ago

Doesn’t look like that kind of colloquialism. Maybe something uncached in the action on first run?

simonwillison.net•3 hours ago

Yeah that step of the workflow always seems to take around two minutes - which is suspicious because there's a 2m timeout in there

Here's the YAML for that step: https://github.com/simonw/scrape-doge-gov/blob/239805970ea155976b111b1d1671c5f64c9d8a84/.github/workflows/scrape.yml#L33-L39

simonwillison.net•2 hours ago

Filed an issue here: https://github.com/tailscale/github-action/issues/159

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply