Is there a good way to add a test execution timeout for each test in Minitest? Or should I just override `#run`? - ThreadSky

marcoroth.dev • 16 days ago

Is there a good way to add a test execution timeout for each test in Minitest?

Or should I just override `#run`?

Comments

The gem minitest-speed “adds test hooks to verify the time it takes to run the setup, body, and teardown phases of each test. If the time of any phase goes over the maximum time, it fails the test.“ Sounds like what you’re looking for?

marcoroth.dev•16 days ago

Oh interesting, thanks! I'll check that out then 🙏

marcoroth.dev•15 days ago

Sadly, this assumes the test to actually finish. So if the test never finishes it doesn't do the speed-related assertions.

I also need it to work for the cases where the test is currently running in a C-extension. So even if it did a timeout on the Ruby side it's not actually enforcing the timeout.

marcoroth.dev•15 days ago

I'm wondering if there's a way to kill the whole process instead.

I have a version working that forks the process for each test, so you can independently kill them, but seems a bit too extreme and overkill.

marcoroth.dev•15 days ago

It's also a bunch of unnecessary overhead for the unlikely case that one of the tests could get stuck. Kinda tricky 😅

rorvswild.com•15 days ago

I made this https://github.com/alexisbernard/top_tests a long time ago. It breaks when a test is taking too long. But it does not interrupt the test if this is what you mean by timeout.

marcoroth.dev•15 days ago

Intresting, thanks! Yeah, I'm mostly looking for a way that interups/fail the test if the test is taking longer than the specified timeout.

2-45.pm•16 days ago

I know that it’s not an answer, but “Minitest with timeouts” sounds a lot like TLDR: https://github.com/tendersearls/tldr. It could maybe be a source of inspiration?

marcoroth.dev•16 days ago

That's a good thought! I might actually be able to just swap out Minitest for TLDR 😅

Currently the tests suite runs in 0.008s so there shouldn't be an issue 🙈

Comments

Posting Rules

Reply