We're back online. Note: We have been experiencing elevated slamming by AI crawlers and bad bots which is why you may have seen the 429 "Too Many Requests" Error. Working on mitigation. - ThreadSky

itch.io • 59 days ago

We're back online. Note: We have been experiencing elevated slamming by AI crawlers and bad bots which is why you may have seen the 429 "Too Many Requests" Error. Working on mitigation.

Comments

wbhwrites.bsky.social•59 days ago

Ugh. Fuck AI shit. Banish it to the deepest circles of hell.

daiz.moe•57 days ago

Start serving the AI crawlers zip bombs https://idiallo.com/blog/zipbomb-protection

outbackcatgirl.bsky.social•56 days ago

i love this

mayshing.com•56 days ago

wow amazing. man these bots trapping stuff start to sound like dangerous magic. 😆

mayshing.com•57 days ago

of course its gonna be them. cast blackholes.

metrothefox.bsky.social•56 days ago

Thank you for doing your best

muteki-ish.bsky.social•57 days ago

People have probably already said this but I absolutely believe this is worth suing over

loam-d.bsky.social•57 days ago

It's hard to trace it back to an actual entity to sue. It's not just the big guys doing the scraping, a lot of it is from random firms/ass holes that simply ignore robots.txt. There's a whole host of startups and extranational entities doing it now.

cass.redsky.monster•59 days ago

https://anubis.techaro.lol/ Unironically use this, it works so well at stopping this that the UN deployed it. And it has a cute mascot too!

aispacedestructor.bsky.social•59 days ago

Not entirely accurate, as far as I'm aware just one specific sub domain of the UN is using it as @brodierobertson.xyz mentioned on the topic. Probably more a single admin who is fan of it deployed it on the page they are responsible for.

xeiaso.net•59 days ago

More than one subdomain, I found a few more on our podcast recording.

aispacedestructor.bsky.social•59 days ago

Ok but if I'm not mistaken it's still not an UN wide decision to use it.

octal.xyz•59 days ago

pipimioden.bsky.social•59 days ago

how do i put this on my neocities site?

techaro.lol•59 days ago

I don't think we support neocities yet, but do you know how we can reach out to the admins there?

gothfashion.info•57 days ago

I would very much be interested in this for my neocities site too.

pipimioden.bsky.social•58 days ago

there's a contact page on the website that will help i think https://neocities.org/contact

cass.redsky.monster•59 days ago

The docs make it seem pretty easy. been thinking about putting it on my own sites once I have them built up more.

not the dev btw just a fan of screwing AI scrapers whenever possible