Y'ALL, my brother made something neat. He's not on here so I'll post for him, but would you like to waste ai data scrapers by getting them stuck in a virtual tarpit? Now you can! :D zadzmo.org/code/nepenth... - ThreadSky

newbabyfly.schism.org • 43 days ago

Y'ALL, my brother made something neat. He's not on here so I'll post for him, but would you like to waste ai data scrapers by getting them stuck in a virtual tarpit? Now you can! :D

https://zadzmo.org/code/nepenthes/

Comments

newbabyfly.schism.org•43 days ago

If you wanna see some stats on the prod server he's been running for a while, he's posted them here!

https://chirp.zadzmo.org/@aaron/statuses/01JG21WSXRHN1RWF0AN58AESCK

newbabyfly.schism.org•43 days ago

And I guess I should add- my brother is a senior programmer/SysAdmin, if you're looking at the links with a sus face, it's because he's the type that trusts no social media except that mastodon instance that he created for himself hahaha.

egguv.bsky.social•43 days ago

📌

kden.cloud•43 days ago

📌

iceofspades.bsky.social•43 days ago

Cyberpunk 2077 essentially having an "Internet 2" protected by the Blackwall is making more and more sense every day.

gingercruiser.bsky.social•43 days ago

Fun

cytricacid.art•43 days ago

web crawlers are not just for AI, but google/search engines as well. you could maybe give it a robots.txt to avoid breaking good faith (aka robots.txt respecting bots) indexers and other bots, while trapping any bots that would ignore a noAI or robots.txt file

newbabyfly.schism.org•43 days ago

He acknowledges this in the notes, and also that Google is actually pretty good about getting out of the tarpit. This is just the first build he's releasing for public use in any case, still has a lot of plans for it!

cytricacid.art•43 days ago

i see! i didnt see that on first look

newbabyfly.schism.org•43 days ago

He told me the ultimate plan is to have it be a defense line against ai scrapers, but for now it's mainly to feed their datasets garbage until he can add more functionality! :D

cytricacid.art•43 days ago

you might be able to see which bots get trapped in that loop and generate a block based on that as well
i would avoid deploying this on any site you want indexed by a search engine though

cytricacid.art•43 days ago

(unless you set up the robots.txt for this but i digress)

Comments

Posting Rules

Reply