good example of the scraper bots hitting the forum today. you can see the massive range of IP addresses they use and how they just scrape shit in order with no care about anything - ThreadSky

About ThreadSky

xkeeper.net • 8 days ago

good example of the scraper bots hitting the forum today. you can see the massive range of IP addresses they use and how they just scrape shit in order with no care about anything

Comments

xkeeper.net•8 days ago

and so it continues. frustrating. you can also see the random user agents they use, among other things.

ncoughlin.com•8 days ago

I get it, but also there are so many good uses for scrapers. I feel like any online anything that people would want to scrape should just expose an API.
Why fight when we can be friends.

xkeeper.net•8 days ago

you can scrape data but be honest and considerate about it. this is neither

pileofgarbage.net•8 days ago

did you see my skeet re CF? they have a feature now to fuck up AI crawler bots. https://bsky.app/profile/pileofgarbage.net/post/3lkwwxfzekk2t

xkeeper.net•8 days ago

i don't use cloudflare, have never used it, and don't really want to start (esp if anything i'd need requires payment), but i am increasingly aware that i might have to just give in and say "fuck it", because it is a losing battle

pileofgarbage.net•8 days ago

yeah it is fucked like that. sorry.

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply