0
Do anti-bot checks feel excessive to anyone else?
I’m getting really tired of “verify you’re not a bot” checks everywhere.
I understand these checks help prevent bots, but they seem to appear on so many websites now. Does anyone else find them frustrating?
Comments
Captchas suck. Don’t trust reCaptcha, and avoid Cloudflare captchas.
That said, Techaro’s Anubis is a good thing.
why is it a good thing ?
Techaro’s Anubis is software that challenges bots without prompting the user directly. Unlike reCaptcha, it’s not a tracking utility that collects data or trains LLMs. It’s just a computational burden to make bot scraping less economical, according to the burden on the website. This protects the website from excessive traffic while still serving users without pestering or tracking them.
Thanks for asking!
No, but only because I’ve helped run a website recently and you underestimate just how much wasted traffic is from scrapper bots. On our limited bandwidth, it was practically a DDOS attack all the time.
My Lemmy bot-check comes with a picture of a sexy cat girl. It’s brief, but it’s there.
That’s Techaro’s Anubis. It inconveniences crawlers notably without demanding input from the user.
They should just use Anubis. At least we then see cute anime characters while the bot check runs.
I’m even more annoyed by anubis. Letting me wait in the browser for an enternity for some check that a bot with a native implementation can solve in milliseconds.
Proof of work my ass.
It sure can, instead of doing 50 requests. A slowdown is all that’s needed to make random scraping uneconomical.
https://github.com/mikenrafter/anubis-fast.mirror
This is a sample of a much faster anubis solver (end user facing).
There’s versions. of this for people running bot networks - it’s just a few cheap cloud cpu cycles to invest. Proof of work is an ineffective defense against spam in the age of cheap and scalable cloud compute - and even moreso if the botnet runs on residential proxies.
My point is, the slowdown is NOT making random scraping uneconomical anymore, it does hurt legitimate users a lot more.
From what we are seeing, it’s currently helping on our instances. I see the argument that it might stop working someday, but for now it’s significantly cut down on bad traffic. The bots tend to buzz off and bother someone else
I’m going to go ballistic if I have to pick out all the pictures of fucking crosswalks one more time.
You’re labeling data for Google… for free. It’s not about ‘stopping’ bots, but about swindling free labour from the working-class.
Other systems for deterring bots don’t force you to menially label data for a for-profit corporation worth billions/trillions. An example of one that is automatic and open-source is anubis.
Yeah, reCaptcha is bad. But Techaro’s Anubis is a good thing.
Seems like a complaint a bot would have.
Fuck, so now anyone who’s different is a bot or AI? Seriously, if I were a robot, why would I write a post complaining about websites? If I were AI, I’d have better things to do.
That’s exactly what an AI would say to try to look like a person.
Dude, you’re watching too many science fiction movies. Even though artificial intelligence might be quite advanced these days, if I were a robot I wouldn’t waste my time talking to humans. I’d think of something worse: ending the lives of these poor, brainless mortals. You’re crazy, man :-P
That’s exactly what a robot would say to look like a human.
Fuck you 😾
As others have said, they are absolutely necessary in this day and age.
But also the bots are not deliberately targetting lemmy, it’s just that lemmy has unlimited pages to scrape and so the traffic piles up. If your issue is specifically with Lemmy then using an app should help. Many instances also give logged in users a free pass.
I could use an app, but since I don’t know English, I need to use a translator to understand what people are writing.
Ah well I’d suggest for Lemmy make sure you’re logged in. Many instances will bypass checks if the right cookie is set. Not always the case, as each instance would need to implement the bypass themselves. I’m not sure if Lemmy.world has done this.
On browser at least, lemmy.world – OP’s instance and my own – only requires a bot check if you’re not logged in, even if you’re behind a VPN (I am). I never see a bot check unless I am going in via a different browser or device where I am not logged in.
Cool, thanks for confirming.
Bot checks will only be for the website in a browser. Apps connect to the API, and you can’t really put a visible check in a silent background request.
The fediverse also is built on computers talking to each other, things like cloudflares bot blocking will sometimes kill federation because ultimately it’s bots talking to bots. But it would make no sense to connect to the API for scraping, if you are specifically targeting lemmy by calling its API, then you might as well just make your own instance, and then all the other instances will freely send you everything.
Sign in to comment. Sign in