Pro@programming.devM to Technology@programming.devEnglish · edit-28 days agoCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comimagemessage-square114linkfedilinkarrow-up1707arrow-down12file-textcross-posted to: technology@lemmy.world
arrow-up1705arrow-down1imageCodeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.i.imgur.comPro@programming.devM to Technology@programming.devEnglish · edit-28 days agomessage-square114linkfedilinkfile-textcross-posted to: technology@lemmy.world
minus-squareIndescribablySad@threads.net@sh.itjust.workslinkfedilinkEnglisharrow-up6·edit-29 days agoSeems like an api request would be preferable for the site you’re checking. I don’t imagine they’re unhappy with the traffic if they haven’t blocked it yet
minus-squareJPAKx4@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2·9 days agoI mean if it’s cms site there may not be an api, this would be the only solution in that case
Seems like an api request would be preferable for the site you’re checking. I don’t imagine they’re unhappy with the traffic if they haven’t blocked it yet
I mean if it’s cms site there may not be an api, this would be the only solution in that case