Pro@programming.devM to

Technology@programming.devEnglish · 8 days ago

Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

cross-posted to:
technology@lemmy.world

705

Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

Pro@programming.devM to

Technology@programming.devEnglish · 8 days ago

cross-posted to:
technology@lemmy.world

Comments

Lemmy;
Hackernews.

Chat

Kissaki@feddit.org
link
fedilink
English
arrow-up
9·
8 days ago
Cloudflare had a similar idea: Introducing pay per crawl: Enabling content owners to charge AI crawlers for access

Technology@programming.dev

Technology@programming.dev

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Technology@programming.dev

Share interesting Technology news and links.

Rules:

No paywalled sites at all.
News articles has to be recent, not older than 2 weeks (14 days).
No videos.
Post only direct links.

To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:

Al Jazeera;
NBC;
CNBC;
Substack;
Tom’s Hardware;
ZDNet;
TechSpot;
Ars Technica;
Vox Media outlets, with exception for Axios;
Engadget;
TechCrunch;
Gizmodo;
Futurism;
PCWorld;
ComputerWorld;
Mashable;
Hackaday;
WCCFTECH;
Neowin.

More sites will be added to the blacklist as needed.

Encouraged:

Archive links in the body of the post.
Linking to the direct source, instead of linking to an article talking about the source.

Misc:

Relevant Communities:

Beehaw Technology- Technology Related Discussions.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

643 users / day
2.1K users / week
4.25K users / month
6.24K users / 6 months
1 local subscriber
439 subscribers
1.32K Posts
2.8K Comments
Modlog

mods:
Pro@programming.dev