Ok if you want to focus on that single phrase and ignore the whole rest of the page which documents decades of stuff to do with search engines and not a single mention of api endpoints, that’s fine. You can have the win on this, here’s a gold star.

Or, like maybe, prison.

It’s been a consensus for decades

Let’s see about that.

Wikipedia lists http://www.robotstxt.org/ as the official homepage of robots.txt and the “Robots Exclusion Protocol”. In the FAQ at http://www.robotstxt.org/faq.html the first entry is “What is a WWW robot?” http://www.robotstxt.org/faq/what.html. It says:

A robot is a program that automatically traverses the Web’s hypertext structure by retrieving a document, and recursively retrieving all documents that are referenced.

That’s not FediDB. That’s not even nodeinfo.

Maybe the definition of the term “crawler” has changed but crawling used to mean downloading a web page, parsing the links and then downloading all those links, parsing those pages, etc etc until the whole site has been downloaded. If there were links going to other sites found in that corpus then the same process repeats for those. Obviously this could cause heavy load, hence robots.txt.

Fedidb isn’t doing anything like that so I’m a bit bemused by this whole thing.

lol FediDB isn’t a crawler, though. It makes API calls.

wow his ears are on crooked

Nice channel, I’ve just added it to https://piefed.social/topic/wholesome to help people find it.

deleted by creator

Naaah, difference between list and dict is fundamental. If you don’t know that then you’ve never coded Python at a professional level. It’s an ok interview question although it would only weed out the most nooby juniors so not really that good depending on what they’re hiring for.

It’s a bug, yep! Will look into it.

Theoretically in the future PieFed might not be limited to only using ActivityPub, or only using Lemmy-compatible ActivityPub.

I hope you feel better soon.

Yes this is a good minimum. We need our instance-chooser guides/websites to surface this information so people can make choices about which instances they join.

Currently if you go to https://joinmastodon.org/servers or https://join-lemmy.org/instances there is no way to filter for VPN compatibility, allowing disposable email, logging policy or legal jurisdiction (in the case of join-lemmy). Or political alignment, defederation policy…

too destructive for compatibility with other ActivityPub software

Yes, but that’s Ok, not every community needs to federate outside PieFed. There can be a mix of insecure (widely-compatible) and secure (PieFed only) communities. PieFed does not be need to be held back by the limitations of ActivityPub as we know it today.

There is more than one alternative and some of them involve having capitalism…

Welcome to PieFed 😊

Probably shoulda done Luigi

edit: skip to 13:00 to see Luigi!

…if you use R2 to store your images.

It is pretty great. We use it throughout PieFed if you’re interested in a working example.

https://www.readersdigest.co.nz/travel/italian-village-offers-1-homes-to-americans-upset-by-us-election-results