• 1 Post
  • 2.82K Comments
Joined 2 years ago
cake
Cake day: April 6th, 2024

help-circle










  • I appreciate the emphasis on conviviality or human centric design. But boy I want to nitpick on the following:

    when we collaborate with AI systems, we might be interfacing with the archetypal patterns that have guided human wisdom throughout history. This makes programming with AI a form of accessing collective spiritual wisdom rather than just advanced tooling.

    I agree with the first half, that yes, you are engaging with archetypal patterns that is often present in human wisdom but that is where it stops. There is no guarantee the LLM has selected the appropriate pattern for your use case. There is no wisdom from the LLM because there is no conviction from its choices. The LLM, at best, is a superstitious machine that sees that X pattern worked in a situation with similar signifiers. Wisdom is understanding which signifiers are of consequence given your context, which requires being able to ignore/forget irrelevant context - something an LLM is terrible at doing as evident by all the “context engineering” tools that exist. It feels like a chicken and egg problem where in order for the LLM to “get right” what is the appropriate context it must first have the appropriate context.