

This has always been a huge red herring. Llms are built on top of the transformer architecture which does text autocomplete (and yes we can combine text embeddings with other inputs like images). They have some interesting properties where they seem to be able to do text autocomplete in a bunch of different scenarios that they werenāt explicitly trained for, but they were never designed for precise dna analysis. It is their architecture that prevents them from other long horizon tasks like playing chess and the way that they represent text is why they can never count the letters in strawberry (most have this specific question hard-coded in their training data now).
Anyone who believes that LLMs are going to solve cancer either has no idea how they work or has been one-shotted from talking to Claudia


Oh⦠Well thatās disappointing.
I was an academic in computer science in the last 10 years or so (keeping it vague to avoid doxxing myself) and it has been so depressing seeing so many of my colleagues selling out to OpenAI, Anthropic, Meta and even Google (for some reason the latter often gets a reputational free pass because people associate them with the golden days of big tech 10+ years ago)