Ah so it’s more or less biased to what acceptable media it can consume and so is likely at best centrist within it’s perspective given they likely blacklist certain sources. So what is stopping Grok from doing the hallucinatory or fabricated responses that were a big issue with other LLMs
I’m just guessing but likely they are training or instructing it in such a way that it will defer to sources that it finds through searching the internet. I guess the first thing it does when you ask a question is it searches the internet for recent news articles and other sources and now you have the context full of “facts” that it will stick to. Other LLMs haven’t really done that by default (although now I think they are doing that more) so they would just give answers purely on their weights which is basically the entire internet compressed down to 150 GB or whatever.
![A story in parts [CW: Islamophobia]](https://hexbear.net/pictrs/image/ad0974a0-cc1a-46be-bd34-1b7e23487318.jpeg){kind=link}
Ah so it’s more or less biased to what acceptable media it can consume and so is likely at best centrist within it’s perspective given they likely blacklist certain sources. So what is stopping Grok from doing the hallucinatory or fabricated responses that were a big issue with other LLMs
I’m just guessing but likely they are training or instructing it in such a way that it will defer to sources that it finds through searching the internet. I guess the first thing it does when you ask a question is it searches the internet for recent news articles and other sources and now you have the context full of “facts” that it will stick to. Other LLMs haven’t really done that by default (although now I think they are doing that more) so they would just give answers purely on their weights which is basically the entire internet compressed down to 150 GB or whatever.