@Hannah & @Because0
It's not unlike LLMs. I'm no expert on AI, but it strings together combinations of words that seem statistically likely to produce the intended meaning. Meanwhile, AI does not have a sensory apparatus to interact with material existence. So when AI says water... what is it talking about?
I mean, sure, we can infer that it is talking about that substance that chemists designate as H2O, but it cannot actually experience what we mean by that word, "water."
I'm sure y'all have experienced the word salad of AI slop, so this might seem somewhat obvious haha but it's perhaps a more extreme tangent to what RAW is getting at.
It's crazy to think about how much of the world operates (without even considering AI) on people who talk about things they have never experienced. I mean, I encounter so many people who talk with certainty about knowing things they admit to have never met face to face, yet they make all kinds of decisions as if they were trained in such encounters. It's a bit of a miracle anything gets done at all