<- Back to list

I'm Not Lying, I'm Hallucinating

idiallo.com · Ibrahim Diallo @dialloibu

AIcultureAI/LLMculture/Trends

AI 摘要

Andrej Karpathy 复兴了‘幻觉’一词,将其从‘预测错误’的含义转变为描述大语言模型编造事实或扭曲真相的行为。这种措辞将模型的失败重新定义为一种神经紊乱,而非说谎。作者希望未来能教导模型学会说‘我不知道’,但暂时也接受了这个为自己开脱的术语。

Andrej Karpathy has a gift for coining terms that quickly go mainstream. When I heard "vibe coding," it just made sense. It perfectly captured the experience of programming without really engaging with the code. You just vibe until the application does what you want.

Then there's "hallucination." He didn't exactly invent it. The term has existed since the 1970s. In one early instance, it was used to describe a text summarization program's failure to accurately summarize its source material. But Karpathy's revival of the term brought it back into the mainstream, and subtly shifted its meaning, from "prediction error" to something closer to a dream or a vision.

Now, large language models don't throw errors. They hallucinate. When they invent facts or bend the truth, they're not lying. They're hallucinating. And with every new model that comes out and promises to stay clean off drugs, it still hallucinates.

An LLM can do no wrong when all its failures are framed as neurological disorder. For my part, I hope there's a real effort to teach these models to simply say "I don't know." But in the meantime, I'll adopt the term for myself. If you ever suspect I'm lying, or catch me red-handed, just know that it's not my fault. I'm just hallucinating.

I'm Not Lying, I'm Hallucinating