Thomas discusses the nuances of hallucinations in language models, emphasizing the need for a clearer taxonomy of errors. He highlights recent research that categorizes different types of hallucinations but notes a gap in understanding their underlying causes. The conversation also touches on the role of uncertainty in these models and suggests that random choices during uncertain moments may contribute to the issue.
