Limitations of LLMs

Ben discusses the inherent limitations of large language models (LLMs) in their ability to generalize and create compared to human cognition. He emphasizes that while LLMs can produce novel compositions, they struggle to make the creative leaps necessary for entirely new genres, such as jazz or metal. The conversation highlights the differences in how LLMs and humans approach creativity, pointing out the challenges in quantifying these limitations.