Ben expresses his fascination with building AGI systems while exploring the creative potential of LLMs in music generation. He discusses the balance between competent output and true creativity, highlighting the need for innovative approaches, like using information theory, to enhance AI's surprisingness in music responses. Ultimately, he seeks a way for AI to produce music that is not only technically sound but also intriguing and original.