Language Models' Astonishing Abilities

Jensen and Ben discuss their awe and surprise at the remarkable accuracy and lifelike nature of large language models. They explore the cleverness of self-supervised learning and the potential for machines to learn reasoning capabilities through reading. Despite the sensibility, they still find the encoding and compression of information within language models to be truly amazing.