Autoregressive Models

Aravind discusses the benefits of infinite data for overcoming problems in generative models. Connor questions the performance impact of autoregressiveness in models like GPT-4, leading to a conversation on potential solutions and the value of output quality over speed.