Neural Networks Revolution

Terry discusses the evolution of the NoREPS conference, rooted in the 1980s dissatisfaction with traditional tools for complex problems like computer vision and language translation. He emphasizes the shift towards large-scale models with numerous parameters, highlighting the importance of data-driven optimization in improving performance. The excitement of the inaugural meeting in 1987, with its 90 submissions and hundreds of attendees, marked a pivotal moment in the field.