Self-Supervised Learning
Alex and Daniel discuss the limitations of supervised learning and the benefits of self-supervised learning, where the label comes from the data itself. They explore the idea of building representations from the bottom up and the role of human design in self-supervised learning tasks.In this clip
From this podcast
The Gradient
Alex Tamkin on Self-Supervised Learning and Large Language Models
Related Questions