Future of Data Augmentations

Sayak discusses the importance of stochastic data augmentation policies in visual representation learning tasks. He highlights the significance of simpler augmentation techniques like cut mix or augmix for unsupervised visual representation learning. The conversation delves into the balance between experience and priors in model training.