Data Efficiency Insights
Hugo discusses the data efficiency of image transformers, exploring the limits of training on smaller datasets like CIFAR ten. He highlights the sensitivity of transformers to optimization procedures and the importance of good hyperparameters for performance.In this clip
From this podcast
Machine Learning Street Talk (MLST)
#044 - Data-efficient Image Transformers (Hugo Touvron)
Related Questions