Yannic and Alex discuss the effectiveness of kernel methods in regression, questioning if the success of certain kernels like RBF is due to their ability to represent natural data well or if other functions could potentially perform better. They delve into the idea of exploring different kernel functions to optimize computational efficiency and performance, highlighting the importance of experimentation in the field of machine learning.
