Yann shares his enthusiasm for non-contrasting methods that maximize mutual information between outputs, highlighting their stability and resilience against collapse. He discusses the challenges of estimating mutual information and the necessity of having a robust model for accurate predictions. The conversation touches on the similarities between Barlow Twins and VicReg, with a preference for VicReg due to its clear rationale for preventing collapse.
