DeepMind's Shortcut Discovery

Tim discusses DeepMind's approach, questioning whether it relies on reasoning or shortcuts. Yannic raises doubts about the model's true capabilities, suggesting it may utilize interpolation tricks. The conversation delves into the unexpected performance of the transformer architecture over neurosymbolic models.