Connor and Yannic debate whether GPT-3 engages in reasoning or operates solely on learned patterns. The discussion delves into the distinction between system one and system two thinking in neural networks, challenging traditional notions of reasoning within AI.