Reasoning in AI

LLMs function as approximate retrieval engines, but there's potential for building systems that can reason within specific domains. While they can learn syntax and apply formal rules, they often lack the goal-directed creativity found in human reasoning. The discussion suggests that leveraging specialized reasoning tools might be more efficient than forcing all capabilities into a single AI system. Additionally, recent advancements include the founding of a new company focused on industrial AI and a revival of LSTM methods to compete with transformer technology.