The discussion delves into the historical roots of reinforcement learning from ancient philosophy to modern economics, exploring how concepts like the von Neumann-Morgenstern utility theorem shape current methodologies. Questions arise about the nature of preferences in AI models, particularly whether they are more influenced by internet-sourced data or curated datasets. This exploration highlights the importance of integrating insights from social sciences to better understand human preferences in AI development.
