Ethical AI Measurement

Yejin Choi discusses the challenges of measuring ethical reasoning in AI systems and shares insights from her work on the Delphi system. She explains the different data sets and measurements used to train and evaluate these systems, highlighting the surprising performance of Delphi and the complexities of determining gold labels for ethical questions.