Novelty in Testing
François discusses the challenge of creating unique and unpredictable tasks for AI testing, emphasizing the need for a source of true novelty. He highlights the limitations of human creativity in this process and proposes crowdsourcing as a way to diversify the task creation, while also ensuring that the test sets remain hidden to prevent bias and manipulation. The conversation reveals the intricate relationship between human intelligence and the development of AI.In this clip
From this podcast
Lex Fridman Podcast
François Chollet: Measures of Intelligence | Lex Fridman Podcast #120
Related Questions