Nicholas emphasizes the complexity of privacy in AI, arguing that the term "differential privacy" can be misleading when applied to pre-trained models. He highlights the potential disconnect between technical definitions and real-world implications, suggesting that current benchmarks may not effectively measure privacy improvements. The conversation underscores the need for more relevant metrics in evaluating private learning techniques.
