Nicholas discusses the analogy between model stealing and cryptanalysis, emphasizing the mathematical nature of models. He highlights the significance of extracting embeddings, noting their potential value in enhancing adversarial attacks and other applications. The conversation challenges traditional threat models, suggesting that many assumptions in prior literature may not hold true in practice.
