Kristin discusses the intriguing phenomenon of secret recovery in transformers, highlighting the role of cross attention in encoding information. She emphasizes the importance of interpretability in AI for crypto, revealing ongoing research efforts to understand how transformers manage secret information. Additionally, she touches on future work aimed at scaling up techniques to tackle higher dimensional lattices and diverse secret distributions.
