Neural Network Insights
Ronen explains how neural networks process information through activation patterns in different layers. By analyzing tokens that trigger high activations, they uncover the network's behavior, revealing surprising patterns in larger models like GPT-2 xl.In this clip
From this podcast

The Cognitive Revolution: How AI Changes Everything
The Tiny Model Revolution with Ronen Eldan and Yuanzhi Li of Microsoft Research
Related Questions