Attention is a complex concept that remains poorly understood in both neuroscience and machine learning. Yael emphasizes the need for models that predict attention based on experience rather than instruction, highlighting a gap in current research. She draws intriguing parallels to geology, where compositional models are being explored to develop new mathematical frameworks for understanding attention as a constrained quantity.
