A new approach to transformers enhances the attention mechanism by decomposing it into local and global components, significantly reducing computational costs while maintaining or even improving performance. Additionally, innovative ray tracing techniques are explored for modeling wireless channels in indoor environments, merging traditional methods with neural representations for more accurate signal propagation analysis.