Lucas discusses the evolving role of transformers in safety-critical systems, highlighting their application in time series modeling and embedded AI. While larger transformer models are gaining traction in generative AI, the complexity of applying these models in critical environments remains a significant challenge. He emphasizes the ongoing research and interest in improving model verification techniques, particularly for large language models.