Jason and Erik predict a regularization of the state in the next 90 days, discussing the importance of filtering out unnecessary information to retain only what's essential in AI systems. They explore the concept of memory decay and state decay, drawing parallels to human memory efficiency and the potential value of decay functions in AI models.