Nathan shares valuable insights on model training costs, emphasizing the impact of previous investments on current estimates. He discusses the efficiency of different models like DBRX and Mixedral, highlighting the importance of fine-tuning and the potential for advancements in technology.