Heather discusses the critical role of latency in building trust and the transition from an on-prem provider to AWS. She shares insights on using DistilBERT for topic modeling, highlighting its effectiveness after just one epoch of training. While maintaining their reliable "Toyota Corolla" model, they plan to develop sub-models for new topic modeling tasks to avoid the complexities of managing an extensive class model.
