Sunil emphasizes the importance of focusing on the test set over the training set for evaluating model performance, arguing that a well-curated test set is crucial for informed decision-making. He shares lessons learned about task granularity in agentic systems, likening the balance between RDBMS and NoSQL approaches to the challenges of effectively utilizing large language models. Finding the right level of task specificity is key to optimizing performance and efficiency.
