Exploring the nuances of model confidence, Thomas suggests that lower activations in unfamiliar contexts could indicate a lack of trust in LLM outputs. The conversation delves into the effectiveness of prompt engineering, revealing how specific phrasing can enhance accuracy. Both Thomas and Sam reflect on the importance of training data in shaping model behavior, questioning whether models can genuinely express uncertainty.
