Peter discusses the impact of using domain-agnostic prompts on model performance, highlighting that these simpler, non-specific questions can significantly enhance accuracy. He emphasizes the importance of understanding how well a model can generalize from easy to complex tasks, particularly in sensitive areas like drug trial recommendations, where accurate data collection is crucial.