Oliver shares his experience testing smaller models, recommending one that performs well despite being below his usual standards. Alex highlights the evolving perception of Phi models, emphasizing their impressive benchmark results but cautioning about real-world performance. The conversation also touches on the extensive training data used for Phi models, which primarily consists of high-quality synthetic data derived from textbooks.
