Evan discusses the nuances of ensemble methods like bagging, boosting, and stacking, highlighting their effectiveness in improving model accuracy without altering data. He emphasizes the importance of tools like XGBoost, which often outperforms traditional models like random forests but requires careful tuning. The conversation also touches on the value of platforms like Kaggle for practical learning in machine learning.