BERT Performance Insights

Tim expresses skepticism about BERT's ability to extract world knowledge from text through mere statistical language modeling. Despite initial doubts, the results reveal surprising performance, with BERT nearly matching human reasoning in some instances. However, the variance in results raises questions about the reliability of these findings and the potential limitations of the linear classifier used.