Sewon Min: The Science of Natural Language

ICL Mechanisms

In-context learning (ICL) represents a shift from traditional methods of training models with large datasets and gradient updates. Sewon Min explains that ICL allows models to learn tasks without gradient updates by using a few examples, known as demonstrations, to guide the model's predictions 1. This approach was first proposed in the GPT-3 paper and involves concatenating example pairs with the test input to predict the next token. The debate around ICL's mechanisms continues, with some researchers suggesting it resembles gradient descent, while others argue it is distinct, highlighting the ongoing exploration in this field 2.

   

Demonstrations

Demonstrations play a crucial role in ICL, yet their effectiveness is not solely dependent on input-label mappings. Sewon Min notes that models often ignore these mappings, focusing instead on input and output distributions 3. This suggests that models condition on the right distribution of text to generate accurate predictions. Min's work supports the idea that ICL involves Bayesian inference, where models locate concepts they have already learned, emphasizing the importance of input distribution over label mapping 4.

   

Task Transfer

Task transfer in ICL is influenced by the diversity and number of meta-training tasks. Sewon Min explains that including diverse datasets increases the likelihood of relevance to target tasks, enhancing performance 5. However, gains diminish after a certain point, indicating model saturation. The role of compositionality in ICL is also explored, with recent studies suggesting that combining models trained on different datasets can enable compositional generalization, though this area remains in its early stages 6.