Neural Machine Translation

Elena discusses the intricate relationship between source and target contributions in neural machine translation. She highlights how models can hallucinate, especially when influenced by exposure bias, leading to an over-reliance on target history. Insights into attention weights reveal that some models may focus on irrelevant tokens, raising questions about their understanding of input data.