Novel Conceptual Combinations

Raphaël discusses a task designed to test if language models can parse novel conceptual combinations. Humans excel at understanding such combinations, like "apartment dog," showcasing the complexity of language comprehension beyond syntax. The task aims to challenge deep learning models to avoid relying on shallow heuristics by introducing subtasks with made-up words and specific prompts.