Jungwon discusses the incremental path from basic search to compositional settings in AI generation. Erik highlights the potential for specialized models in a compositional approach, emphasizing reliability over brainstorming in language model output.