Luke discusses a shift back to image discretization and tokenization, emphasizing the power of treating any data as a sequence of tokens. This approach allows for innovative combinations of text and image data, enabling the training of models that can handle diverse inputs and outputs. He highlights the implications of scaling laws and how bimodal training can outperform unimodal methods, paving the way for more effective multimodal AI systems.
