Auke discusses the advantages of using Swin transformers for image compression, highlighting their efficiency in determining the necessary local information for decision-making. He explains the concept of effective receptive fields, noting how these models adapt their focus based on the task—showing a larger receptive field when comparing images for motion estimation, which enhances performance in video compression tasks.