Equivariance in Generative Models

Equivariance has found its way into generative models, with notable advancements like the equivalent VAE. While existing methods, such as equivariant normalizing flows, showcase elegance, scaling these approaches for low-complexity, low-latency applications remains a challenge. The focus is on creating small, efficient equivariant models that outperform traditional counterparts, emphasizing the importance of transformation consistency in the generator network.