Equivariance has found its way into generative models, with notable advancements like the equivalent VAE. While existing methods, such as equivariant normalizing flows, showcase elegance, scaling these approaches for low-complexity, low-latency applications remains a challenge. The focus is on creating small, efficient equivariant models that outperform traditional counterparts, emphasizing the importance of transformation consistency in the generator network.