A new software framework called tensorly is making it easier for researchers to define tensor operations and experiment with various architectures across different platforms. While the design of complex architectures remains a challenge, there is potential for advancements through the application of group theories and tensor algebra, which could enhance architecture search methodologies. Current approaches, even simple ones, are resource-intensive, highlighting the need for more efficient solutions in the field.
