X Distill Method

Researchers have introduced the X distill method, which enhances network complexity by incorporating semantic information during training. This extra information is not required on the device, allowing for a more efficient transfer. The training process is self-supervised, showcasing an innovative approach to leveraging additional data without burdening device capabilities.