Adapter Fusion

Kyunghyun Cho discusses the concept of adapter fusion, a two-stage training procedure that allows the use of multiple adapters to solve multiple problems simultaneously without destructive interference. This approach bypasses the issue of destructive interference and offers a solution to fuse representations from different tasks.