MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition F i n d i n g s - E M N L P

Cheng Yang | Yang Sui | Jinqi Xiao | Lingyi Huang | Yu Gong | Yuanlin Duan | Wenqi Jia | Miao Yin | Yu Cheng | Bo Yuan |