NLPExplorer

MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition

Month: November
Year: 2024
Location: Miami, Florida, USA
Venue: F | i | n | d | i | n | g | s | - | E | M | N | L | P |