Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts F i n d i n g s - A C L

Ganesh Jawahar | Haichuan Yang | Yunyang Xiong | Zechun Liu | Dilin Wang | Fei Sun | Meng Li | Aasish Pappu | Barlas Oguz | Muhammad Abdul-Mageed | Laks Lakshmanan | Raghuraman Krishnamoorthi | Vikas Chandra |

LLM Performance Predictors are good initializers for Architecture Search F i n d i n g s - A C L

Ganesh Jawahar | Muhammad Abdul-Mageed | Laks Lakshmanan | Dujian Ding |