Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations F i n d i n g s - A C L

Bowen Shen | Zheng Lin | Daren Zha | Wei Liu | Jian Luan | Bin Wang | Weiping Wang |

Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning F i n d i n g s - A C L

Naibin Gu | Peng Fu | Xiyu Liu | Bowen Shen | Zheng Lin | Weiping Wang |