Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

Damai Dai | Yutao Sun | Li Dong | Yaru Hao | Shuming Ma | Zhifang Sui | Furu Wei |

Paper Details:

Month: July
Year: 2023
Location: Toronto, Canada
Venue: F | i | n | d | i | n | g | s | - | A | C | L |

Citations

URL