Symmetric Dot-Product Attention for Efficient Training of BERT Language Models

Martin Courtois | Malte Ostendorff | Leonhard Hennig | Georg Rehm |

Paper Details:

Month: August
Year: 2024
Location: Bangkok, Thailand and virtual meeting
Venue: F | i | n | d | i | n | g | s | - | A | C | L |