On the Role of Parallel Data in Cross-lingual Transfer Learning F i n d i n g s - A C L

Machel Reid | Mikel Artetxe |

CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models EMNLP

Aitor Ormazabal | Mikel Artetxe | Eneko Agirre |

Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training F i n d i n g s - A C L

Kelly Marchisio | Patrick Lewis | Yihong Chen | Mikel Artetxe |

Revisiting Machine Translation for Cross-lingual Classification EMNLP

Mikel Artetxe | Vedanuj Goswami | Shruti Bhosale | Angela Fan | Luke Zettlemoyer |

Training Trajectories of Language Models Across Scales ACL

Mengzhou Xia | Mikel Artetxe | Chunting Zhou | Xi Victoria Lin | Ramakanth Pasunuru | Danqi Chen | Luke Zettlemoyer | Veselin Stoyanov |

Principled Paraphrase Generation with Parallel Corpora ACL

Aitor Ormazabal | Mikel Artetxe | Aitor Soroa | Gorka Labaka | Eneko Agirre |

Multilingual Autoregressive Entity Linking TACL

Nicola De Cao | Ledell Wu | Kashyap Popat | Mikel Artetxe | Naman Goyal | Mikhail Plekhanov | Luke Zettlemoyer | Nicola Cancedda | Sebastian Riedel | Fabio Petroni |

PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining NAACL

Machel Reid | Mikel Artetxe |

Lifting the Curse of Multilinguality by Pre-training Modular Transformers NAACL

Jonas Pfeiffer | Naman Goyal | Xi Lin | Xian Li | James Cross | Sebastian Riedel | Mikel Artetxe |

Don’t Prompt, Search! Mining-based Zero-Shot Learning with Language Models EMNLP

Mozes van de Kar | Mengzhou Xia | Danqi Chen | Mikel Artetxe |

Efficient Large Scale Language Modeling with Mixtures of Experts EMNLP

Mikel Artetxe | Shruti Bhosale | Naman Goyal | Todor Mihaylov | Myle Ott | Sam Shleifer | Xi Victoria Lin | Jingfei Du | Srinivasan Iyer | Ramakanth Pasunuru | Giridharan Anantharaman | Xian Li | Shuohui Chen | Halil Akin | Mandeep Baines | Louis Martin | Xing Zhou | Punit Singh Koura | Brian O’Horo | Jeffrey Wang | Luke Zettlemoyer | Mona Diab | Zornitsa Kozareva | Veselin Stoyanov |

Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? EMNLP

Sewon Min | Xinxi Lyu | Ari Holtzman | Mikel Artetxe | Mike Lewis | Hannaneh Hajishirzi | Luke Zettlemoyer |

Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models EMNLP

Mengzhou Xia | Mikel Artetxe | Jingfei Du | Danqi Chen | Veselin Stoyanov |

Does Corpus Quality Really Matter for Low-Resource Languages? EMNLP

Mikel Artetxe | Itziar Aldabe | Rodrigo Agerri | Olatz Perez-de-Viñaspre | Aitor Soroa |

On the Role of Bidirectionality in Language Model Pre-Training F i n d i n g s - E M N L P

Mikel Artetxe | Jingfei Du | Naman Goyal | Luke Zettlemoyer | Veselin Stoyanov |

PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generation F i n d i n g s - E M N L P

Aitor Ormazabal | Mikel Artetxe | Manex Agirrezabal | Aitor Soroa | Eneko Agirre |

Multilingual Machine Translation with Hyper-Adapters EMNLP

Christos Baziotis | Mikel Artetxe | James Cross | Shruti Bhosale |

Few-shot Learning with Multilingual Generative Language Models EMNLP

Xi Victoria Lin | Todor Mihaylov | Mikel Artetxe | Tianlu Wang | Shuohui Chen | Daniel Simig | Myle Ott | Naman Goyal | Shruti Bhosale | Jingfei Du | Ramakanth Pasunuru | Sam Shleifer | Punit Singh Koura | Vishrav Chaudhary | Brian O’Horo | Jeff Wang | Luke Zettlemoyer | Zornitsa Kozareva | Mona Diab | Veselin Stoyanov | Xian Li |

Multilingual Machine Translation: Closing the Gap between Shared and Language-specific Encoder-Decoders EACL

Carlos Escolano | Marta R. Costa-jussà | José A. R. Fonollosa | Mikel Artetxe |

Beyond Offline Mapping: Learning Cross-lingual Word Embeddings through Context Anchoring ACL IJCNLP

Aitor Ormazabal | Mikel Artetxe | Aitor Soroa | Gorka Labaka | Eneko Agirre |

A Call for More Rigor in Unsupervised Cross-lingual Learning ACL

Mikel Artetxe | Sebastian Ruder | Dani Yogatama | Gorka Labaka | Eneko Agirre |

Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining ACL

Ivana Kvapilíková | Mikel Artetxe | Gorka Labaka | Eneko Agirre | Ondřej Bojar |

On the Cross-lingual Transferability of Monolingual Representations ACL

Mikel Artetxe | Sebastian Ruder | Dani Yogatama |

Translation Artifacts in Cross-lingual Transfer Learning EMNLP

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

An Effective Approach to Unsupervised Machine Translation ACL

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings ACL

Mikel Artetxe | Holger Schwenk |

Analyzing the Limitations of Cross-lingual Word Embedding Mappings ACL

Aitor Ormazabal | Mikel Artetxe | Gorka Labaka | Aitor Soroa | Eneko Agirre |

Bilingual Lexicon Induction through Unsupervised Machine Translation ACL

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Contextualized Translations of Phrasal Verbs with Distributional Compositional Semantics and Monolingual Corpora CL

Pablo Gamallo | Susana Sotelo | José Ramom Pichel | Mikel Artetxe |

Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond TACL

Mikel Artetxe | Holger Schwenk |

Unsupervised Statistical Machine Translation EMNLP

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Uncovering Divergent Linguistic Information in Word Embeddings with Lessons for Intrinsic and Extrinsic Evaluation CoNLL

Mikel Artetxe | Gorka Labaka | Iñigo Lopez-Gazpio | Eneko Agirre |

A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings ACL

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Learning bilingual word embeddings with (almost) no bilingual data ACL

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Learning principled bilingual mappings of word embeddings while preserving monolingual invariance EMNLP

Mikel Artetxe | Gorka Labaka | Eneko Agirre |

Adding syntactic structure to bilingual terminology for improved domain adaptation WS

Mikel Artetxe | Gorka Labaka | Chakaveh Saedi | João Rodrigues | João Silva | António Branco | Eneko Agirre |

Analyzing English-Spanish Named-Entity enhanced Machine Translation SSST WS

Mikel Artetxe | Eneko Agirre | Inaki Alegria | Gorka Labaka |

Building hybrid machine translation systems by using an EBMT preprocessor to create partial translations EAMT WS

Mikel Artetxe | Gorka Labaka | Kepa Sarasola |

Building hybrid machine translation systems by using an EBMT preprocessor to create partialtranslations EAMT

Mikel Artetxe | Gorka Labaka | Kepa Sarasola |