NLPExplorer

Better Word Representations with Recursive Neural Networks for Morphology

Thang Luong | Richard Socher | Christopher Manning |

Paper Details:

Month: August
Year: 2013
Location: Sofia, Bulgaria
Venue: CoNLL | WS |
SIG: SIGNLL

Citations

URL

Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts
Cícero dos Santos | Maíra Gatti |

Modeling Newswire Events using Neural Networks for Anomaly Detection
Pradeep Dasigi | Eduard Hovy |

Towards Semantic Validation of a Derivational Lexicon
Britta Zeller | Sebastian Padó | Jan Šnajder |

Predictability of Distributional Semantics in Derivational Word Formation
Sebastian Padó | Aurélie Herbelot | Max Kisselew | Jan Šnajder |

Sub-Word Similarity based Search for Embeddings: Inducing Rare-Word Embeddings for Word Similarity Tasks and Language Modelling
Mittul Singh | Clayton Greenberg | Youssef Oualil | Dietrich Klakow |

Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Text
Aditya Joshi | Ameya Prabhu | Manish Shrivastava | Vasudeva Varma |

Enriching Phrase Tables for Statistical Machine Translation Using Mixed Embeddings
Peyman Passban | Qun Liu | Andy Way |

Aff2Vec: Affect–Enriched Distributional Word Representations
Sopan Khosla | Niyati Chhaya | Kushal Chawla |

Learning to Generate Word Representations using Subword Information
Yeachan Kim | Kang-Min Kim | Ji-Min Lee | SangKeun Lee |

What’s in Your Embedding, And How It Predicts Task Performance
Anna Rogers | Shashwath Hosur Ananthakrishna | Anna Rumshisky |

AnlamVer: Semantic Model Evaluation Dataset for Turkish - Word Similarity and Relatedness
Gökhan Ercan | Olcay Taner Yıldız |

Bilingual Word Embeddings for Phrase-Based Machine Translation
Will Y. Zou | Richard Socher | Daniel Cer | Christopher D. Manning |

Word Semantic Representations using Bayesian Probabilistic Tensor Factorization
Jingwei Zhang | Jeremy Salwen | Michael Glass | Alfio Gliozzo |

Glove: Global Vectors for Word Representation
Jeffrey Pennington | Richard Socher | Christopher Manning |

Non-lexical neural architecture for fine-grained POS Tagging
Matthieu Labeau | Kevin Löser | Alexandre Allauzen |

Learning Better Embeddings for Rare Words Using Distributional Representations
Irina Sergienya | Hinrich Schütze |

Component-Enhanced Chinese Character Embeddings
Yanran Li | Wenjie Li | Fei Sun | Sujian Li |

A Generative Word Embedding Model and its Low Rank Positive Semidefinite Solution
Shaohua Li | Jun Zhu | Chunyan Miao |

Morphological Priors for Probabilistic Neural Word Embeddings
Parminder Bhatia | Robert Guthrie | Jacob Eisenstein |

LAMB: A Good Shepherd of Morphologically Rich Languages
Sebastian Ebert | Thomas Müller | Hinrich Schütze |

The Effects of Data Size and Frequency Range on Distributional Semantic Models
Magnus Sahlgren | Alessandro Lenci |

Charagram: Embedding Words and Sentences via Character n-grams
John Wieting | Mohit Bansal | Kevin Gimpel | Karen Livescu |

Joint Embeddings of Chinese Words, Characters, and Fine-grained Subcharacter Components
Jinxing Yu | Xun Jian | Hao Xin | Yangqiu Song |

High-risk learning: acquiring new word vectors from tiny data
Aurélie Herbelot | Marco Baroni |

A Sub-Character Architecture for Korean Language Processing
Karl Stratos |

Quantifying Context Overlap for Training Word Embeddings
Yimeng Zhuang | Jinghui Xie | Yinhe Zheng | Xuan Zhu |

Generalizing Word Embeddings using Bag of Subwords
Jinman Zhao | Sidharth Mudgal | Yingyu Liang |

Card-660: Cambridge Rare Word Dataset - a Reliable Benchmark for Infrequent Word Representation Models
Mohammad Taher Pilehvar | Dimitri Kartsaklis | Victor Prokhorov | Nigel Collier |

Memory, Show the Way: Memory Based Few Shot Word Representation Learning
Jingyuan Sun | Shaonan Wang | Chengqing Zong |

How to represent a word and predict it, too: Improving tied architectures for language modelling
Kristina Gulordava | Laura Aina | Gemma Boleda |

Capturing Regional Variation with Distributed Place Representations and Geographic Retrofitting
Dirk Hovy | Christoph Purschke |

Painless Semi-Supervised Morphological Segmentation using Conditional Random Fields
Teemu Ruokolainen | Oskar Kohonen | Sami Virpioja | Mikko Kurimo |

Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation
Ivan Vulić | Douwe Kiela | Anna Korhonen |

Continuous N-gram Representations for Authorship Attribution
Yunita Sari | Andreas Vlachos | Mark Stevenson |

Inducing Embeddings for Rare and Unseen Words by Leveraging Lexical Resources
Mohammad Taher Pilehvar | Nigel Collier |

The Interplay of Semantics and Morphology in Word Embeddings
Oded Avraham | Yoav Goldberg |

Geographical Evaluation of Word Embeddings
Michal Konkol | Tomáš Brychcín | Michal Nykl | Tomáš Hercig |

Resources to Examine the Quality of Word Embedding Models Trained on n-Gram Data
Ábel Elekes | Adrian Englhardt | Martin Schäler | Klemens Böhm |

DerivBase.hr: A High-Coverage Derivational Morphology Resource for Croatian
Jan Šnajder |

Exploitation of Co-reference in Distributional Semantics
Dominik Schlechtweg |

Word Embedding Evaluation and Combination
Sahar Ghannay | Benoit Favre | Yannick Estève | Nathalie Camelin |

Joint Learning of Sense and Word Embeddings
Mohammed Alsuhaibani | Danushka Bollegala |

Evaluation of Croatian Word Embeddings
Lukáš Svoboda | Slobodan Beliga |

Multiview LSA: Representation Learning via Generalized CCA
Pushpendre Rastogi | Benjamin Van Durme | Raman Arora |

Morphological Word-Embeddings
Ryan Cotterell | Hinrich Schütze |

Unsupervised Morphology Induction Using Word Embeddings
Radu Soricut | Franz Och |

Bilingual lexicon extraction for a distant language pair using a small parallel corpus
Ximena Gutierrez-Vasques |

Right-truncatable Neural Word Embeddings
Jun Suzuki | Masaaki Nagata |

Bilingual Learning of Multi-sense Embeddings with Discrete Autoencoders
Simon Šuster | Ivan Titov | Gertjan van Noord |

Learning Visually Grounded Sentence Representations
Douwe Kiela | Alexis Conneau | Allan Jabri | Maximilian Nickel |

attr2vec: Jointly Learning Word and Contextual Attribute Embeddings with Factorization Machines
Fabio Petroni | Vassilis Plachouras | Timothy Nugent | Jochen L. Leidner |

Frustratingly Easy Meta-Embedding – Computing Meta-Embeddings by Averaging Source Word Embeddings
Joshua Coates | Danushka Bollegala |

POS induction with distributional and morphological information using a distance-dependent Chinese restaurant process
Kairit Sirts | Jacob Eisenstein | Micha Elsner | Sharon Goldwater |

Improving Lexical Embeddings with Semantic Knowledge
Mo Yu | Mark Dredze |

An Exploration of Embeddings for Generalized Phrases
Wenpeng Yin | Hinrich Schütze |

Community Evaluation and Exchange of Word Vectors at wordvectors.org
Manaal Faruqui | Chris Dyer |

Orthogonality of Syntax and Semantics within Distributional Spaces
Jeff Mitchell | Mark Steedman |

A Unified Learning Framework of Skip-Grams and Global Vectors
Jun Suzuki | Masaaki Nagata |

Open IE as an Intermediate Structure for Semantic Tasks
Gabriel Stanovsky | Ido Dagan | Mausam |

A Hierarchical Knowledge Representation for Expert Finding on Social Media
Yanran Li | Wenjie Li | Sujian Li |

Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models
Minh-Thang Luong | Christopher D. Manning |

Learning Word Meta-Embeddings
Wenpeng Yin | Hinrich Schütze |

Morphological Smoothing and Extrapolation of Word Embeddings
Ryan Cotterell | Hinrich Schütze | Jason Eisner |

A Character-level Decoder without Explicit Segmentation for Neural Machine Translation
Junyoung Chung | Kyunghyun Cho | Yoshua Bengio |

Neural Machine Translation of Rare Words with Subword Units
Rico Sennrich | Barry Haddow | Alexandra Birch |

Matrix Factorization using Window Sampling and Negative Sampling for Improved Word Representations
Alexandre Salle | Aline Villavicencio | Marco Idiart |

Automatically Generating Rhythmic Verse with Neural Networks
Jack Hopkins | Douwe Kiela |

Multimodal Word Distributions
Ben Athiwaratkun | Andrew Wilson |

From Characters to Words to in Between: Do We Capture Morphology?
Clara Vania | Adam Lopez |

Learning Character-level Compositionality with Visual Features
Frederick Liu | Han Lu | Chieh Lo | Graham Neubig |

Probabilistic FastText for Multi-Sense Word Embeddings
Ben Athiwaratkun | Andrew Wilson | Anima Anandkumar |

Adversarial Contrastive Estimation
Avishek Joey Bose | Huan Ling | Yanshuai Cao |

Incorporating Latent Meanings of Morphological Compositions to Enhance Word Embeddings
Yang Xu | Jiawei Liu | Wei Yang | Liusheng Huang |

Batch IS NOT Heavy: Learning Word Representations From All Samples
Xin Xin | Fajie Yuan | Xiangnan He | Joemon M. Jose |

A Distributional and Orthographic Aggregation Model for English Derivational Morphology
Daniel Deutsch | John Hewitt | Dan Roth |

An Unsupervised Method for Uncovering Morphological Chains
Karthik Narasimhan | Regina Barzilay | Tommi Jaakkola |

Improving Distributional Similarity with Lessons Learned from Word Embeddings
Omer Levy | Yoav Goldberg | Ido Dagan |

Enriching Word Vectors with Subword Information
Piotr Bojanowski | Edouard Grave | Armand Joulin | Tomas Mikolov |

Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets
Rotem Dror | Gili Baumer | Marina Bogomolov | Roi Reichart |

Joint Semantic Synthesis and Morphological Analysis of the Derived Word
Ryan Cotterell | Hinrich Schütze |

Analysis Methods in Neural Language Processing: A Survey
Yonatan Belinkov | James Glass |

Czech Dataset for Semantic Similarity and Relatedness
Miloslav Konopík | Ondřej Pražák | David Steinberger |

Think Positive: Towards Twitter Sentiment Analysis from Scratch
Cícero dos Santos |

HCCL at SemEval-2017 Task 2: Combining Multilingual Word Embeddings and Transliteration Model for Semantic Similarity
Junqing He | Long Wu | Xuemin Zhao | Yonghong Yan |

The Limitations of Cross-language Word Embeddings Evaluation
Amir Bakarov | Roman Suvorov | Ilya Sochenkov |

Obtaining a Better Understanding of Distributional Models of German Derivational Morphology
Max Kisselew | Sebastian Padó | Alexis Palmer | Jan Šnajder |

Learning Distributed Representations for Multilingual Text Sequences
Hieu Pham | Thang Luong | Christopher Manning |

Bilingual Word Representations with Monolingual Quality in Mind
Thang Luong | Hieu Pham | Christopher D. Manning |

A Joint Model for Word Embedding and Word Morphology
Kris Cao | Marek Rei |

Quantifying the Vanishing Gradient and Long Distance Dependency Problem in Recursive Neural Networks and Recursive LSTMs
Phong Le | Willem Zuidema |

Mapping Unseen Words to Task-Trained Embedding Spaces
Pranava Swaroop Madhyastha | Mohit Bansal | Kevin Gimpel | Karen Livescu |

Intrinsic Evaluation of Word Vectors Fails to Predict Extrinsic Performance
Billy Chiu | Anna Korhonen | Sampo Pyysalo |

Problems With Evaluation of Word Embeddings Using Word Similarity Tasks
Manaal Faruqui | Yulia Tsvetkov | Pushpendre Rastogi | Chris Dyer |

A Syllable-based Technique for Word Embeddings of Korean Words
Sanghyuk Choi | Taeuk Kim | Jinseok Seol | Sang-goo Lee |

What do we need to know about an unknown word when parsing German
Bich-Ngoc Do | Ines Rehbein | Anette Frank |

Evaluation of word embeddings against cognitive processes: primed reaction times in lexical decision and naming tasks
Jeremy Auguste | Arnaud Rey | Benoit Favre |

Fully Delexicalized Contexts for Syntax-Based Word Embeddings
Jenna Kanerva | Sampo Pyysalo | Filip Ginter |

Are doggies really nicer than dogs? The impact of morphological derivation on emotional valence in German
Gabriella Lapesa | Sebastian Padó | Tillmann Pross | Antje Rossdeutscher |

Addressing Low-Resource Scenarios with Character-aware Embeddings
Sean Papay | Sebastian Padó | Ngoc Thang Vu |

Subword-level Composition Functions for Learning Word Embeddings
Bofang Li | Aleksandr Drozd | Tao Liu | Xiaoyong Du |

Incorporating Subword Information into Matrix Factorization Word Embeddings
Alexandre Salle | Aline Villavicencio |

Compositional Morpheme Embeddings with Affixes as Functions and Stems as Arguments
Daniel Edmiston | Karl Stratos |

Unsupervised Random Walk Sentence Embeddings: A Strong but Simple Baseline
Kawin Ethayarajh |

Characters or Morphemes: How to Represent Words?
Ahmet Üstün | Murathan Kurfalı | Burcu Can |

Interpreting Word-Level Hidden State Behaviour of Character-Level LSTM Language Models
Avery Hiebert | Cole Peterson | Alona Fyshe | Nishant Mehta |

Retrieval Term Prediction Using Deep Belief Networks
Qing Ma | Ibuki Tanigawa | Masaki Murata |

Field Of Study

Linguistic Trends

Embeddings Morphology

Approach

Deep Learning

Language

English French Arabic

Similar Papers

Cross Language Dependency Parsing using a Bilingual Lexicon

Hai Zhao | Yan Song | Chunyu Kit | Guodong Zhou |

Extending Statistical Machine Translation with Discriminative and Trigger-Based Lexicon Models

Arne Mauser | Saša Hasan | Hermann Ney |

Integrating Graph-Based and Transition-Based Dependency Parsers

Joakim Nivre | Ryan McDonald |

A treebank-based study on the influence of Italian word order on parsing performance

Anita Alicante | Cristina Bosco | Anna Corazza | Alberto Lavelli |

Improving Arabic-Chinese Statistical Machine Translation using English as Pivot Language

Nizar Habash | Jun Hu |