[1N3-J-9] Natural language processing, information retrieval: understanding

[1N3-J-9-04] Distinguish Antonyms in Multiple Viewpoints on Distributed Word Representations

〇Taku Nakamura¹, Ran Tian², Shota Sasaki¹, Kentaro Inui^1,3 (1. Tohoku University, 2. National Institute of Advanced Industrial Science and Technology (AIST), 3. RIKEN Center for Advanced Intelligence Project (AIP))

Keywords:Natural Language Processing, Distributed representations of words, Antonym Distinction

Distributed representations of words (word embeddings) are proven effective for measuring word similarity and additive compositionality.
However, it is challenging to distinguish between synonyms and antonyms because their proximity in the word embedding space is generally close due to their interchangeability in the context.
In this paper, we aim to build a model that can discriminate antonyms in the embedding space without affecting important properties of original word embeddings.
Our method is designed to learn multiple hyperplanes for capturing antonymy relations in the embedding space in a supervised manner.
Our empirical evaluation demonstrates that we can reasonably distinguish between synonyms and antonyms and reveals that several intriguing issues still remain.