[3J4-GS-6c] 言語メディア処理：言語モデル

[3J4-GS-6c-03] An analysis of the improvement in Japanese dependency analysis using BERT

〇Tadatomo Udagawa¹, Daisuke Kubo¹, Takuya Matsuzaki¹ (1. Tokyo University of Science)

Keywords:Syntax parsing, Neural language model, Error analysis

In this paper, we investigate how the accuracy of Japanese dependency analysis is improved by using BERT.We compare two neural models based on BERT and those based only on traditional features.In our experiments, both of the BERT-based models outperformed the accuracy of the models based only on traditional features.We analyze the difference, in terms of the POS combination and the distance between the bunsetsu pairs, to find the main factor of the improvement.