[3C4-J-9] Natural language processing, information retrieval: correction of documents

[3C4-J-9-01] An Approach for Applying BERT to Sentence Elimination Problem in English Exam

〇Hiromi Narimatsu¹, Hiroaki Sugiyama¹, Genichiro Kikui², Hirotoshi Taira³, Seiki Matoba³, Ryuichiro Higashinaka¹ (1. NTT Communication Science Laboratories, 2. Okayama Prefectural University, 3. Osaka Institute of Technology)

Keywords:Natural Language Processing, BERT, Sentence Elimination Problem

We have been working on the English problems in the“ Can a Robot Get into the University of Tokyo? ”project. This paper focuses on the sentence elimination problem by applying BERT, which has obtained the state-of-the-arts results in a number of machine comprehension tasks. We show how we apply BERT and report the improvements made over baselines. Finally, we show our error analysis and the problems that still need to be solved.