[3G2] [General Session] 9. NLP / IR

[3G2-01] Proposal of Metrics Measuring Coherence Based on Sentence Similarity Graph with Document Structure

〇Mana Ihori¹, Atsuko Tominaga², Yoshinari Takegawa², Keiji Hirata² (1. Future University Hakodate Graduate School, 2. Future University Hakodate)

Keywords:Evaluate of coherence, Graph of document structure, Evaluation formula

Coherence of the document is having unity of semantic, further It is necessary to write a document that is easy to understand. It is difficult to evaluate coherence of long document, since demand of automatic evaluation of coherence is high. Also, previous method focused on adjacent sentences to evaluate coherence. However, it is necessary to consider document structure, since document consists of multiple segments. Therefore, in this research, we propose metrics measuring coherence based on sentence similarity graph with document structure. We performed comparative experiments with previous method. As a result, some output accuracies comparable to previous method, it is assumed that proposed method is valid to evaluate coherence.