Presentation information

Organized Session

Organized Session » OS-11

[4E1-OS-11a] 人間と共生する対話知能(1/4)

Fri. Jun 11, 2021 9:00 AM - 10:40 AM Room E (OS room 3)

座長:吉川 雄一郎(大阪大学)

9:40 AM - 10:00 AM

[4E1-OS-11a-03] Analysis of Subjective Evaluation for Fine-tuning Methods of Transformer encoder-decoder based Conversational Systems

〇Hiroaki Sugiyama1, Hiromi Narimatsu1, Masahiro Mizukami1, Tsunehiro Arimoto1, Yuya Chiba1, Toyomi Meguro1, Hideharu Nakajima1 (1. NTT Communication Science Laboratories)

Keywords:Conversational systems, Large-scale Transformer model

In recent years, several high-performance conversational systems based on the transformer encoder-decoder model have been proposed.
Natural response generation is achieved by increasing the system scale (model parameters, amount of training data, etc.).
While previous studies have analyzed the relationship between the system size and decoding method on the subjective evaluation of dialogues, they have not analyzed the differences among Fine-tune corpora.
In addition, conventional analysis has focused only on overall naturalness and superiority, and has not sufficiently analyzed the relationship with multifaceted and detailed impressions.
We evaluate and analyze the impressions of human dialogues in different Fine-tune corpora, system sizes, and the use of additional information.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.