[1P4-GS-6] Language media processing: basic theory

[1P4-GS-6-04] A Study of Reward Functions Suitable for Reinforcement Learning in Machine Translation

〇Yuki Nakatani¹, Tomoyuki Kajiwara¹, Takashi Ninomiya¹ (1. Ehime University)

[[Online]]

Keywords:Machine Translation, Reinforcement Learning

In text generation tasks such as machine translation, models are generally trained using cross-entropy loss.However, mismatches between the loss function and the evaluation metric are often problematic.It is known that this problem can be addressed by direct optimization to the evaluation metric with reinforcement learning.In machine translation, previous studies have used BLEU to calculate rewards for reinforcement learning, but BLEU is not well correlated with human evaluation.In this study, we investigate the impact on machine translation quality through reinforcement learning based on evaluation metrics that are more highly correlated with human evaluation.Experimental results show that reinforcement learning based on BERT trained on the STS task can improve various evaluation metrics.