[3Rin4] Interactive 1

[3Rin4-43] A User Study for Verification of the Effectiveness of Scene Graph Features on Image Captioning

〇Yuki Taya¹, Atsushi Keyaki², Hiroshi Tsukahara², Ichiro Kobayashi¹ (1.Ochanomizu University, 2.Denso IT Laboratory, Ltd.)

Keywords:Image Captioning, Scene Graph

In recent years, image captioning where a caption of an image is generated using deep learning networks hasbeen actively studied. In the early studies, image features extracted from an image are used, but studies usingscene graphs has also been studied aiming at generating captions with attributes and relations of people andobjects in an image. In this study, we conduct a user study to evaluate whether scene graph truly helps to enrichcaptioning. Through user evaluation questionnaires by crowdsourcing, we got a result that scene graph features donot apparently help to enrich captioning, but they are not harmful either.