[4I1-GS-7b] 画像音声メディア処理：マルチモーダル処理

[4I1-GS-7b-03] Proposal of method for creating the manual for inheriting agricultural work technology using eye-gaze data and video annotation system

〇Yumana Hirata¹, Masashi Kasamatsu¹, Yukikazu Murakami¹, Hayate Wakisaka¹ (1. National Institute of Technology KAGAWA College)

Keywords:Eye-camera, Image-annotation, Tacit knowledge

In recent years, Japanese agriculture has tended to have a declining working. And there is concern that this tendency would continue to worsen. In order to realize sustainable agriculture, it is necessary to pass on the skills of veteran farmers to novice farmers. However, the opportunities for novice farmers to receive direct guidance from veteran farmers have been decreasing. Therefore, the preparation of agricultural work manuals has become more important. However, many conventional farm work manuals only consist with sentences and images. That's why there is a problem that it is difficult for novice farmers with little experience to understand them intuitively. In response to this, in this study, we used an eye camera and Mask R-CNN, which is one of the instance segmentation algorithms, to see what a veteran farmers sees, based on the difference in the line-of-sight movement between a veteran farmers and a novice farmers. We propose to create a web-based agricultural work succession manual. In this research, we created a web manual for strawberry farming work. As a work process, we took the line of sight of raising seedlings, cutting, flooding, planting, harvesting, and packing, and conducted hearings based on the difference in the line of sight between veteran farmers and novice farmers, and created a manual.