Presentation information

General Session

General Session » GS-7 Vision, speech media processing

[4I1-GS-7b] 画像音声メディア処理:マルチモーダル処理

Fri. Jun 11, 2021 9:00 AM - 10:40 AM Room I (GS room 4)

座長:石原 賢太(NEC)

9:40 AM - 10:00 AM

[4I1-GS-7b-03] Proposal of method for creating the manual for inheriting agricultural work technology using eye-gaze data and video annotation system

〇Yumana Hirata1, Masashi Kasamatsu1, Yukikazu Murakami1, Hayate Wakisaka1 (1. National Institute of Technology KAGAWA College)

Keywords:Eye-camera, Image-annotation, Tacit knowledge

In recent years, Japanese agriculture has tended to have a declining working. And there is concern that this tendency would continue to worsen. In order to realize sustainable agriculture, it is necessary to pass on the skills of veteran farmers to novice farmers. However, the opportunities for novice farmers to receive direct guidance from veteran farmers have been decreasing. Therefore, the preparation of agricultural work manuals has become more important. However, many conventional farm work manuals only consist with sentences and images. That's why there is a problem that it is difficult for novice farmers with little experience to understand them intuitively. In response to this, in this study, we used an eye camera and Mask R-CNN, which is one of the instance segmentation algorithms, to see what a veteran farmers sees, based on the difference in the line-of-sight movement between a veteran farmers and a novice farmers. We propose to create a web-based agricultural work succession manual. In this research, we created a web manual for strawberry farming work. As a work process, we took the line of sight of raising seedlings, cutting, flooding, planting, harvesting, and packing, and conducted hearings based on the difference in the line of sight between veteran farmers and novice farmers, and created a manual.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.