[3N1-IS-2d] Machine learning (4/5)

[3N1-IS-2d-03] Audio Guide Text Generation of Manual Information for Repairing Precision Equipment

〇Yuriko Yamaya¹, Shintaro Kawamura¹, Seigo Harashima¹, Shinya Iguchi¹ (1. Ricoh Co., Ltd.)

キーワード：Multi Modal, Text Generation, Repair Support, Manual Utilization

One of the major tasks of the customer engineers by precision equipment manufacturing industries is to repair the customers’ machines. In case they encounter unknown or difficult procedures, they need to check manuals during repairing it. Furthermore, their works are often done at narrow spaces and make their hands dirty, so there is strong needs on hands-free guides, such as audio text guide. In manuals, there are not only the texts but also images which show the engineers the positional relationships between a target part and the peripheral parts, and the directions of which the target part can be moved. That is, the text of the manuals is insufficient to carry out their work.
We propose to generate procedure explanation in texts for hands-free guides, by acquiring the information on the relationship between the target part and peripheral parts from the images and adding them to the information on the target part operation.