[2Q5-GS-3] Knowledge utilization and sharing:

[2Q5-GS-3-03] Automated Generation of a Meta-Video Dataset for Human Action Recognition using Commonsense Knowledge Graph

〇Fumiya Mitsuji^1,2, Sudesna Chakraborty¹, Takeshi Morita^1,2, Yuya Yoshikawa³, Yasunori Yamamoto^4,2, Shusaku Egami², Takanori Ugai^5,2, Ken Fukuda² (1. Aoyama Gakuin University, 2. National Institute of Advanced Industrial Science and Technology, 3. Chiba Institute of Technology, 4. Database Center for Life Science (DBCLS), ROIS-DS, 5. Fujitsu Limited)

Keywords:1.Human Action Recognition, 2.Video Datasets, 3.Knowledge Graphs, 4.Data Linking

Constructing meta-datasets that capture the relationships between action labels across different datasets typically requires extensive human annotations. To address this challenge, we propose an approach that automates this process by leveraging common sense knowledge graphs. Specifically, our method aims to extract equivalence relationships between action labels by linking labels from multiple action recognition datasets to the corresponding nodes in common sense knowledge graphs. In this study, we focus on six widely used datasets. To evaluate the effectiveness of our approach, we use precision, recall, and F-measure with the manually constructed MetaVD serving as the ground truth. Additionally, we introduce a simplified evaluation metric, the Average Transferred Precision Gain to assess the performance. Our preliminary results demonstrate the potential of the proposed method for automating the equivalence relationship extraction. Future work will extend this approach to identify additional relationships, such as similarity and hierarchical (is-a) relationships, to enable a more comprehensive automated meta-dataset construction.