Presentation information

General Session

General Session » GS-2 Machine learning

[4G2-GS-2k] 機械学習:基礎理論

Fri. Jun 11, 2021 11:00 AM - 12:40 PM Room G (GS room 2)

座長:谷口 忠大(立命館大学)

12:00 PM - 12:20 PM

[4G2-GS-2k-04] Exploring knowledge transfer graphs by introducing design space refinement method with human-in-the-loop

〇Sachi Iwata1, Soma Minami1, Tsubasa Hirakawa1, Takayoshi Yamashita1, Hironobu Fujiyoshi1 (1. Chubu University)

Keywords:Deep Learning, Knowledge Distillation

Deep collaborative learning is a method of transferring knowledge between multiple networks. Knowledge transfer graph has been proposed as deep collaborative learning that makes a rich in diversity of knowledge transfer. However, designing a knowledge transfer graph is difficult due to many combinations, so it is not clear the trend for highly accurate knowledge transfer graphs. To address this problem, we propose a method for designing search space with human-in-the-loop for knowledge transfer graph. We analyze the trend of graphs and designing graphs with high accuracy based on the acquired results. The experimental results with CIFAR-100 show that the search space explored by the proposed method is better than that of deep mutual learning. We confirmed that the accuracy of the best knowledge transfer graph in the search space is better than that of using the asynchronous successive halving algorithm.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.