[4I2-OS-1a] AutoML（自動機械学習）

[4I2-OS-1a-04] On the Study of Search Space Design for Neural Architecture Search with Weight Sharing

〇Youhei Akimoto^1,3, Shinichi Shirakawa² (1. University of Tsukuba, 2. Yokohama National University, 3. RIKEN Center for Advanced Intelligence Project)

Keywords:NAS, AutoML

Neural Architecture Search (NAS) aims to automatically design the structure of a deep neural network in an exploratory manner, which is conventionally designed by experts. Weight sharing (WS)-based NAS is known to be a time-efficient NAS approach because it simultaneously learns the neural network structure and weight parameters in a single training session. However, WS-based NAS has been observed to have a problem that the search may converge to an architecture with significantly low final performance depending on the design of the search space --- the set of possible combinations of operations. The design of an appropriate search space is task-dependent, and the user must carefully design it, which hinders the application of WS-type NAS. In this study, we show a simple modification to the aggregation operation in the search space helps to mitigate the above mentioned issue.