1:30 PM - 1:50 PM
[3J3-OS-3a-01] Local Search with Multi start for Hyperparameter Optimization of Deep Learning
Keywords:Hyperparameter Optimization, Local Search, Deep Learning
In deep learning, hyperparameters can severely affect the learning model performance. Hyperparameter optimization (HPO) is one of the promising techniques to maximize the performance of the learning model. It has been reported that the Nelder-Mead method shows superior performance to other optimization methods in the HPO of deep learning. However, the Nelder-Mead method may converge bad local minima because this method is a local search heuristic using a simplex. This problem may be tackled using multi start to start from the different initial values. In this paper, we investigate the effectiveness of the multi start in several HPO problems of deep learning. The results show that the search performance of the Nelder-Mead method is improved by applying the multi start.
Authentication for paper PDF access
A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.