Hyperparameter optimization for Deep Learning Structures using Bayesian Optimization
I have constructed a CLDNN (Convolutional, LSTM, Deep Neural Network) structure for raw signal classification task. Each training epoch runs for about 90 seconds and the hyperparameters seems to be very difficult to optimize. I have been research various ways to optimize the hyperparameters (e.g. random or grid search) and found out about Bayesian Optimization. Although I am still not fully understanding the optimization algorithm, I feed like it will help me greatly. I would like to ask few questions regarding the optimization task. How do I set up the Bayesian Optimization with regards to a