I have recently started looking more into autoML, where we have a "Controller" system, who outputs architectures and hyperparameters, and is given a reward based on the performance of a system trained using this configuration on a given dataset.
This is of course a very computationally expensive endeavour, since each training step of the Controller has several child networks that need to be trained. However, every time someone runs an autoML task, they will generate dozens if not hundreds of candidate child networks.
Would it be possible, or has it already been done, to have a dataset of child network performance to "bootstrap" an autoML task. This would be a great way to reduce the cost of trying a new autoML architecture.
Are there any downsides anyone can foresee? I have started with the list of Awesome-AutoML-Papers and have not found anything of this nature yet. There have been other efforts to make the process more efficient, such as Pham18 and Liu17, but we still need to start from scratch when trying a new Controller architecture.
