3
$\begingroup$

In "Neural architecture search with reinforcement learning" (https://arxiv.org/pdf/1611.01578.pdf), the authors use a recurrent neural network as the controller to generate hyperparameters, but do not describe the architecture of the controller in detail.

  • How are the predictions for each hyperparameter made? The paper says that softmax is used and hyperparameters are generated sequentially (first filter width/height, then stride width/height, etc., then repeating for the next layer). Thus, what architecture allows predictions to be made sequentially in such a way?
  • How are the skip connection sigmoids incorporated into this architecture?
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.