1
$\begingroup$

I am looking at developing an algorithm that would automatically grow the structure of a neural network by adding/deleting units within a layer, or adding layers as necessary.

I researched the topic and only found literature from before 2000. I was somewhat aware of it, being old enough to have come across some of them when they were published. What I found is mostly interested in neuron-by-neuron construction. I didn't find anything layer-by-layer.

I have searched for more recent papers, including in the deep learning space and have drawn a blank.

I wrote a draft blog article laying out my thoughts (https://emmanuel-r8.github.io/post/neural-network-incremental-growth.html). I will carry on researching the topic. But I am looking for references that would tell me that it is either a blind alley or expand my horizons.

$\endgroup$

1 Answer 1

0
$\begingroup$

This might be useful: https://www.amazon.com/SORN-Self-Organizing-Recurrent-Neural-Network-ebook/dp/B00X1FIHCO And this : https://pypi.org/project/sorn/

$\endgroup$
4
  • $\begingroup$ Thank you. One of the citations also looks interesting: papers.nips.cc/paper/… $\endgroup$ Commented Oct 24, 2019 at 13:35
  • $\begingroup$ More generally, NIPS has quite a few more references (although not quite on point. But no doubt I'll find many ideas!): papers.nips.cc/search/?q=self-organizing $\endgroup$ Commented Oct 24, 2019 at 13:45
  • 1
    $\begingroup$ Could you give full references in case the links go dead in the future? Short summaries of the content of each would be helpful, too. Thank you. $\endgroup$ Commented Oct 24, 2019 at 14:41
  • $\begingroup$ I made the comment based on the papers' title. I'll comment more when I have read the papers. $\endgroup$ Commented Oct 25, 2019 at 0:31

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.