Once I read about one kind of neural network (for classification or feature selection) for a supervised training where you start with all inputs, then you proceed with a training step and randomly (or via criteria) you remove one input feature and then proceed with the training step. If this helps to improve the model, you remove this feature but if this is not the case, you reclaim this feature and remove others and evaluate again.
Also, you start with 1 feature and proceed with the train step. as the process before, you add new features and evaluate if this helps to model or not.
Do you remember the name of this kind of algorithm and have some article describing it or using it?
I have made my own research, and search on my browsing history with no success. Some kind of "pull back" or "push forward" but not back-propagation.