Linked Questions

1
vote
0answers
15 views

Using LSTM to predict next number [duplicate]

I trying to understand working of LSTM So I'm doing simple code to simulate its action. ...
354
votes
7answers
311k views

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?

In some literature, I have read that a regression with multiple explanatory variables, if in different units, needed to be standardized. (Standardizing consists in subtracting the mean and dividing ...
232
votes
8answers
162k views

What should I do when my neural network doesn't learn?

I'm training a neural network but the training loss doesn't decrease. How can I fix this? I'm not asking about overfitting or regularization. I'm asking about how to solve the problem where my ...
5
votes
3answers
8k views

When should normalization never be used?

Lately, there have been numerous questions about normalization What are some of the situations where you never ever ever should normalize your data, and what are the alternatives?
5
votes
3answers
4k views

Are deep neural networks robust to outliers?

Tree based models such as (gradient boosting or random forest) have a lot of advantages, such as robust to collinearity and outliers. I can see deep neural networks (MLP) are robust to collinearity. ...
4
votes
1answer
11k views

What does “Mean of each pixel over all images” mean?

I was reading a paper related to Auto encoders for my project work. It is required to input images as vectors to the neural network. I couldn't understand a certain sentence due to lack of knowledge ...
3
votes
1answer
712 views

Neural Networks input data normalization and centering

I'm learning Neural Networks and I grasped the algebra behind them. I'm now interested in understanding how normalization and centering of the input data affect them. In my personal learning project (...
3
votes
3answers
824 views

Newbie to neural networks [closed]

Just starting to play around with Neural Networks for fun after playing with some basic linear regression. I am an English teacher so don't have a math background and trying to read a book on this ...
1
vote
1answer
558 views

What characteristics should the input data have for a neural network?

I am planning to use a neural network for prediction. For example, to predict whether a student will pass a course based on his previous academic records or characteristics. I was wondering how to ...
1
vote
1answer
708 views

Standardization in neural network online training

It is common knowledge that the inputs to a neural network should be standardized to have mean 0 and variance 1 (see this thread for example, or the LeCun paper). And as long as one does batch ...
1
vote
1answer
557 views

ANN: Weights grow very large, can I scale them?

I have written an ANN algorithm. And after several iterations my weights grow largely and there's this error which says the value of them is overflowing and therefore the outputs are NaNs. Does it ...
0
votes
1answer
75 views

What are some things to try when you are struggling to get a model to “learn”?

I'm using Caffe to train a CNN on a fairly large image set at work. It's about 200K images consisting of profile photos people upload to our app. The labels are either "approve" or "reject" based on ...