Linked Questions

29
votes
3answers
41k views

Training loss increases with time [duplicate]

I am training a model (Recurrent Neural Network) to classify 4 types of sequences. As I run my training I see the training loss going down until the point where I correctly classify over 90% of the ...
0
votes
1answer
7k views

Setting up a MLP for binary classification with tensorflow [duplicate]

I have some troubles trying to set up a multilayer perceptron for binary classification using tensorflow. I have a very large dataset (about 1,5*10^6 examples) each with a binary (0/1) label and 100 ...
0
votes
0answers
4k views

improving fitting results of neural network [duplicate]

I've trained fitnet network for prediction steel's yield stress with MATLAB ann toolbox. The neural network should predict yield stress. I have about 250 vector ...
1
vote
1answer
2k views

My loss is either 0.0 or randomly very high - Tensorflow [duplicate]

I am making a CNN with 6 classes. The 8400 training samples are batched into 84 batches of size 100. I run the model and print out the loss after every batch, the loss is always either 0.0 or some ...
1
vote
1answer
1k views

Neural Network cannot learn a simple function [duplicate]

I am trying to train a simple neural network for regression, where the underlying function is a quadratic. Training data is generated by this underlying function, and I am just trying to get a network ...
1
vote
1answer
1k views

Does not being able to overfit a single training sample mean that the neural network architecure or implementation is wrong? [duplicate]

Is the following hypothesis true ? If a simple neural network cannot overfit a single training sample, there is something wrong with its architecture or its implementation. To give you more ...
1
vote
0answers
2k views

Tuning a neural network [duplicate]

I have been designing a neural network to perform predictions on construction item costs. I've developed a core set of predictors that seem to describe the problem space well - they appear to be ...
2
votes
2answers
2k views

Getting a constant answer while finding patterns with neuralnet package [duplicate]

I'm trying to find patterns in a large dataset using the neuralnet package. My data file looks something like this (30,204,447 rows) : ...
0
votes
0answers
2k views

Keras - LSTM loss increasing for each epoch [duplicate]

I'm using Keras to build and train a recurrent neural network. ...
2
votes
0answers
1k views

Loss and dropout in deep learning [duplicate]

I have a CNN with 3 convolutional layers, 1 max-pooling layer and 2 fully-connected layers before applying softmax classification. The CNN is trained with Adagrad and I achieve a quite good ...
0
votes
0answers
1k views

Why MSE of this MATLAB neural network is so high? [duplicate]

I'm using this code to train a neural netowrk in MATLAB: ...
0
votes
0answers
1k views

How to improve this simple neural network in keras for non-linear regression? [duplicate]

I am training a simple neural network in keras to fit my non-linear thermodynamic equation of state. I use backpropagation and stochastic gradient. The network approximates the equation of state but ...
1
vote
1answer
667 views

How to design a fitness function for an evolving neural network? [duplicate]

I'm working on making my own neural network using the NEAT algorithm. I have programmed the algorithm from scratch because I can't seem to get any of the libraries online working, but I'm 90% sure the ...
3
votes
2answers
751 views

Neural Network for sound classification [duplicate]

I am currently trying to automate some identification process of characteristic noise sounds. For acoustic feature, I calculate MFCC. I have downloaded a free MATLAB toolbox from Dan Ellis'es website. ...
2
votes
0answers
958 views

Neural network weights explode in linear unit [duplicate]

I am currently implementing a simple neural network and the backprop algorithm in Python with numpy. I have already tested my backprop method using central differences and the resulting gradient is ...

15 30 50 per page
1
2 3 4 5
9