We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [keras]

Open source high-level neural network library for Python and R. Is capable of using TensorFlow or Theano as backend.

Filter by
Sorted by
Tagged with
176
votes
4answers
258k views

What is batch size in neural network?

I'm using Python Keras package for neural network. This is the link. Is batch_size equals to number of test samples? From ...
13
votes
1answer
1k views

Why can't a single ReLU learn a ReLU?

As a follow-up to My neural network can't even learn Euclidean distance I simplified even more and tried to train a single ReLU (with random weight) to a single ReLU. This is the simplest network ...
1
vote
1answer
3k views

Time steps in Keras LSTM

My understanding of time-series LSTM training is that the recurrent cell gets unrolled to a specified length (num_steps), and parameter updates are back-propagated ...
70
votes
2answers
46k views

How does Keras 'Embedding' layer work?

Need to understand the working of 'Embedding' layer in Keras library. I execute the following code in Python ...
65
votes
6answers
70k views

What loss function for multi-class, multi-label classification tasks in neural networks?

I'm training a neural network to classify a set of objects into n-classes. Each object can belong to multiple classes at the same time (multi-class, multi-label). I read that for multi-class problems ...
21
votes
5answers
9k views

How do I make my neural network better at predicting sine waves?

Here, have a look: You can see exactly where the training data ends. Training data goes from $-1$ to $1$. I used Keras and a 1-100-100-2 dense network with tanh activation. I calculate the result ...
9
votes
2answers
8k views

How the embedding layer is trained in Keras Embedding layer

How is the embedding layer trained in Keras Embedding layer? (say using tensorflow backend, meaning is it similar to word2vec, glove or fasttext) Assume we do not use a pretrained embedding.
3
votes
0answers
448 views

Why ReLU activation cannot fit my toy example - sinus function (Keras) [closed]

I have a toy example of modeling sinus function using simple FC layer NN. My input data is just 150 data points uniformly randomized in range from 0 to 10. I started from fiting NN using ...
3
votes
1answer
884 views

Bad performance with ReLU activation function on MNIST data set

I'm quite new to neural networks and currently I'm trying to train a non convolutional neural network on the MNIST data set. I'm observing some behaviour I don't quite understand. This is the code ...
9
votes
1answer
612 views

My neural network can't even learn Euclidean distance

So I'm trying to teach myself neural networks (for regression applications, not classifying pictures of cats). My first experiments were training a network to implement an FIR filter and a Discrete ...
4
votes
1answer
3k views

Difference Between Rho and Decay Arguments in Keras RMSprop

I am working to tune a RNN for the purposes of predictive analytics on time series data. I am testing different optimizers and am currently working with RMSprop. I have reviewed Hinton's lecture ...
3
votes
1answer
2k views

what is the difference between binary cross entropy and categorical cross entropy? [duplicate]

So, I made a bidirectional LSTM model for sentiment classification. Model's job was to predict ratings of movies(1-5 stars) based on the movie review. While training the model I first used ...
1
vote
1answer
91 views

Reproducible numbers in Keras/TensorFlow

Every time I run a Keras/TensorFlow code gives different results. Can someone suggest how to get reproducible numbers?
1
vote
1answer
546 views

How to add more inputs to a CNN?

What would be the correct approach to add additional inputs that aren't images, e.g. time, to the CNN. I initially thought of adding more inputs to one of the densely connected layers at the end of ...
0
votes
1answer
318 views

Feasibility of a neural network fitting a specific multivariate quadratic function? [duplicate]

I have run into some problems when trying to train a network that fits some multivariate quadratic function, or the Euclidean distance between 2 points in a 3-dimensional space, where they are 'pretty ...
0
votes
1answer
98 views

Training error not decreasing on the training set

I cannot make my neural network - MLP with 1 hidden layer fit the training data perfectly. Here is the data: ...