Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 172360

A Long Short Term Memory (LSTM) is a neural network architecture that contains recurrent NN blocks that can remember a value for an arbitrary length of time.

12 votes
1 answer
17k views

Understanding how to batch and feed data into a stateful LSTM

As I understand how a stateful LSTM works, I could divide my 100 training examples into 4 sequences of 25 examples. … How would I deal with the state of the LSTM when doing so? …
KOB's user avatar
  • 465
4 votes
1 answer
6k views

What is the purpose of unrolling an LSTM into multiple time steps if you can just use a stat...

As far as I understand the follwoing two models are essentially identical: Having a stateful LSTM with just a single time step and passing 10 time-series data points into it one by one, and using the … final output as the prediction for the 11th data point Having a stateless LSTM unrolled into 10 time steps passing the entire 10 data points as input to the corresponding time steps, then using the output …
KOB's user avatar
  • 465
3 votes
0 answers
2k views

When, if at all, to reset the state of an LSTM when training and when testing?

My LSTM takes in as input batches of shape (50, 25, 108). … the state of the LSTM is reset. …
KOB's user avatar
  • 465
2 votes
1 answer
723 views

Stateful LSTM for time-series prediction - should each input sequence be shifted by 1 time s...

I am building an LSTM, to attempt to learn the trend historic trend of some time-series data set (e.g. the daily share price of a company). … I am using a stateful LSTM and hence taking the output state of one batch and inputting it to the state of the next batch, does this mean that my next batch must be [t=25, t=49]? …
KOB's user avatar
  • 465
2 votes
1 answer
191 views

Wrote one of my first Neural Networks thinking I know exactly how it works. Now that I run i...

Now, in a hope to become more familiar with implementing my NNs using TensorFlow, I have decided to write an LSTM using it. … The LSTM I am trying to implement is the well-known example of learning from the entire works of Shakespeare, and then producing its own text in the same style. …
KOB's user avatar
  • 465
2 votes
1 answer
518 views

Testing an LSTM making predictions 1 timestep into the future

Say I have a time series data set of 100 sequential timesteps, and I want to train and test an LSTM on the data set, but only on forecasting a single timestep into the future. … Otherwise, by the nature of how an LSTM works, can I train on the first 80 data points, and then pass in the full length 100 sequence and use the predictions at timesteps 81 - 100 as the test set predictions …
KOB's user avatar
  • 465
1 vote
0 answers
202 views

Written my first LSTM - looking for feedback as well as ways I can improve it's learning abi... [closed]

I have written an LSTM using Tensorflow that reads in sequences of 25 chars from a large text file of Shakespeare's plays. All charatcers are encoded to and from one-hot vectors. …
KOB's user avatar
  • 465
1 vote
0 answers
403 views

Use all unrolled time step predictions in loss/accuracy calculations, or just the last one?

Take for example, I am building an LSTM RNN which takes in 5 features that correlate to the number of sales of a product for that day. … The LSTM takes in sequences of 10 days of these 5 features (it is unrolled to 10 time steps, each receiving 5 features as input), and then attempts to predict the number of sales for the 11th day. …
KOB's user avatar
  • 465
1 vote
1 answer
2k views

Many-to-many or many-to-one LSTM when predicting a value derived from a sequence of features

I build an LSTM that takes in two hours of these sequential data points (24 time steps) and then attempts to predict if the price will have increased/decreased an hour after the last data point fed into … As the LSTM produces an output at each time step, should I be calculating the loss from all 24 of these outputs, or just the last one?. …
KOB's user avatar
  • 465