2
$\begingroup$

I am currently trying to solve a regression problem using neural networks. I want to detect movement patterns in images over time (video) and output a continuous value for different medical indices. After training a network I used the training data to predict outputs to make sure the network learned the patterns correctly, but I noticed something strange.

The model is able to track the course of the expected reference values, but cannot seem to predict the correct absolute values (see image below). It seems like the predictions are shifted a certain value below the reference values. What can I do to make my network predict the correct y-axis values? (Adding a bias would probably do the trick, but it is definitely not the best solution.)

The network topology:

  • TimeDistributed(Conv2D(32, (3,3)))
  • TimeDistributed(Conv2D(16, (3,3)))
  • TimeDistributed(Flatten())
  • GRU(64, stateful=True)
  • Dropout(0.5)
  • Dense(64, activation='relu')
  • Dense(1)

The image below displays two curves: one for the expected reference values (orange) and one for the predictions made by the network (blue). The plots represent the continuous predictions for every training data sample. enter image description here

Any hint would help me out a lot, thank you!

$\endgroup$
2
  • 1
    $\begingroup$ Welcome to CV. On this site there's no need to say "thank you" at the end of your post - it might seem rude at first, but it's part of the philosophy of this site (tour) to "Ask questions, get answers, no distractions" and it means future readers of your question don't need to read through the pleasantries. $\endgroup$ Commented Mar 6, 2018 at 14:00
  • $\begingroup$ Two questions for you: first, are you mean-removing when you train? Second, do you include bias weights on your final layer? You should try adding bias weights to the output layer at least to see if it fixes the offset issue. $\endgroup$
    – T3am5hark
    Commented Apr 6, 2018 at 20:33

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.