New answers tagged

2 votes

Correct loss function and metric for regression of count data in neural network

The Poisson distribution is one integer-valued distribution among many alternatives. You can experiment with alternative losses. The model's predictions for the Poisson model is the conditional ...
user avatar
  • 78.2k
2 votes
Accepted

Restrict output range of a neuron based on output of other neurons

You can enforce the constraint with an additional transformation. Suppose we have $x_i = \sigma(AH + b)$ where $\sigma$ is the sigmoid activation and $A, b$ are the weights and biases. We can ...
user avatar
  • 78.2k
1 vote

Do value and key of additive attention need to have the same dimension?

In this implementation, yes, but the query and key variables correspond to a linear projection of the decoder and encoder states ...
user avatar
  • 2,376

Top 50 recent answers are included