# Tagged Questions

A mathematical quantity designed to measure the amount of randomness of a random variable.

8 views

55 views

### Tensorflow Cross Entropy for Regression?

Does cross-entropy cost make sense in the context of regression? (as opposed to classification) If so, could you give a toy example through tensorflow and if not, why not? I was reading about cross ...
48 views

### Shannon entropy and does missing data affect output

So I am doing analysis based on this paper: http://www.bioline.org.br/pdf?se10001 The author uses Shannon entropy in one part to calculate weights and he uses data which does not come with missing ...
12 views

### Weighting average similarity/correlation values by number of correlations?

I have a dataset containing correlations and other similarity measures between musical performances of which the performer and his nationality etc are known. Now i want to analyse that dataset; ...
16 views

### How to take random draws of a low-entropy “meta-random” distribution

I'm working on a simulation study, and for it I'd like to be able to generate random draws from a random multivariate distribution. I'm looking for something pretty chaotic, in the sense that it's ...
13 views

### Using differential entropy for characterizing a number

I have to come up with a score representing the information related to a number pulled from a a text (IM text). When correctly identified the numbers in our Ims follow a distribution composed of two ...
45 views

### kullback leibler divergence of empirical density and fitted density in R

I have a vector and I used Pareto and Log-normal distribution to get a predicted density function. I am wondering is there any easy ways to calculate the KLD between the true distribution and fitted ...
16 views

### How to deal with missing data when calculating Information Gain

While working on a neural network for classification problem I'm dealing with huge number of possible features and information gain seems like a good way to narrow them down (there are hundreds of ...
9 views

### How to calculate entropy for a specific attribute?

This is super simple but I'm learning about decision trees and the ID3 algorithm. I found a website that's very helpful and I was following everything about entropy and information gain until I got ...