Piotr Migdal's user avatar
Piotr Migdal's user avatar
Piotr Migdal's user avatar
Piotr Migdal
  • Member for 12 years, 6 months
  • Last seen more than 2 years ago
91 votes

What is a data scientist?

73 votes

What is the role of the logarithm in Shannon's entropy?

28 votes
Accepted

Qualitively what is Cross Entropy

26 votes

Can mutual information gain value be greater than 1

20 votes
Accepted

LDA vs word2vec

19 votes

What does "a distribution over distributions" mean?

16 votes
Accepted

Entropy-based refutation of Shalizi's Bayesian backward arrow of time paradox?

14 votes
Accepted

Does this quantity related to independence have a name?

14 votes

How does the log(p(x,y)) normalize the point-wise mutual information?

10 votes
Accepted

What is the correlation of [1,2,3] and [1,5,7] to 8 decimal digits?

9 votes
Accepted

Entropy of generalized distributions?

9 votes

Does correlation imply mutual information?

5 votes
Accepted

A framework for multi-valued categorical attributes

5 votes

Community detection in mobile social network

5 votes
Accepted

Visualize sets and their connections

4 votes
Accepted

Bar plots with variable bases (intensive and extensive variables at once)

4 votes

Matrix Factorization Recommendation Systems with Only "Like" Ratings

3 votes

Clarification: Are Generative Adversarial Networks an alternative to MCMC sampling?

3 votes
Accepted

Markov chains: how to validate a state-transition probability matrix on new data?

3 votes

How to estimate a chance of getting in the first positions, given previous tries?

3 votes

What is the meaning of the eigenvectors of a mutual information matrix?

3 votes

Measuring entropy/ information/ patterns of a 2d binary matrix

3 votes

Interpreting Shannon entropy

3 votes

Number of needed samples for entropy estimation

3 votes

Hidden Markov models with Baum-Welch algorithm using python

3 votes
Accepted

Continuous joint entropy with fully dependent variable

3 votes
Accepted

When and why does the "brittleness" of mutual information cause overfitting?

3 votes

How to calculate burstiness?

2 votes
Accepted

Difference between different kinds of entropy

2 votes
Accepted

Renyi divergence identity