famargar
• Member for 5 years, 1 month
• Last seen more than a week ago

12k views

Indeed you can use Patsy with scikit-learn to obtain the same results you would obtain with R, or with the formula notation in stats models. See code below: from patsy import dmatrices # create ...

2k views

The three parameter gamma distribution is needed only when you need to shift the distribution itself. In the two-parameter gamma distribution, you could read the shape parameter as a proxy of the most ...

47 views

It seems like your problem is actually supervised problem; to be more precise, a two-class classification problem: either the point has some property, or it does not. You are coloring the data points ...

23k views

1) Nature isn't always simple. In fact, most phenomena (outcome) we study depend on multiple variables, and in a complex manner. An inferential model based on one variable at a time will most likely ...

127 views

Not sure I fully understand the question. If the question is how to choose the sample of people to offer the free trial, I would start by analyzing the properties of customers that paid the service ...

766 views

There are many good answers here. I’ll just add here the general point to be made. You can summarise a distribution of values with a single number, the mean (or even two, say the standard deviation) ...

1k views

You are misinterpreting the p-value. It actually represents the probability to observe a certain effect or stronger (in your case a correlation) if the null hypothesis - i.e. no correlation - is the ...

334 views

Observing a distribution that is actually the convolution of two or more distinct distributions is very common. In general, you can be observing the same phenomenon for a single population, but ...

507 views

Typically, the “business use” of a classifier depends on sensitivity and specificity, not on AUC. What you have is to model with same average performance (what the AUC measures) but one is optimal at ...

6k views

Data is Latin for given, that is used in modern times as a shorthand for given set of recorded facts. So in a way referring to fabricated recordings as some sort of given facts would be an open ...

830 views

Did you try plotting the data in log-log scale? It may be that the small correlation becomes very discernible on a log-log scale. Just remember to add 1 when log-transforming: x -> log(x+1) I don’t ...

851 views

You properly say that the distribution is bimodal. A perhaps slightly more articulated analysis would be to try to measure the relative contribution of the two subsamples (promoters and detractors) ...

7k views

Trying a linear regression will teach you something about this relation, as suggested in the first answer. Since It looks like you are using python plus matplotlib for this plot, you are one line of ...

1k views

One option is to down-sample you majority class - i.e. randomly throwing away events belonging to the majority class. That is of course feasible only if you have large enough data to afford this. An ...

467 views

Standardization (or normalization using Student's t statistics, to use a longer name) is a good practice if you don't want your machine learning algorithm to improperly assign a larger relevance to ...

30 views

Keeping the assumption that human-derived severity score is the "truth" label about the severity of the disease, then your approach is correct, and the only question left is "is there a possibility ...

125 views

It seems like you would like to build a new variable "hospital visit cost" that is the result of a regression model whose independent variables are a categorical variable "hospital stay type" (...

798 views

I wonder if you tried fitting your data with something like a powerlaw distribution ($ax^{-b}$ with both $a$ and $b$ positive) or its discrete equivalent, Zeta or Yule-Simon distribution (thanks ...

67 views