10,985 reputation
11228
bio website
location
age 51
visits member for 4 years
seen 3 hours ago

1d
awarded  Yearling
Jan
25
comment How to tell the probability of failure if there were no failures?
If there are few or no failures then $\Theta \sim U(0,0.1)$ will produce almost the same result as $\Theta \sim U(0,1)$ i.e. Beta$(1,1)$, and the latter is easier to handle
Jan
21
comment How to find third quartile from the mean and the standard deviation
Less than $93.8$ (which is $\sqrt3$ standard deviations above the mean), but the actual value depends on the distribution.
Jan
12
comment Density estimation for streams of Data
You could store your data as counts in intervals, where the intervals are substantially narrower than the bandwith you are using for smoothing your kernel. Then you just need to remember as many numbers as there are intervals.
Jan
10
comment Measuring “almost the same” when significantly different
@Glen_b: I am looking for a summary measurement of "closeness" which is insensitive to scale (e.g. multiplying all the data by $10$) and can be used for meaningful comparisons with other splits of the same population by different factors and for comparisons with other cases for example when the success rates change.
Jan
10
comment Measuring “almost the same” when significantly different
There are other similar tables (such as gender, age, and ethnic origin) which show different disparities as well has having a variety of distributions between the size of the largest group and of the others. I was wondering if there was some sensible summary statistic that I had missed which like the $\chi^2$ statistic gave a greater weight to disparities in the larger groups but which was not so dependent on the total number of individuals as the $\chi^2$ statistic. For example the $\chi^2$ statistic divided by the total number of individuals would be unitless.
Jan
9
asked Measuring “almost the same” when significantly different
Jan
9
comment How to find $\displaystyle \dfrac{d}{dt} \left [\int_t^\infty xf(x)~dx \right ] $ (when $f(x)$ is a probability density function)
Use the fundamental theorem of calculus
Jan
9
comment How to find $\displaystyle \dfrac{d}{dt} \left [\int_t^\infty xf(x)~dx \right ] $ (when $f(x)$ is a probability density function)
Do you mean $\displaystyle \dfrac{d}{dt} \left [\int_t^\infty xf(x)~dx \right ]$? Perhaps $-tf(t).$ Or do you mean $\displaystyle \dfrac{d}{dt} \left [\dfrac{\int_t^\infty xf(x)~dx}{1-F(t)} \right ]$?
Jan
8
comment Definitions of quantiles in R
Wikipedia gives the formulae
Jan
3
comment Explanation of formula for median closest point to origin of N samples from unit ball
I suspect it may be suggesting that in high dimensions, points to predict are effectively a long way from the training data, as if on the edge of a sphere, so you are not really interpolating but rather extrapolating, and so uncertainties are much greater. But I do not really know.
Jan
2
answered Explanation of formula for median closest point to origin of N samples from unit ball
Dec
25
comment When to use a normal approximation of a Bernoulli distribution
@Victor - I used the MathJax version of TeX. See meta.math.stackexchange.com/questions/5020/… for some tips
Dec
22
answered When to use a normal approximation of a Bernoulli distribution
Nov
28
comment Using kFold in a regression problem?
It rather depends on what you mean by regression. $k$-fold cross validation is method to help decide the hyperparameters of your method (at an extreme level deciding the method itself) while trying to avoid over-fitting. And you should not be using the test set to compare methods: you should instead be using the results of the cross validation.
Nov
25
answered Negative Binomial Distribution R
Nov
23
comment Area within a given number of standard deviations from given mean
It depends on the shape of the distribution.
Nov
23
comment Rearrange boxplot with ggplot
It may depend on whether you use reshape or reshape2 (you should have mentioned this in your question). As for displaying results, you can show how many 1s and 0s there are or what proportion are 1s.
Nov
23
answered Rearrange boxplot with ggplot
Nov
23
revised Rearrange boxplot with ggplot
show code