Hot answers tagged bayesian
7
Expanding on my comment; let's simplify. Suppose there is one Boolean variable A. Suppose that, if the animal is a chicken, A is true 60% of the time and, if the animal is a penguin, it is true 10% of the time.
Now given A, what is the probability it is a chicken?
No way to know. We could have
1000 chickens - 600 with A = 1 and 400 with A = 0
10 penguins ...
5
The reason you don't have the same epiphanic look on your face as that guy is I think that . . . the statement isn't true.
A null hypothesis is the hypothesis that any difference between the control and experimental conditions is due to chance.
An uninformative prior is meant to state that you have prior data on a question, but that it doesn't tell you ...
5
I'd not heard of the Barber book before, but having had a quick look through it, it does look very very good.
Unless you've got a particular field you want to look into I'd suggest the following (some/many of which you've probably already heard of):
Information theory, inference and learning algorithms, by D.J.C Mackay. A classic, and the author makes a ...
4
The problem arises because the negative binomial distribution can be formulated differently. As a consequence, the expectation differs for different formulations. The way you have specified the negative binomial distribution, the expectation of $n$ is $E(n) = m/\theta$ (e.g. see here on page 3). With that, the Fisher information simplifies to $$I(\theta) = ...
3
I'm the one that created the graphic, though as noted in the accompanying post it's not originally my insight. Let me provide some context for how it came up and do my best to explain how I understand it. The realization occurred during a discussion with a student who had mostly learned the Bayesian approach to inference up to that point. He was having a ...
2
See this Wikipedia article:
For the case of a single parameter and data that can be summarized in
a single sufficient statistic, it can be shown that the credible
interval and the confidence interval will coincide if the unknown
parameter is a location parameter (...) with a prior that is a uniform
flat distribution (...) and also if the unknown ...
2
From your link:
Confusion of the inverse, also called the conditional probability fallacy or the inverse fallacy, is a logical fallacy whereupon a conditional probability is equivocated with its inverse
i.e. this is where you make the mistake of thinking P(A|B) is the same as P(B|A).
The likelihood is, however, not regarded as a conditional ...
2
The null hypothesis isn't equivalent to a Bayesian uninformative prior for the simple reason that Bayesians can also use null hypotheses and perform hypothesis tests using Bayes' factors. If they were equivalent, Bayesians wouldn't use null hypotheses.
However, both frequentist and Bayesian hypothesis testing incorporate an element of self-skepticism, in ...
2
This is a fairly straightforward example to check for one simple reason: Your prior is the conjugate prior for Poisson data. Your prior $\lambda \sim Exp(1)$, can be written as a Gamma distribution, because $$\lambda \sim Exp(1) \Rightarrow \lambda \sim \Gamma(1,1).$$
The posterior distribution should then also be a Gamma. I won't go through the math on it, ...
1
Bayesian and Frequentist statistics rest upon a different understanding of what a probability distribution is. To a Bayesian, probability reflects degree of belief. The purpose of an experiment (or data collection) is to update one's beliefs about the parameter values of the system. And since our beliefs concern parameters (unknown) rather than data (which ...
1
Let us consider a more general case with arbitrary $\sigma$-fields $\mathcal{B}\subseteq\mathcal{A}$, $\mathcal{T}\subseteq\mathcal{S}$ and $\mathcal{M}\subseteq\mathcal{A}\otimes\mathcal{S}$ and a combined conditional/marginal experiment
$$
\mathcal{E}^\mathcal{M}_{\mathcal{B}\vee\mathcal{T}}=\left(A\times ...
1
########################################################################################
#These values for n, m, x, y,a, and b are just randomly chosen for illustration. These values will come from your data
n = 100
m = 100
x = rbinom(n,1,.7)
y = rbinom(m,1,.3)
a = .2
b = .1
...
1
A quick Google search led me to this article: Estimating the Correlation in Bivariate Normal Data With Known Variances and Small Sample Sizes. In this article, they discussed several possible priors: "uniform", "Jeffreys", and "arc-sine". Specifically, take the "uniform" prior for example, it assumes that $\rho$ follows a uniform distribution on $[-1,1]$.
...
1
I think the most appropriate summary for this application is just to simply state that the years were 15% different, ± some uncertainty. Here's why: first, the concept of statistical significance per se doesn't fit naturally into the Bayesian framework; second, in this application it's not really plausible that the parameter takes the exact same value in the ...
1
As far as I know, no such book exists yet as the area is still quite new. The couple Bayesian nonparametrics books I've seen are basically just a bunch of review papers from various researchers bound together.
If you have a PhD in math, applied or not, I'm sure you can get your head around by reading the standard papers.
Probably the gentlest yet most ...
1
Not sure that is a helpful question:
EC2 pricing is clearly described by the vendor.
Relative speed to your desktop is an empirical question. Why not measure it?
"Particularly suited to running occassional R and JAGS simulation" is not a questions, could you be more focused here?
It obviously takes longer to run them sequentially. But then you knew that, ...
1
It depends on the specific naive model you apply. In general, for Text Classification, you do want to consider repetition of terms, so the answer is yes.
The other point is that you are considering the probability based on the document event space. You can also do it based on the term space:
p(viagra | spam) = 5 times spam term in class spam / 50 terms in ...
1
I am not directly familiar with Generalised Wishart Processes, but I have recently been working with the Wishart Affine Stochastic Correlation (WASC) model and hence "ordinary" Wishart processes in continuous time. The parameter corresponding to $\nu$ is usually called $\beta$, here. In fact, $\beta$ can be a real number with $\beta > n-1$ for the model ...
Only top voted, non community-wiki answers of a minimum length are eligible
