5
$\begingroup$

Given an underlying unknown distribution, I sample $N$ numbers. From those $N$ numbers I take the highest $k$ numbers. How do I model the posterior probability from those $k$ numbers.

I know I can do it if I just get any random $k$ numbers. I would have a prior and update my belief that is posterior based on the observed data, but how do I further exploit the knowledge of top $k$ ?

I have very basic knowledge about prior and posterior. Any resource to guide me through would be heplful as well.

An example of my problem is, I know $N(0, 1)$ to generate 1000 random samples from $N(0, 1)$. I take the top 10 numbers from the 1000. I want to understand how my posterior would be different when I just get any 10 random numbers from the 1000 samples from the estimate when I know that I got top 10 numbers.

$\endgroup$
3
  • 1
    $\begingroup$ Posterior probability of what? Is this a Bayesian problem where the underlying unknown is parametrized with unknown parameters and you are looking at the posterior probability of these parameters? (That's what I'd think from the first 3 paragraphs, but the last paragraph does not mention any unknown parameters). If my understanding is correct, do you have some specific case in mind? $\endgroup$ Oct 27, 2016 at 5:27
  • $\begingroup$ Yeah my underlying distribution in this case is a normal distribution with a particular mean and variance and I am trying to estimate it. I want to estimate the parameters given the scenario above. In sum, I want to know how to write the probability of a given number of being at i-th index if N draws have been made from underlying distribution. $\endgroup$
    – learner
    Oct 27, 2016 at 5:35
  • 1
    $\begingroup$ Mean and variance both are unknown? The current title is somewhat misleading (this would be the posterior probability (distribution) of the mean and variance (based on this ordered set , not the posterior probability of o)) - I suggest something in the lines of "Posterior probability when data consists of $k$ largest of $N$ samples" $\endgroup$ Oct 27, 2016 at 5:41

1 Answer 1

1
$\begingroup$

Let us take your example of a Normal sample: if you observe the $k$ largest Normal values of a Normal $\mathrm{N}(\theta,1)$ sample of size $N$, the likelihood of this sample is $$\ell(\theta|x_1,\ldots,x_k)=\Phi\left(\min_{1\le i\le k}\{x_i\}-\theta\right)^{N-k}\,\prod_{i=1}^k \exp\left\{-(x_i-\theta)^2/2\right\}$$where $\Phi$ is the Normal cdf. Once you have derived this likelihood, business (or rather bayesness!) proceeds as usual: the posterior distribution is $$\pi(\theta|x_1,\ldots,x_k)\propto\pi(\theta)\Phi\left(\min_{1\le i\le k}\{x_i\}-\theta\right)^{N-k}\,\prod_{i=1}^k \exp\left\{-(x_i-\theta)^2/2\right\}$$ This is not a closed-form likelihood but it can be handled through simulation, either using a simple Metropolis-Hastings algorithm with a numerical computation of the Normal cdf, or using a Gibbs sampler that generates $N-k$ latent Normal variates constrained to be less than $\min_{1\le i\le k}\{x_i\}$.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.