8
$\begingroup$

I have a number of samples of different sizes from a population of unknown size. The data are market shares for five different products within a category (so they sum to 1). I want to know how many observations I need for the configuration of shares in a sample to be a reasonable approximation of the configuration of shares in the population.

I have read this: Sample size for categorical data, but I have priors about what the shares look like (that is, I don't want the "worst case" configuration of shares). Is there a way to calculate n* for alpha = .05, d = .05 and some a priori configuration of proportions?

$\endgroup$
1
  • $\begingroup$ How do you define what constitutes a "reasonable approximation"? $\endgroup$
    – Glen_b
    Commented Aug 19, 2015 at 0:45

1 Answer 1

5
$\begingroup$

Thompson, 1987, doesn't address this directly, but did consider an algorithm for specific configurations of the probabilities. He was looking for the worst case scenario when the bounds of error were not constant, and suggested a search over many configurations.

Here is my modification of Thompson's algorithm. This version reduces the search to your a priori configuration and, perhaps, some near neighbors.

  1. Select a set of vectors $P =(P_1,P_2,P_3,P_4,P_5), \sum_j P_j=1)$, which are plausible according to your a priori beliefs. You state that you have one configuration in mind, and it is likely that small departures from that configuration will have little effect on the calculation. Still, I recommend that, for safety, you consider plausible departures from this configuration.

  2. Choose an overall $\alpha$ level and bound on error $d_j$ for estimating $P_j$. Your question has $d_j = 0.05$ and $\alpha = 0.05$.

If $p_j$ is the sample proportion for category $j$, a simultaneous $1-\alpha$ confidence for the $P_J$ will be of the form:

$$ \left[\,p_j -d_j,\, p_j +d_j\,\right] $$

with the desired property that

$$ \text{Pr}(|\,P_j - p_j\,| > d_j\text{, for any j}) \le \alpha. $$

  1. Compute the worst case $n$ for your $\alpha$ from the table in Sample size for categorical data

  2. Starting from your initial configuration of probabilities , compute $\sum \alpha_j$, where $\alpha_j = 2(1-\Phi(z_j))$ and

$$ z_j = \frac{ d_j\sqrt{n}}{\sqrt{P_j(1-P_j)}} $$

($ 1- \Phi(z)$ is the probability that a standard Normal variable is $\ge z$.)

If $\sum \alpha_j< \alpha$, repeat with a smaller value of $n$. If $\sum \alpha_j>\alpha$, repeat with a larger value, until the smallest $n$ is found such that $\sum \alpha_j \leq \alpha$

  1. If you believe in your initial configuration, you can stop there. Otherwise repeat for every vector of probabilities in your plausible set and choose the largest $n$.

Reference

Thompson, Steven K. 1987. Sample size for estimating multinomial proportions. The American Statistician 41, no. 1: 42-46.

$\endgroup$
3
  • $\begingroup$ Steve Samuels, if you are still reading this, how did come wit the z_j formula, and why a_j should be equals to 2*(1-Phi(z_j)), especially why 2? $\endgroup$
    – McKracken
    Commented Aug 29 at 14:04
  • $\begingroup$ I know Steve Samuels well enough to say that he's retired and not (obviously) active any more in communities he was active in. $\endgroup$
    – Nick Cox
    Commented Sep 5 at 11:45
  • $\begingroup$ Thanks Nick. I'm struggling to get some of the rationale behind this approach, which may be very significant to me. Do you have any clues about it? I'm also trying to get in touch with the author of the question (Nate), since it looks like he accepted the answer, so he may have grasped the rationale I'm looking for. I'll post under the question, so maybe he will notice. $\endgroup$
    – McKracken
    Commented Sep 6 at 8:49

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.