0
$\begingroup$

I am running a conjoint forced-choice survey experiment.

The idea is to interview 500 respondents, that will perform 5 choice tasks choosing between 2 profiles. Profiles are fully randomized.

My question is simple: what is my effective sample size (ESS)?

$ESS= respondents \times tasks \times profiles$

or

$ESS= respondents \times tasks$.

Improve this question
$\endgroup$
3
  • $\begingroup$ To be clear, is each of the 'choice tasks' to pick one of 2 profiles? Please explain how profiles are randomized. Are the same 2 profiles presented for each task, but in different order? Or are there more than 2 profiles altogether? For each subject, how do the tasks differ? If they don't differ, then why 5? // Overview: What is the purpose of the study? $\endgroup$
    – BruceET
    Commented Nov 10, 2021 at 1:16
  • $\begingroup$ Dear @BruceET, thanks for your reply. Exactly, it is a forced choice conjoint experiment, where respondents have to choose between two possible profiles. The study aims to examine the average marginal component effect of each attribute (Hainmueller et al 2014). The profiles are fully randomized. Not only attributes are randomized, but also their order. In every task, respondents are presented with two (fully randomized) profiles. Hence, using more tasks increases the effective sample size. My doubt is whether I should also include the number of profiles per task (2) in computing the ESS $\endgroup$
    – Alex
    Commented Nov 10, 2021 at 9:58
  • $\begingroup$ If profiles are essentially the same measurement for each subject, then (random order or not) I'd regard them as an effect. Seems you have fixed effect Profile, random subjects, five random trials within each subject. Main sample size issue is number of subjects. $\endgroup$
    – BruceET
    Commented Nov 10, 2021 at 16:52

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.