Tagged Questions
0
votes
1answer
215 views
Determining if a set of experimental results is statistically significantly different from zero?
We have a dataset resulting from an experiment with a genotype A and a genotype B, which underwent either treatment X or no treatment Y, for four total sample groups. Each sample group had only three ...
2
votes
0answers
58 views
Conflicting Answers from Marketing Test: Both Answers are Statistically Significant
I'm running a marketing test comparing banner A against banner B against banner C. Each banner received >10million exposures and based on response rate we concluded early in the test that banners B ...
3
votes
4answers
223 views
What if your randomly formed groups are clearly not similar?
What if, before you begin the data collection for an experiment, you randomly divide your subject pool into two (or more) groups. Before implementing the experimental manipulation you notice the ...
2
votes
0answers
65 views
Weighting a control group
In reviewing some market research, I came across a study which decided to weight the results/outcomes of the control group so the distribution of participants in the control sub-groups (0,1,2,3,4,5 - ...
1
vote
1answer
235 views
How to deal with a 2x2 experimental design if the dependent variable is dichotomous?
I am assessing the acceptability of a sentence in a within-subjects design with two crossed factors (type of sentence, missing word). After reading each sentence, the participants answer a simple ...
1
vote
1answer
178 views
Sequential experiment: controlled design and metrics
This is a generic question. Let me put forth an example scenario. Say, I had 2 techniques for allocating my daily budget within 4 stocks. Upon allocation, I get the data about the stock's performance ...
4
votes
1answer
500 views
Data analysis for mixed within-subjects/between-subjects design?
I have run a survey with many respondents. There was a pool of questions, and each respondent was asked 3 of the questions (chosen uniformly at random and independently for each respondent).
Now I'm ...
5
votes
2answers
78 views
Is it a problem that the sizes of randomized groups can differ?
My website has advertising for various companies - say 10,000 companies. Each company has it's own page but all the pages are currently similar except by which company is on the page. A ...
2
votes
3answers
172 views
Testing a binomial model
I have a computational experiment that takes a size parameter $s$ and returns true or false.
It has been suggested that the result of the experiment is independent of $s$, but I don't think so. I ...
1
vote
0answers
61 views
Formulate hypotheses when $\mu_A < \mu_B$ is different from $\mu_A > \mu_B$
I'm testing two different settings (say 'A' and 'B') for a machine. From physical arguments, I know that $\mu_B >= \mu_A$. If really $\mu_B < \mu_A$, there's something fundamentally wrong with ...
7
votes
1answer
115 views
Can someone help me understand what type of problem I am looking at? Not sure if this classifies as hypothesis-testing
Please pardon me if this question is not clear. I am not sure if I am using the right terminologies.
I have conducted an experiment in different environments multiple times. So my data looks ...
