Timeline for Siginificant size for a Control Group
Current License: CC BY-SA 4.0
11 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Sep 9 at 13:55 | comment | added | whuber♦ | I would suggest not treating it as a hard constraint, but instead considering the total cost to the business arising from (a) the loss of customers to the control group balanced by (b) the gain of information from the experiment. | |
| S Sep 7 at 23:03 | history | suggested | cottontail | CC BY-SA 4.0 |
improved phrasing, removed signature
|
| Sep 7 at 21:34 | review | Suggested edits | |||
| S Sep 7 at 23:03 | |||||
| Sep 7 at 21:06 | answer | added | J-J-J | timeline score: 3 | |
| Nov 7, 2021 at 6:00 | history | tweeted | twitter.com/StackStats/status/1457226338218254336 | ||
| Jan 24, 2018 at 18:09 | history | edited | mdewey |
edited tags
|
|
| Mar 21, 2014 at 16:14 | comment | added | kyg | Hi Whuber. I should have been more specific with the details. The aim is to compare test and control groups to measure uplift in customers' borrowing amount. Unit of measurement is dollars. The business has a limited number of customers for each experiment and requires (for business reasons) as small as possible a control group so that more customers will be in the test group and be treated with a marketing offer. So it is not really a 'business requirement' but rather a 'business constrain'. Kim-Yen | |
| Mar 21, 2014 at 14:08 | comment | added | whuber♦ | You and your client(s) will be unhappy with the answer: assuming you can supply the information needed to solve this problem, then minimizing the control group size is likely to lead to a prohibitively costly test group size. It's a fact that the variability within the control group is just as important for determining statistical significance as variability within the test group. Thus this "business requirement" is counterproductive: you ought to work to replace it with a statistically effective requirement that actually works for the business objectives rather than against them. | |
| Mar 21, 2014 at 14:05 | history | edited | whuber♦ |
edited tags
|
|
| Mar 21, 2014 at 7:02 | review | First posts | |||
| Mar 21, 2014 at 7:05 | |||||
| Mar 21, 2014 at 6:47 | history | asked | kyg | CC BY-SA 3.0 |