# Comparing two means: Same group, different variance (Welch's t-test?)

Intro:

I have recently made a simulation program which simulates patients with Type 1 diabetes. In that context I am creating artifical patients. Let's denote three of these as $\text{p}_1$, $\text{p}_2$, and $\text{p}_3$. Assume that $\text{p}_1$, $\text{p}_2$ and $\text{p}_3$ are treated with treatment $A$. Treatment $A$ treats $\text{p}_1$, $\text{p}_2$ and $\text{p}_3$'s diabetes to a certain degree. We evaluate the treatment with some measures conducted in a virtual trial; let's denote one of these measures $\text{M}1_A$. $\text{M}1_A$ has an average value and a standard deviation for Treatment A for the three patients.

Now let's introduce treatment B for the same patient group, $\text{p}_1$, $\text{p}_2$ and $\text{p}_3$. Again we put the treatment through a trial test and receive a list of measures, this time denoted $\text{M}1_B$. I am interested in testing whether the difference in $\text{M}1_A$ and $\text{M}1_B$ is significant.

I know: $N=3, \text{std(M}1_A), \text{std(M}1_B), \text{mean(M}1_A), \text{mean(M}1_B)$

Question:

I want to compare the two measures tested on the same group of 'people' and use a statistical tool to figure out if the difference in the two measures are significant.

I am considering using Welch's t-test – would this be correct?

• WHen you say you know the means and standard deviations, do you not have the three original values for each treatment? – Glen_b Mar 18 '14 at 8:46
• I conduct the virtual trial on each patient for both treatments. This means that I can calculate the mean and standard deviation for the group on treatment A and the mean and standard deviation for the group on treatment B. @Glen_b I am not sure what you mean by original but, I would assume that yes i have the original values. – SteewDK Mar 18 '14 at 8:51
• If you're simulating, what makes the the results "on the same patient" rather than "on different patients" (i.e. what makes the same-patient measures 'more alike')? – Glen_b Mar 18 '14 at 9:24
• I am simulating so this means that treatment A will not effect treatment B. I assume that the treatments are done on the EXACT same patients - nothing differs between the two groups execpt the treatment itself. Thanks @Glen_b. – SteewDK Mar 18 '14 at 9:50
• If there's no effective difference in the simulation if you'd used patients p4,p5,p6 for the second treatment in your simulation, then it's not actually paired -- but if you do a real experiment, it matters a lot. – Glen_b Mar 18 '14 at 10:04