I am applying a two-sample t-test to determine whether we have software regressions on latency measurements. 

## Procedure
- Run the test and gather 60 latency measurements.
- Calculate the two-sample t-test score against the previous build.
- Interpret the results (threshold on the t-test score and investigate further if needed)

I learned about this test from my engineering statistics textbook but I also saw it suggested in [this question](https://stats.stackexchange.com/questions/16018/how-can-i-determine-if-theres-a-statistically-significant-difference-between-tw).

Not sure if it's relevant, but the variability should be relatively consistent since I'm using an RTOS system.

## Problem

In one run of the test I calculated a significance of -3.6 when I re-ran it, I re-calculated only -2.6.

## Question

What does that tell me? Is the distribution not being captured by 60 samples? Is this test not appropriate here? Is -3.6 not a big difference to -2.6?

I thought the difference between a score of -3.6 and -2.6 is very large so I'm a little confused whether I'm approaching this the right way.