In my test procedure I sequentially take 10 measurements of a recently perturbed physical system, and I often find the first few (between 0 and 4) measurements can be inaccurate because the system has not settled/equilibrated. The initial non-equilibrated measurements may just have less accuracy or show a distinct trend, while the remainder should not have a trend and just show random variation.

I am currently eyeballing the data to discard any initial poor data but want to have a more rigourous and automated method for selecting the "good" data. I am aware (eg here) of various outlier tests (Chauvenet, Grubbs, Pierce, Generalized ESD) but because of "masking" and trending don't think they will give reliable results. The experimental conditions are fairly well controlled so there are unlikely to be other genuinely sporadic outliers appearing.

Is there a more appropriate statistical test (than say Generalised ESD) for my procedure?

Update:

To give some more details I have run about 15 procedures so far and while some datasets have all good values most need 2 or 3 measurements dropped, so it seems reasonable to query the first 4.

The problem description above is somewhat simplified in that more than one number is determined for each measurement, ie there are several system parameters measured. Only 1 or 2 parameters show non-equilibrium effects though so there is limited scope for cross-checking.

The aim is to get reliable values for parameters of an unchanging system and therefore the model I am trying to fit is a series of constant values with some measurement error. The measuring is time-consuming but automated and can currently run overnight, the analysis is performed afterwards. It is possible to increase the number of measurements but this obviously takes more time. There may be a slight trend in values over the whole procedure but this is small and qualitatively different from the "non-equilibration" effect.

Six good data-points is sufficient to get an adequate estimate of the parameters and to detect any obvious problems with the process, so just dropping the first 4 is an acceptable solution. It seems from the discussion this is the best solution, unless the Dixon's test variant can be used. Where can I read more about that?

In my test procedure I sequentially take 10 measurements of a recently perturbed physical system, and I often find the first few (between 0 and 4) measurements can be inaccurate because the system has not settled/equilibrated. The initial non-equilibrated measurements may just have less accuracy or show a distinct trend, while the remainder should not have a trend and just show random variation.

I am currently eyeballing the data to discard any initial poor data but want to have a more rigourous and automated method for selecting the "good" data. I am aware (eg here) of various outlier tests (Chauvenet, Grubbs, Pierce, Generalized ESD) but because of "masking" and trending don't think they will give reliable results. The experimental conditions are fairly well controlled so there are unlikely to be other genuinely sporadic outliers appearing.

Is there a more appropriate statistical test (than say Generalised ESD) for my procedure?

Update:

To give some more details I have run about 15 procedures so far and while some datasets have all good values most need 2 or 3 measurements dropped, so it seems reasonable to query the first 4.

The problem description above is somewhat simplified in that more than one number is determined for each measurement, ie there are several system parameters measured. Only 1 or 2 parameters show non-equilibrium effects though so there is limited scope for cross-checking.

The aim is to get reliable values for parameters of an unchanging system and therefore the model I am trying to fit is a series of constant values with some measurement error. The measuring is time-consuming but automated and can currently run overnight, the analysis is performed afterwards. It is possible to increase the number of measurements but this obviously takes more time.

From the previous results I have a good idea of the expected variation in measurements at equilibrium, so I could use that information in addition to the within-dataset variation to assess outliers. Currently I only use that information to determine if the final error is acceptable.

Six good data-points is sufficient to get an adequate estimate of the parameters and to detect any obvious problems with the process, so just dropping the first 4 is an acceptable solution. It seems from the discussion this is the best solution, unless the Dixon's test variant can be used. Where can I read more about that?

In my test procedure I sequentially take 10 measurements of a recently perturbed physical system, and I often find the first few (between 0 and 4) measurements can be inaccurate because the system has not settled/equilibrated. The initial non-equilibrated measurements may just have less accuracy or show a distinct trend, while the remainder should not have a trend and just show random variation.

I am currently eyeballing the data to discard any initial poor data but want to have a more rigourous and automated method for selecting the "good" data. I am aware (eg here) of various outlier tests (Chauvenet, Grubbs, Pierce, Generalized ESD) but because of "masking" and trending don't think they will give reliable results. The experimental conditions are fairly well controlled so there are unlikely to be other genuinely sporadic outliers appearing.

Is there a more appropriate statistical test (than say Generalised ESD) for my procedure?

In my test procedure I sequentially take 10 measurements of a recently perturbed physical system, and I often find the first few (between 0 and 4) measurements can be inaccurate because the system has not settled/equilibrated. The initial non-equilibrated measurements may just have less accuracy or show a distinct trend, while the remainder should not have a trend and just show random variation.

I am currently eyeballing the data to discard any initial poor data but want to have a more rigourous and automated method for selecting the "good" data. I am aware (eg here) of various outlier tests (Chauvenet, Grubbs, Pierce, Generalized ESD) but because of "masking" and trending don't think they will give reliable results. The experimental conditions are fairly well controlled so there are unlikely to be other genuinely sporadic outliers appearing.

Is there a more appropriate statistical test (than say Generalised ESD) for my procedure?

Update:

To give some more details I have run about 15 procedures so far and while some datasets have all good values most need 2 or 3 measurements dropped, so it seems reasonable to query the first 4.

The problem description above is somewhat simplified in that more than one number is determined for each measurement, ie there are several system parameters measured. Only 1 or 2 parameters show non-equilibrium effects though so there is limited scope for cross-checking.

The aim is to get reliable values for parameters of an unchanging system and therefore the model I am trying to fit is a series of constant values with some measurement error. The measuring is time-consuming but automated and can currently run overnight, the analysis is performed afterwards. It is possible to increase the number of measurements but this obviously takes more time. There may be a slight trend in values over the whole procedure but this is small and qualitatively different from the "non-equilibration" effect.

Six good data-points is sufficient to get an adequate estimate of the parameters and to detect any obvious problems with the process, so just dropping the first 4 is an acceptable solution. It seems from the discussion this is the best solution, unless the Dixon's test variant can be used. Where can I read more about that?