1
$\begingroup$

I have several (partially overlapping) data curves of oscilloscope-measured detector voltage as a function of time (very simple hypothetical example as follows): enter image description here

There is an underlying physics process that is known to be smooth (but is too complex to model parametrically over the entire range) and the derivative of this curve is the quantity of interest. In order to calculate this derivative, one of several nonlinear regression methods can be employed to fit these curves. For simplicity let's assume it's a cubic spline fit (example below): enter image description here

The derivative is then calculated from this spline fit as follows: enter image description here

Due to the nature of the measurement techniques, the residuals do not have constant variance and thus the standard procedures for deriving prediction bounds don't apply. I have spent a lot of time reading up on this but with minimal stats experience/understanding, it is very difficult to ascertain which methods are best, and more importantly which are valid. I feel that maybe bootstrapping is my best bet, but the complexities of my case make me unsure on how to implement it. I have come up with the following possible strategy:

  1. Composite voltage data; perform spline fit and obtain residuals.
  2. Using a moving window, estimate a time-dependent local variance.
  3. Create N (thousands) resampled curves using this variance and re-fit the spline to these data curves.
  4. Calculate derivatives for original fit and each of the resampled fits to give a spread of data (if the number of resamples is high enough, these should be normally distributed about the mean).
  5. For the final derivative curve, use the mean of all the fit derivatives and use the variance of the spread of fits to define the prediction bounds using standard equations, or the delta method.

My questions (arising from my ignorance) are as follows:

  1. Is this even a correct way of implementing (moving block) bootstrapping, or is there a better way?
  2. Would it be better to do a regression fit on each individual curve and composite the derivatives, fit the composited curves and then bootstrap?
  3. Is a rolling window local variance just a massive fudge?

Any constructive advice would be greatly appreciated.

$\endgroup$

1 Answer 1

0
$\begingroup$

Ok, let me correct some possible errors here (I'm answering rather than editing as (a) I don't want to just gloss over the fact that they were there, and (b) I may not actually be right in correcting them; I'm hoping someone else might be able to say).

Talk of variance (and its use in resampling) in items 2 and 3 of the strategy would better be described by standard bootstrap resampling with replacement, except on a rolling block/window.

The assumption of constant variance (residual normality) in the spread of the fits in derivatives seems wrong to me the more I think about it. So it's not a simple case of using this variance to define prediction bounds as it may not be constant. What I can possibly do though is take the spread of y-values evaluated at a given x-value and use quantiles to define upper and lower bounds. By definition, these should be the required prediction bounds as the appropriate percentage of the predictions should lie within the range. This could be further checked by running more resamples, and the same percentage of new predictions should lie in that range.

Correct me if I'm wrong in this. My other questions still apply though.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.