1
$\begingroup$

I have a dataset of $n×m$ numbers, where the $m$ variables ($m$ is in the order of 5–10) exhibit various degrees of correlation with one another. The format of the data is not necessarily a timeseries, it could be a discrete or continuous timeseries, and it could be various timeseries grouped together. The dataset is oversampled ($n>10000$).

I want to cull the amount of data (rows) such that the reduced dataset will have the same CDF and PDF as the original data for all $m$ variables. Simple bootstrapping will not do as that technique assumes that the variables are independent. However, I have the impression that multi-stage bootstrapping might actually be something that could be used here.

Does anyone have an answer to my question, or can anyone refer me to some literature where I could find an answer on this? If you happen to have some coding examples yourself, I am writing in Matlab.

$\endgroup$
  • 1
    $\begingroup$ I'm not sure it's very clear what you're trying to do here. Are you trying to resample your columns? Bootstrapping happens over observations, not predictors. You can do the bootstrap on time series data by resampling in blocks, see en.wikipedia.org/wiki/… $\endgroup$ – einar Jan 23 '17 at 0:33
  • $\begingroup$ Apologies for the confusing, but I would like to resample the rows, or observations, not the columns or predictors. Is your reference to 'block data' in your link to en.wikipedia.org/wiki/… the same as multi-stage bootstrapping or is that something else again? $\endgroup$ – Frank Drost Jan 23 '17 at 0:38
  • 1
    $\begingroup$ I'm not familiar with multi-stage bootstrap, but I want to say no. In time series data you have data in fixed time steps, so they have a certain order. Block bootstrapping is to sample some number of consecutive observations together instead of sampling observations independently of one another. $\endgroup$ – einar Jan 23 '17 at 0:45
  • 1
    $\begingroup$ Wikipedia mentions that block bootstrapping can be used on data that is correlated. As I have no experience with block bootstrapping, I am not questioning that statement, but at the same time wikipedia is not regarded as a scientific appropriate source of information. I can of course 'google' block bootstrapping for more information, but any useful tips or relevant links to a mathematical analysis and discussion on the appropriateness of the technique would be most useful. And of course, if anyone has other suggestions to how I could try to address my main question I would appreciate too. $\endgroup$ – Frank Drost Jan 23 '17 at 0:55
2
$\begingroup$

The wikipedia reference is excellent. It has a number of references to several books. My book Chernick (2007) covers time series. But the most thorough text on dependent data is Lahiri's text. I will provide these additional references.

The two references are

1) Bootstrap Methods: A Practitioners Guide 2nd Edition, Michael R. Chernick (2007) Wiley.

www.wiley.com/WileyCDA/WileyTitle/productCd-0471756210.html

2) Resampling Methods for Dependent Data, S. N. Lahiri (2003) Springer.

www.springer.com/us/book/9780387009285

$\endgroup$
  • $\begingroup$ Great, Thanks for the information. I will have a look on whether block bootstrapping might be useful for solving my issue. $\endgroup$ – Frank Drost Jan 23 '17 at 1:38

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.