Questions tagged [jackknife]

The jackknife is one of several resampling methods (see also bootstrap). In the jackknife, one (or sometimes more) points from the data are deleted in each resample.

Filter by
Sorted by
Tagged with
0 votes
0 answers
25 views

Estimating covariance between two random forests

I'm building two random forests in R, one using a "treatment" dataset, $\hat{f}_1$, and the other using a "control" dataset, $\hat{f}_2$, so ...
user avatar
5 votes
1 answer
88 views

Linear relationship seems to depends from one value: would bootstraping help?

Statistics beginner here so please don't shoot if the terminology isn't 100% neat. In a sample of 45 individuals, I am looking at a relationship between two parameters (Annual_SOM_rate and ...
user avatar
  • 75
0 votes
0 answers
12 views

Jackknife estimation and testing

I'm using jacknife method to get the uncertainty of my estimation. My estimation restricted to (0,1) and some can be very small. For example, the jackknife estimate for variable A is 0.0000503 and ...
user avatar
1 vote
0 answers
44 views

For small sample sizes, is jackknife superior at controlling Type-I error compared to bootstrap?

This question is motivated by the post here: Can bootstrap be seen as a "cure" for the small sample size? In the referenced post, we see that the bootstrap approach does not control type-1 ...
user avatar
  • 11
0 votes
0 answers
17 views

Total least square and jackknife method

I am trying to understand the total least square. I have found in example here, unfortunately it is only in German, but the most important thing are the five example data points. These are (1,3), (3,1)...
user avatar
  • 3
-1 votes
0 answers
12 views

What does the bias of jackknife method mean? [duplicate]

If we apply the jackknife method on a dataset and estimate a bias, what does that mean in physical interpretation? I mean without using statistical words how can I can interpret the results in my own ...
user avatar
  • 1
0 votes
0 answers
35 views

What does the bias of the jackknife method mean?

If we apply the jackknife method on a dataset and estimate a bias, what does that mean in physical interpretation? I mean without using statistical words how can I can interpret the results?
user avatar
1 vote
1 answer
52 views

What's the "proof" that jackknife is useful for estimating larger population?

What's the "proof" that jackknife is useful for estimating larger population? That is, since it's proposed as an estimate for a larger population, then why would one use it rather than ...
user avatar
  • 3,217
1 vote
1 answer
33 views

Species richness: Why does the more species at one plot imply the more species are missed?

Species richness: Why does the more species at one plot imply the more species are missed? This is what my lecture notes say. The more there are species that have been observed only once, the more ...
user avatar
  • 3,217
0 votes
0 answers
18 views

Percentile jackknife?

Percentile bootstrap, where one bootstraps and takes the 2.5th and 97.5th percentiles of the bootstrapped distribution of the statistic of interest are fairly common and well known. I've never come ...
user avatar
  • 14.8k
1 vote
0 answers
42 views

How to estimate the effect of sample size on the variance of a statistic (using a given sample)?

Question Let's say I have some sample, of size N, with observations ($y_i$ with $i=1,...,N$). And I have some statistic based on the observations (say $S = f(y_1, ..., y_N)$). I would now like to ...
user avatar
  • 20.1k
1 vote
1 answer
42 views

What is the best way to estimate an error on stacked data?

I have 400 pixel maps (which are different realisations of the same underlying system) which, individually, don't show much. If I stack them, however, I get a statistical signal; the maps tend to have ...
user avatar
0 votes
0 answers
79 views

Sampling Weights with latent profile analysis package

Is there a package for latent profile analysis in R that can accommodate sampling weights? I am using tidyLPA and would prefer to use this package if anyone has knowledge about how methods such as ...
user avatar
2 votes
1 answer
139 views

Jackknifing for assessing the "robustness" of test results

In a presentation I saw recently, a two-sided t-test was repeated with jackknifed subsets of the original data in order to assess the result's "robustness". In detail, they took a random ...
user avatar
  • 95
14 votes
1 answer
2k views

Why is the jackknife less computationally intensive than the bootstrap?

It's often claimed that the jackknife is less computationally intensive. How is that the case? My understanding is that the jackknife involves the following steps: Remove 1 data point Estimate the ...
user avatar
  • 4,319
4 votes
1 answer
330 views

MSE of the Jackknife Estimator for the Uniform distribution

The Jackknife is a resampling method, a predecessor of the Bootstrap, which is useful for estimating the bias and variance of a statistic. This can also be used to apply a "bias correction" to an ...
user avatar
  • 6,243
5 votes
1 answer
634 views

How to compute confidence intervals from *weighted* samples?

Imagine we have a webserver, which serves a total of N static URLS. There are users visiting the URLs every day. At the end of each day, we have data like this: ...
user avatar
-1 votes
1 answer
432 views

Deming regression prediction interval using jackknife resampling

I am trying to write a custom Deming function following the maths in Linnet (1993): https://www.ncbi.nlm.nih.gov/pubmed/2281234 Using jackknife resampling I calculate the standard error for the ...
user avatar
  • 115
0 votes
0 answers
25 views

Can one construct "original" data from a function of jackknifed data?

Say I have original, uncorrelated data, $x_i$, with $i = 1,2 \ldots N$. I can jackknife this data set (a simple delete-one) $$ \bar{x}_{i} = \frac{1}{N-1}\sum_{j \neq i}x_{j} \quad\quad (1) $$ to ...
user avatar
  • 101
2 votes
1 answer
271 views

How to estimate the confidence interval of the difference of means?

I have two sets of measurements (repeated measurements of two processes, let's call them $X=\{X_i\}_{0...n}$ and $Y=\{Y_i\}_{0...m}$), and I would like to estimate (with confidence interval) the ...
user avatar
0 votes
0 answers
57 views

How can I calculate $\mu_x/\mu_y$ using Jackknife?

I have difficulties in calculating confidence interval using Jackknife. Suppose that I have two independent samples and I do not know both their population distributions. I understand how to ...
user avatar
  • 1
0 votes
1 answer
133 views

Why are jackknife pseudovalues treated as independent?

Treating jackknife pseudovalues as IID variables is ubiquitous among the sources I've come across. However, I never see an attempt to justify it beyond citing a "proposal" by Tukey's 1958 paper, which ...
user avatar
1 vote
0 answers
34 views

What kind of data should be used to demonstrate jack-knife usability?

I tried to use jack-knife method to get the estimation of parameters of the model of the time series. The problem is, that if I use the least squares method, the parameters of a model are always the ...
user avatar
  • 31
0 votes
1 answer
73 views

jackknife estimator with central limit theorem

Let $\hat{\theta}_n$ be an estimator of the parameter $\theta$ from the sample $\Omega_n$ of $n$ observations, satisfying that $\sqrt{n} (\hat{\theta}_n-\theta) \overset{d}{\longrightarrow} \mathcal{N}...
user avatar
4 votes
1 answer
1k views

What's the point of reporting bootstrap bias?

Suppose the data $X = (X_1,X_2,\cdots,X_n)$ is a vector of iid observations $X_i$ where each $X_i$ has marginal distribution $F(\theta)$. Suppose we observe $x = (x_1,\cdots,x_n)$ and $\hat \theta = \...
user avatar
0 votes
1 answer
844 views

testing for differences using jackknife distributions

I have two distributions relative to two experimental conditions. I compute a certain index (i.e. coherence) describing each distribution. I want to see if there is a significant difference ...
user avatar
1 vote
0 answers
352 views

jackknife replicate weights for survey data

I am confused about utilizing the jackknife replicate weights for computing the variance. From the second equation on page 192 of STATA's documentation (http://www.stata.com/manuals13/svy.pdf), the ...
user avatar
  • 11
1 vote
2 answers
720 views

Estimating the total with jackknife

At a homework assignment, we are supposed to estimate the total in a population using a Horvitz Thompson estimator, and then estimate the variance using the jackknife technique. As a first step, I ...
user avatar
  • 407
1 vote
1 answer
149 views

Jackknife and matrix diagonalization

Suppose I have $M$ matrices $n\times n$ of the form: \begin{equation} C^{k} = \begin{bmatrix} x^{k}_{11} & x^{k}_{12} & x^{k}_{13} & \dots & x^{k}_{1n} \\ x^{k}_{21} ...
user avatar
  • 71
5 votes
1 answer
274 views

What is a good introductory text on resampling methods? [duplicate]

I have found a few decent ones about specific resampling applications such as bootstrapped confidence intervals, but nothing broader. A journal article or book chapter would be preferable to an entire ...
5 votes
1 answer
1k views

Why does the jackknife-after-bootstrap estimation of variance give an overestimate?

The jackknife-after-bootstrap method is used to find the an error estimate (for example variance) to a bootstrap estimate. A typical setting is: (1) From a sample of a population, find an estimate $\...
user avatar
  • 517
12 votes
1 answer
1k views

Comparison of the jacknife vs the bootstrap

I am interested in understanding the relative pros and cons of bootstrap versus jacknife resampling. Both are used in iterative algorithmic approaches to estimating the precision of a prediction or ...
user avatar
  • 9,842
1 vote
1 answer
260 views

Tests for comparing correlation values. The winner is?

The question is relatively simple, but trivial. I have data divided by one fixed effect (Emotion, with 2 conditions: A and B), and I have a covariate, for each of my 20 subjects. My aim is to 1) ...
user avatar
  • 432
1 vote
0 answers
351 views

How can bootstrap be used to establish confidence intervals for Theil regression parameters?

In References for methods for calculating the confidence interval for Theil-Sen Estimator, we note that Wilcox (1998, 2009?) proposed the use of bootstrap as a method for finding confidence intervals ...
user avatar
  • 11.9k
3 votes
1 answer
517 views

Is the Jackknife estimation better than Maximum Likelihood Estimator?

I'm trying to estimate distribution parameters with Maximum Likelihood Estimator (MLE) and Jackknife estimator based on it. The estimation statistic is mean. Jackknife estimator is considered to be ...
user avatar
3 votes
2 answers
993 views

Statistical analysis of random variable with finite mean and infinite variance

Given a measurement that (we know from theory) has a finite expected value, but infinite variance, is it possible to have some statistical information? Can I get the significance of such data? Can ...
user avatar
1 vote
0 answers
319 views

What sample size is necessary to jackknife estimate variance of large dataset?

So I'm working on a project and I wrote a java library that I can use to perform feature ranking and Naive Bayes classification on data sets. I wrote and tested the library on small data sets so I ...
user avatar
0 votes
0 answers
368 views

Resampling to subset (jackknife) or bootstrap for survival analysis

This is a question regarding survival analysis and bootstrap: Suppose I have a time-to-event dataset with 1000 subjects, and based on this dataset I can obtain some measures or plots (not standard, o....
user avatar
9 votes
1 answer
850 views

Why is backward elimination justified when doing multiple regression?

Does it not result in over-fitting? Would my results be more reliable if I added a jack-knife or bootstrap procedure as a part of the analysis?
user avatar
  • 91
23 votes
2 answers
11k views

Jackknife vs. LOOCV

Is there really any difference between the jackknife and leave one out cross validation? The procedure seems identical am I missing something?
user avatar
  • 1,207
0 votes
1 answer
124 views

jackknifing blocks (*not* time series)

I have the following problem. There are 50 subjects. Each subject does a block of 100 trials. At the end I want to compute a complicated statistic s() on the data x. Now I want to be able to compute ...
user avatar
  • 3
4 votes
2 answers
1k views

How to program the deleted d-jack-knife

I have a dataset containing 45 observations. I want to sample times from this dataset, but with sample size equal to 35 each time. So each time I want to delete 10 datapoints from the original dataset....
user avatar
  • 131
13 votes
1 answer
2k views

Are there any contemporary uses of jackknifing?

The question: Bootstrapping is superior to jackknifing; however, I am wondering if there are instances where jackknifing is the only or at least a viable option for characterizing uncertainty from ...
user avatar
  • 1,876
6 votes
1 answer
1k views

Bootstrap Confidence Intervals for Weir & Cockerham's Fst

I'm working on calculating bootstrap confidence intervals for Weir & Cokerham's Fst. I want to use the percentile-t method as described in this paper. I'm calculating the $F_{st}$ value between ...
user avatar
90 votes
2 answers
47k views

Resampling / simulation methods: monte carlo, bootstrapping, jackknifing, cross-validation, randomization tests, and permutation tests

I am trying to understand difference between different resampling methods (Monte Carlo simulation, parametric bootstrapping, non-parametric bootstrapping, jackknifing, cross-validation, randomization ...
user avatar
  • 2,246
2 votes
0 answers
527 views

Analysis of a complex sample with replicate weights: error when using survey package

I have a data base from a stratified multi-stage survey. Due to confidentiality reasons, they do not gave me the strata neither the psu, ssu… variables. Instead they gave me the: “Final weights” ...
user avatar
4 votes
1 answer
676 views

The Bayesian approach to computing estimator bias and variance

From what I understand, jackknife and bootstrapping are frequentist methods for computing statistics (bias, variance, etc.) of an estimator. Given a sample of my data and an estimator, and assuming ...
user avatar
3 votes
0 answers
566 views

Comparing Gini coefficients: Variance estimation etc. needed?

In a project on software measurement, we plan to use aggregating statistics (e.g., Gini) to describe the concentration of certain observed program attributes (size) among program units (e.g., modules, ...
user avatar
  • 143
4 votes
2 answers
3k views

How to derive jackknife bias for variance and mean

I am having a hard time to understand how one derives the jackknife bias for the variance and mean. 1) Why do we need an inflation factor of $(n-1)$ when calculating the jackknife bias of the mean? ...
user avatar
  • 51
1 vote
0 answers
885 views

Bootstrap or jack-knife for crossvalidation of predictive model?

Is a bootstrap or jack-knife method better for crossvalidation of a multivariate logistic regression based predictive model?
user avatar
  • 41