Questions tagged [stratification]
A sampling technique in which the population of interest is partitioned into subsets ("strata") based on characteristics known at all units before sampling.
265
questions
1
vote
1
answer
22
views
How to deal with survival analysis when censoring time depends on a covariate
I'm performing survival analysis on time to drop out of a certain program. However, the censoring of each case depends heavily on the length of the program. For example, some programs only last 3 ...
- 11
0
votes
0
answers
15
views
When monitoring a sample, how to gauge when a substratum significantly exceeds sample size estimates and should therefore have its rates adjusted?
I'm in charge of a year-long, stratified sample where the population is estimated based on previous years but which is also quite dynamic, changing in unpredicted ways every year (furthermore, past ...
- 315
0
votes
0
answers
7
views
How to combine strata in bootstrap resampling to produce a confidence interval for the population statistic?
Let's I have $k$ strata, each with resamples $\mathcal{D_i}$ resamples where $i = 1 ... k$
Each has some confidence interval $[\hat{\theta_i} - \theta^{\star}_{i, \alpha/2}, \hat{\theta} - \theta^{\...
0
votes
0
answers
8
views
How to combine a two strata, where one is fully sampled and the other partially sampled, and the sampling statistic is highly skewed
I am estimating the mean of a highly skewed sampling distribution.
I have a full sample of 80% of the population. I have a small partial sample of 20%.
I'm using the bootstrap to estimate the ...
2
votes
3
answers
82
views
What is "information leak from test to train" ? Is stratification by target a leak?
It's common practice to do procedures such as standardization and even missing value imputation (commonly based on some means) after train/test split - otherwise it is treated as information leak from ...
- 21
0
votes
0
answers
28
views
Stratified sampling for household dataset. Multiple targets or single target?
I am new in stratified sampling. I have a regression task to analyse the relationship between income, household size and expenditure, using python. Both income and expenditure are continuous variables,...
- 1
-1
votes
1
answer
43
views
Which of the variables appear to be effect modifiers. When stratifying by each variable, which seem to indicate the presence of interaction?
The following graph displays five pairs of stratified odds ratios (not from the same study) with 95% confidence intervals. For this plot, assume the confidence intervals indicate whether the stratum-...
1
vote
0
answers
5
views
Relative Error when using an erroneous neyman allocation
I'm having a lot of issues trying to derive an equation for the relative error in the following problem. Someone has used the following incorrect formula to perform Neyman allocation
$n_{h,e}=n\frac{...
- 11
1
vote
1
answer
59
views
Is Neyman allocation sampling the best approach?
I have a data set of the 2020 value of 15,000 unique objects. The value is right skewed. I have to draw a sample of 500 unique objects based on the 2020 value (range = $1-40,000). The present value of ...
- 19
0
votes
0
answers
13
views
Randomised controlled trial stratified by site - inclusion of site as fixed effects or clustered standard errors?
I have a 2-arm RCT which is stratified by two factors:
Site (2 sites)
Disease presence (presence; absence)
The analysis of the primary outcome (binary) will use a log-binomial GLM to generate the RR ...
1
vote
0
answers
5
views
Disproportionate stratified sampling that follows proportional trend?
I'm conducting a study across four counties to determine which of four different methods is most effective in detecting nutria. 60 sites will be randomly selected within a 5-meter buffer of any open ...
- 11
0
votes
0
answers
10
views
Is it appropriate to pre-stratify and post-stratify along different delineations of the same variables in a single survey?
I am working in the context of opt-in, web-based surveys. Often the desire is for accurate population estimates, and often at a country-wide level. The standard approach at this organization is to ...
1
vote
0
answers
13
views
How can I show probability of selection change when adding stratification to a survey design
I have a survey that uses a stratified sampling approach with optimal allocation.
The team conducting the survey has asked that we make two changes:
Subdivide one of the strata into smaller pieces. ...
- 123
1
vote
1
answer
54
views
Why can stratified sampling to testing/training sets on strata that contain less than 10% of the entire dataset be statistically risky?
I'm trying to split my data into a testing and a training set. There are lots of variables that I want to ensure are well represented in both the training and testing sets (say, 15 covariates). But ...
- 173
0
votes
0
answers
47
views
Regression Analysis for Stratified Random Sampling
I have some data that was found using a stratified random sampling procedure. We used this process to directly sample from the entire population and record Metrics that we were interested in. From my ...
- 23
0
votes
0
answers
7
views
Sampling Methodology for QA/QC Sampling
I need a bit of help / nudge in the right direction. I am currently wrapping up my MS in Applied Statistics and have learned a ton about the subject. Recently I was approached by one of our business ...
- 131
0
votes
0
answers
30
views
Stratified sampling where observed values vary with strata inclusion
Problem set-up:
Let's say I make $n$ observations of a numerical-scale variable, $x$, where each observation can be cross-classified into $L$ strata. Each observation may belong to anywhere from 1 to $...
- 51
0
votes
0
answers
20
views
Difference between stratifying and categorizing a variable?
What's the difference between stratifying a variable within a model vs making a category variable out of it?
Does the difference lie in that stratification affects how all the other variables are ...
- 403
0
votes
1
answer
33
views
0
votes
0
answers
36
views
Grouped stratified train-val-test split for a multilabel dataset
I was wondering if there is a fast heuristic algorithm for performing grouped stratified dataset split on a multilabel dataset. Question originally posted on Data Science stackexcahnge here.
...
- 11
0
votes
1
answer
11
views
Stratified cox reg analysis
I am trying to make a stratified cox reg analysis in R studio, where I want to see the differences in exposure to MT divided by gender.
I used the following code:
...
- 1
2
votes
0
answers
30
views
pre-stratification(blocking) vs post-stratification
$Q:$ When should I consider pre-stratification(blocking) vs post-stratification? From experiments, I would certainly consider pre-stratification but post-stratification seems to homogenize the sample ...
- 1,315
0
votes
0
answers
41
views
Strata Sample Sizes and Stratified Sampling
I am trying to conduct a research study on the local population of homeless individuals in my county. But, before I can detail my study, it would be helpful to provide some context.
Context: It is ...
- 101
0
votes
1
answer
70
views
How do you calculate the total sample size in stratified sampling?
I know that we can allocate observations from the total sample to each strata either using proportional allocation ($n_{h}/N_{h} = n/N$) or optimal allocation:
$$n_{h} = \left [ \frac{\frac{N_{h}S_{h}}...
- 59
0
votes
0
answers
27
views
Stratified randomization: adjustment or not?
In randomised trials, there's a mantra saying "analyse as you randomise". So if I deploy a stratified randomisation, i.e. randomise within strata of some baseline variable, then this would ...
- 547
1
vote
1
answer
210
views
Inconsistent handling of lonely PSUs in R's `survey` package?
There appears to be some inconsistent handling of lonely PSUs in R's survey package when calling svyglm on a subset of ...
- 13
0
votes
0
answers
17
views
correct survey design for wroking with aggregation of surveys
I have 4 quaterly surveys and I am using survey package from R , for each one the design is:
Quarter design:
...
- 1
0
votes
0
answers
68
views
How is a Stratified Random Sample more efficient than a Simple Random Sample? And how does disproportionate selection factor in?
Sample Efficiency
In the article "Adjusting for Design Effects in Disproportionate Stratified Sampling Designs Through Weighting" the authors state that the "main statistical benefit ...
- 315
0
votes
0
answers
62
views
Confidence interval and/or sampling distribution in double / two-phase sampling for stratification
Question: How to calculate a 95% confidence interval for estimated population mean in double / two-phase sampling for stratification where a simple random sample is taken at each phase?
Consider the ...
- 1
0
votes
0
answers
12
views
Optimal sampling strategy when only marginal group sizes are known
I seems to me that this cannot be such an uncommon situation but I find I cannot come up with the answer myself and I also cannot come up with the correct search terms to find it, either here on Cross ...
- 227
1
vote
2
answers
55
views
Train test split based on statistics
I would like to know if there is a method of splitting that is not random but based on the distribution of the train and test data samples feauture values.
Currently I am splitting randomly but ...
- 13
1
vote
1
answer
41
views
Age and sex standardised incidence rates
If I were to compute age-sex standardised incidence rates based on a simple random sample of a nationwide household survey on hearing loss. Noting that this a sample not the total population, so the ...
- 13
1
vote
1
answer
283
views
Computing standard errors when using stratified sampling
I am trying to understand the following formula for the standard error of the population mean as estimated through stratified sampling. On the CRAN site, the formula given is $$
S_{\bar{x}_{\textit{...
- 611
5
votes
1
answer
67
views
Causal inference, stratification to mitigate confounders in continuous variables?
Handling confounders in continuous variables
In Statistical Rethinking, the author shows that in different situations, a confounder (fork, pipe, collider, descendent) will induce spurious correlations....
- 2,053
0
votes
0
answers
22
views
Regression discontinuity with stratified assignment to treatment
I am working on running a regression discontinuity model where the "random" assignment to treatment occurs at a different level from the outcome variable.
Essentially, the forcing variable ...
- 1
0
votes
1
answer
23
views
Should I keep discovery and validation samples separated also for subanalysis and stratification?
I am conducting an analysis on RNAseq data on two populations sampled from different geographical regions. I used population A as discovery (about 120 samples and 150 matched controls) and population ...
- 1
0
votes
1
answer
40
views
K-fold Stratified cross validation on a dataset with examples of variable length
I have a dataset of audio recording of variable length with large std which are heavily imbalanced in terms of total duration per class. So in stratified k-fold cross validation I would like to main ...
- 11
0
votes
0
answers
158
views
difference between stratification and blocking in experimental design
What is the difference between stratification and blocking in experimental design(or randomized control trial)?
Blocking is to obtain homogeneity in a controlled factor. However, I can block more than ...
- 1,315
0
votes
1
answer
34
views
How to update survey weights after fixing strata membership/assignments?
Imagine we conduct a survey using stratified sampling, and after the survey closes, we find out that we had misclassified some of the respondents. They actually belong to different strata than we had ...
- 123
1
vote
1
answer
47
views
Estimating a population total from a stratified simple random sample
I have a stratified population. I want to estimate a population total $T$ from a stratified simple random sample. I have two strategies:
I compute $\displaystyle T=\sum_h N_h\bar x_h$ where $x_h$ is ...
- 115
4
votes
1
answer
161
views
Subclassification on a propensity and prognostic score grid with k × k subclasses, using R MatchIt
I would like to perform a joint subclassification of some data on the propensity and prognostic scores as described in this paper "On the joint use of propensity and prognostic scores in ...
- 41
1
vote
1
answer
76
views
Cox PH controlling for multiple events
I'm working on a cox proportional hazard analysis in R using the survival package.
I´m analysing covariate effects on fish movement within a study area. The study area is divided into two zones ("...
- 11
0
votes
1
answer
110
views
Choosing an equal number of samples from each strata - what is this called?
Suppose I have a highly skewed distribution and a proxy measurement. I use this proxy measurement to bin the samples of this distribution into different "strata". I then take N samples from ...
- 33
0
votes
1
answer
117
views
When having non-proportional hazards, should I use stratified Cox by time or Logrank tests within periods?
My data have non-proportional hazards with clear separation. Should I handle it via stratified Cox regression or using separate Log-rank test within subsets?
I will use R only to illustrate.
I want to ...
- 23
2
votes
1
answer
58
views
When computing period-specific hazard ratio using Cox, should I add variable:strata or full variable * strata?
Let's asusme I want to calculate separate hazards ratio in two periods, split like below.
...
- 23
1
vote
1
answer
92
views
How to resample members from the population who didn't respond after the survey?
I have used stratified random sampling on population to generate the sample.
Now the issue is if after the survey is conducted some of the members in the sample ...
- 63
0
votes
1
answer
25
views
How to calculate sampling error for proportionate sampling?
I have done sampling using Proportionate Stratified Random Sampling.
The table below shows the proportion of each groups in the sample and population.
This is the formula for Standard Error (...
- 63
1
vote
0
answers
45
views
Draw a stratified sample in panel data
Question: How can we draw a stratified sample in panel data context when the stratifying variables are not fixed over time?
Background: I have panel data on workers (id) over time (t). I want to draw ...
- 269
0
votes
1
answer
47
views
Partitioning survival data into prognostic groups
I have survival data (n ~ 1000) with ~40% censoring and ~10% missing data. I want to partition the subjects into 4 prognostic groups based on survival. Misganow B and Vidyasagar M (Exploiting Ordinal ...
- 103
0
votes
0
answers
43
views
Stratified sampling with unknown strata sizes
I'm in a setting where I have natural population strata (that I can infer from the samples), but I don't know the strata sizes. Are there ways to get valid confidence intervals in this setting?
- 1