Questions tagged [stratification]

A sampling technique in which the population of interest is partitioned into subsets ("strata") based on characteristics known at all units before sampling.

Filter by
Sorted by
Tagged with
1 vote
1 answer
22 views

How to deal with survival analysis when censoring time depends on a covariate

I'm performing survival analysis on time to drop out of a certain program. However, the censoring of each case depends heavily on the length of the program. For example, some programs only last 3 ...
0 votes
0 answers
15 views

When monitoring a sample, how to gauge when a substratum significantly exceeds sample size estimates and should therefore have its rates adjusted?

I'm in charge of a year-long, stratified sample where the population is estimated based on previous years but which is also quite dynamic, changing in unpredicted ways every year (furthermore, past ...
  • 315
0 votes
0 answers
7 views

How to combine strata in bootstrap resampling to produce a confidence interval for the population statistic?

Let's I have $k$ strata, each with resamples $\mathcal{D_i}$ resamples where $i = 1 ... k$ Each has some confidence interval $[\hat{\theta_i} - \theta^{\star}_{i, \alpha/2}, \hat{\theta} - \theta^{\...
0 votes
0 answers
8 views

How to combine a two strata, where one is fully sampled and the other partially sampled, and the sampling statistic is highly skewed

I am estimating the mean of a highly skewed sampling distribution. I have a full sample of 80% of the population. I have a small partial sample of 20%. I'm using the bootstrap to estimate the ...
2 votes
3 answers
82 views

What is "information leak from test to train" ? Is stratification by target a leak?

It's common practice to do procedures such as standardization and even missing value imputation (commonly based on some means) after train/test split - otherwise it is treated as information leak from ...
  • 21
0 votes
0 answers
28 views

Stratified sampling for household dataset. Multiple targets or single target?

I am new in stratified sampling. I have a regression task to analyse the relationship between income, household size and expenditure, using python. Both income and expenditure are continuous variables,...
  • 1
-1 votes
1 answer
43 views

Which of the variables appear to be effect modifiers. When stratifying by each variable, which seem to indicate the presence of interaction?

The following graph displays five pairs of stratified odds ratios (not from the same study) with 95% confidence intervals. For this plot, assume the confidence intervals indicate whether the stratum-...
1 vote
0 answers
5 views

Relative Error when using an erroneous neyman allocation

I'm having a lot of issues trying to derive an equation for the relative error in the following problem. Someone has used the following incorrect formula to perform Neyman allocation $n_{h,e}=n\frac{...
1 vote
1 answer
59 views

Is Neyman allocation sampling the best approach?

I have a data set of the 2020 value of 15,000 unique objects. The value is right skewed. I have to draw a sample of 500 unique objects based on the 2020 value (range = $1-40,000). The present value of ...
0 votes
0 answers
13 views

Randomised controlled trial stratified by site - inclusion of site as fixed effects or clustered standard errors?

I have a 2-arm RCT which is stratified by two factors: Site (2 sites) Disease presence (presence; absence) The analysis of the primary outcome (binary) will use a log-binomial GLM to generate the RR ...
1 vote
0 answers
5 views

Disproportionate stratified sampling that follows proportional trend?

I'm conducting a study across four counties to determine which of four different methods is most effective in detecting nutria. 60 sites will be randomly selected within a 5-meter buffer of any open ...
  • 11
0 votes
0 answers
10 views

Is it appropriate to pre-stratify and post-stratify along different delineations of the same variables in a single survey?

I am working in the context of opt-in, web-based surveys. Often the desire is for accurate population estimates, and often at a country-wide level. The standard approach at this organization is to ...
1 vote
0 answers
13 views

How can I show probability of selection change when adding stratification to a survey design

I have a survey that uses a stratified sampling approach with optimal allocation. The team conducting the survey has asked that we make two changes: Subdivide one of the strata into smaller pieces. ...
  • 123
1 vote
1 answer
54 views

Why can stratified sampling to testing/training sets on strata that contain less than 10% of the entire dataset be statistically risky?

I'm trying to split my data into a testing and a training set. There are lots of variables that I want to ensure are well represented in both the training and testing sets (say, 15 covariates). But ...
  • 173
0 votes
0 answers
47 views

Regression Analysis for Stratified Random Sampling

I have some data that was found using a stratified random sampling procedure. We used this process to directly sample from the entire population and record Metrics that we were interested in. From my ...
  • 23
0 votes
0 answers
7 views

Sampling Methodology for QA/QC Sampling

I need a bit of help / nudge in the right direction. I am currently wrapping up my MS in Applied Statistics and have learned a ton about the subject. Recently I was approached by one of our business ...
  • 131
0 votes
0 answers
30 views

Stratified sampling where observed values vary with strata inclusion

Problem set-up: Let's say I make $n$ observations of a numerical-scale variable, $x$, where each observation can be cross-classified into $L$ strata. Each observation may belong to anywhere from 1 to $...
  • 51
0 votes
0 answers
20 views

Difference between stratifying and categorizing a variable?

What's the difference between stratifying a variable within a model vs making a category variable out of it? Does the difference lie in that stratification affects how all the other variables are ...
  • 403
0 votes
1 answer
33 views

Are stratified variables still significant?

...
  • 403
0 votes
0 answers
36 views

Grouped stratified train-val-test split for a multilabel dataset

I was wondering if there is a fast heuristic algorithm for performing grouped stratified dataset split on a multilabel dataset. Question originally posted on Data Science stackexcahnge here. ...
0 votes
1 answer
11 views

Stratified cox reg analysis

I am trying to make a stratified cox reg analysis in R studio, where I want to see the differences in exposure to MT divided by gender. I used the following code: ...
  • 1
2 votes
0 answers
30 views

pre-stratification(blocking) vs post-stratification

$Q:$ When should I consider pre-stratification(blocking) vs post-stratification? From experiments, I would certainly consider pre-stratification but post-stratification seems to homogenize the sample ...
  • 1,315
0 votes
0 answers
41 views

Strata Sample Sizes and Stratified Sampling

I am trying to conduct a research study on the local population of homeless individuals in my county. But, before I can detail my study, it would be helpful to provide some context. Context: It is ...
  • 101
0 votes
1 answer
70 views

How do you calculate the total sample size in stratified sampling?

I know that we can allocate observations from the total sample to each strata either using proportional allocation ($n_{h}/N_{h} = n/N$) or optimal allocation: $$n_{h} = \left [ \frac{\frac{N_{h}S_{h}}...
0 votes
0 answers
27 views

Stratified randomization: adjustment or not?

In randomised trials, there's a mantra saying "analyse as you randomise". So if I deploy a stratified randomisation, i.e. randomise within strata of some baseline variable, then this would ...
1 vote
1 answer
210 views

Inconsistent handling of lonely PSUs in R's `survey` package?

There appears to be some inconsistent handling of lonely PSUs in R's survey package when calling svyglm on a subset of ...
  • 13
0 votes
0 answers
17 views

correct survey design for wroking with aggregation of surveys

I have 4 quaterly surveys and I am using survey package from R , for each one the design is: Quarter design: ...
0 votes
0 answers
68 views

How is a Stratified Random Sample more efficient than a Simple Random Sample? And how does disproportionate selection factor in?

Sample Efficiency In the article "Adjusting for Design Effects in Disproportionate Stratified Sampling Designs Through Weighting" the authors state that the "main statistical benefit ...
  • 315
0 votes
0 answers
62 views

Confidence interval and/or sampling distribution in double / two-phase sampling for stratification

Question: How to calculate a 95% confidence interval for estimated population mean in double / two-phase sampling for stratification where a simple random sample is taken at each phase? Consider the ...
  • 1
0 votes
0 answers
12 views

Optimal sampling strategy when only marginal group sizes are known

I seems to me that this cannot be such an uncommon situation but I find I cannot come up with the answer myself and I also cannot come up with the correct search terms to find it, either here on Cross ...
  • 227
1 vote
2 answers
55 views

Train test split based on statistics

I would like to know if there is a method of splitting that is not random but based on the distribution of the train and test data samples feauture values. Currently I am splitting randomly but ...
  • 13
1 vote
1 answer
41 views

Age and sex standardised incidence rates

If I were to compute age-sex standardised incidence rates based on a simple random sample of a nationwide household survey on hearing loss. Noting that this a sample not the total population, so the ...
  • 13
1 vote
1 answer
283 views

Computing standard errors when using stratified sampling

I am trying to understand the following formula for the standard error of the population mean as estimated through stratified sampling. On the CRAN site, the formula given is $$ S_{\bar{x}_{\textit{...
  • 611
5 votes
1 answer
67 views

Causal inference, stratification to mitigate confounders in continuous variables?

Handling confounders in continuous variables In Statistical Rethinking, the author shows that in different situations, a confounder (fork, pipe, collider, descendent) will induce spurious correlations....
  • 2,053
0 votes
0 answers
22 views

Regression discontinuity with stratified assignment to treatment

I am working on running a regression discontinuity model where the "random" assignment to treatment occurs at a different level from the outcome variable. Essentially, the forcing variable ...
0 votes
1 answer
23 views

Should I keep discovery and validation samples separated also for subanalysis and stratification?

I am conducting an analysis on RNAseq data on two populations sampled from different geographical regions. I used population A as discovery (about 120 samples and 150 matched controls) and population ...
  • 1
0 votes
1 answer
40 views

K-fold Stratified cross validation on a dataset with examples of variable length

I have a dataset of audio recording of variable length with large std which are heavily imbalanced in terms of total duration per class. So in stratified k-fold cross validation I would like to main ...
  • 11
0 votes
0 answers
158 views

difference between stratification and blocking in experimental design

What is the difference between stratification and blocking in experimental design(or randomized control trial)? Blocking is to obtain homogeneity in a controlled factor. However, I can block more than ...
  • 1,315
0 votes
1 answer
34 views

How to update survey weights after fixing strata membership/assignments?

Imagine we conduct a survey using stratified sampling, and after the survey closes, we find out that we had misclassified some of the respondents. They actually belong to different strata than we had ...
1 vote
1 answer
47 views

Estimating a population total from a stratified simple random sample

I have a stratified population. I want to estimate a population total $T$ from a stratified simple random sample. I have two strategies: I compute $\displaystyle T=\sum_h N_h\bar x_h$ where $x_h$ is ...
  • 115
4 votes
1 answer
161 views

Subclassification on a propensity and prognostic score grid with k × k subclasses, using R MatchIt

I would like to perform a joint subclassification of some data on the propensity and prognostic scores as described in this paper "On the joint use of propensity and prognostic scores in ...
1 vote
1 answer
76 views

Cox PH controlling for multiple events

I'm working on a cox proportional hazard analysis in R using the survival package. I´m analysing covariate effects on fish movement within a study area. The study area is divided into two zones ("...
  • 11
0 votes
1 answer
110 views

Choosing an equal number of samples from each strata - what is this called?

Suppose I have a highly skewed distribution and a proxy measurement. I use this proxy measurement to bin the samples of this distribution into different "strata". I then take N samples from ...
0 votes
1 answer
117 views

When having non-proportional hazards, should I use stratified Cox by time or Logrank tests within periods?

My data have non-proportional hazards with clear separation. Should I handle it via stratified Cox regression or using separate Log-rank test within subsets? I will use R only to illustrate. I want to ...
2 votes
1 answer
58 views

When computing period-specific hazard ratio using Cox, should I add variable:strata or full variable * strata?

Let's asusme I want to calculate separate hazards ratio in two periods, split like below. ...
1 vote
1 answer
92 views

How to resample members from the population who didn't respond after the survey?

I have used stratified random sampling on population to generate the sample. Now the issue is if after the survey is conducted some of the members in the sample ...
  • 63
0 votes
1 answer
25 views

How to calculate sampling error for proportionate sampling?

I have done sampling using Proportionate Stratified Random Sampling. The table below shows the proportion of each groups in the sample and population. This is the formula for Standard Error (...
  • 63
1 vote
0 answers
45 views

Draw a stratified sample in panel data

Question: How can we draw a stratified sample in panel data context when the stratifying variables are not fixed over time? Background: I have panel data on workers (id) over time (t). I want to draw ...
  • 269
0 votes
1 answer
47 views

Partitioning survival data into prognostic groups

I have survival data (n ~ 1000) with ~40% censoring and ~10% missing data. I want to partition the subjects into 4 prognostic groups based on survival. Misganow B and Vidyasagar M (Exploiting Ordinal ...
0 votes
0 answers
43 views

Stratified sampling with unknown strata sizes

I'm in a setting where I have natural population strata (that I can infer from the samples), but I don't know the strata sizes. Are there ways to get valid confidence intervals in this setting?
  • 1

1
2 3 4 5 6