Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [stratification]

A sampling technique in which the population of interest is partitioned into subsets ("strata") based on characteristics known at all units before sampling.

0
votes
0answers
15 views

compute AUC and statistical testing of stratified data

I have a dataset where samples are stratified in groups. That is, there are N samples per examination, and M examinations per subject. I would like to account for this when estimating the ...
2
votes
1answer
51 views

Odds ratio not between the two odds ratio of a stratified analysis

This is not the first time I have performed stratified analyses based on logistic regressions, but I have never before been confronted with this situation. When I test my relationship in the overall ...
1
vote
0answers
158 views

Calculating a sample size based on the target width of a confidence interval with stratification

I am reviewing a sampling design devised by a colleague and completely fail to understand it, although I am not a novice in statistics (but not a huge expert either). The said colleague is no longer ...
0
votes
1answer
19 views

random vs. stratified Cox model

What is the difference in interpretation of the effect estimates in a Cox model stratified by sex vs. with a random statement for sex? Thanks.
0
votes
0answers
6 views

Difference between Confounding and Effect Modifier

I am searching everywhere about the differences between Confounding and Effect modifier, but not able to find it. Kindly help me in this. Can you please answer using examples rather than definitions.
0
votes
0answers
13 views

Should stratified cross-validation be used in a regression context?

After a number of Google searches and looking at various stack posts, I cannot find much information or discussion about using stratified cross-validation in regression context. I am modeling forest ...
0
votes
0answers
29 views

Nested CV with Stratified Kfold

I am using nested CV for model evaluation and my target variable has imbalanced classes. With Sklearn, I am using GridSearchCV and cross_val_score to perform the nested cross validation. Each takes ...
0
votes
0answers
7 views

Least square estimate for post-stratification sampling

I figured out via the normal linear regression method that Beta0 hat = ybar - Beta1 hat xbar. But I am not sure how to find out the least square estimate for Chat. Is anyone able to help me? Thanks!! ...
0
votes
0answers
41 views

Calculating sample size for a stratified random sample

I have a total population of 4,000 farmers, divided into three unique regions. Approximately 50% of the farmers live in Region A (N=2,000), 27% in Region B (N=1,080), and 23% in Region C (N=920). I am ...
0
votes
0answers
13 views

Stratified Sampling: Given required bound, calculated $n_h$ is bigger than $N_h$?

I'm dealing with a question that has given me a peculiar result and I would like someone's opinion on how to deal this: Say you have a population of $N=550$ objects: $N_1=75$ red and $N_2=475$ blue. ...
0
votes
0answers
13 views

Stratifying a multivariate dataset

I woul like to stratify a multivariate dataset in different stratas in such a way that the elements of each strata are similar. My idea is to have different groups whith the element within a group ...
0
votes
1answer
177 views

what's the difference between stratified sampling and matching?

I am trying to find a good technique to balance data in which the minority class is about 1% of the data. As I understood, the most common practice is matching. What is the difference, though, ...
0
votes
0answers
121 views

Fold size and stratified k-fold cross-validation dilemma

So, as far as I understand, all folds in k-fold cross-validation need to be the same size, or as close as possible. However, if one uses stratified cross-validation, each class should be represented ...
0
votes
0answers
58 views

how to use boot package to do stratified bootstrapping?

Here's a toy data set that replicates my problem. I am interested in knowing the confidence intervals of an empirical distribution that is composed of the scores of each school at the proportion that ...
0
votes
1answer
53 views

Optimal multivariate binning where the cut-points must be the same for all observations

I have a large data set with many discrete and continuous variables. All the variables are present in every observation. I want to explain (the log of) one continuous variable using all the other ...
0
votes
0answers
61 views

Stratified cross validation with groups

I have a model for a binary classification problem that I want to cross validate. The data is divided into groups. Some groups contain samples in both classes, others only contain samples from one ...
0
votes
0answers
20 views

What methods exist for multi-output stratification (multi-label with different mutually exclusive label sets)?

To elaborate a bit: Methods do exist for single-output multi-label stratification (e.g., see scikit-multilearn). And there's a perfectly serviceable naive method for multi-class problems. The ...
2
votes
1answer
36 views

How to control for severe medical cases using survival analysis and Cox regression?

I have a longitudinal medical record dataset. My cohort is made up of patients with a particular disease. There are no members of this cohort without this disease. Disease indications are denoted by a ...
0
votes
0answers
7 views

Model to Impute strata data according to higher level data

I've got regional level data and I want to impute said data on a county level strata (smaller strata with respect to the regional strata). I know I can do that if I have a series of variables on the ...
0
votes
0answers
17 views

Sampling methods - Stratified Vs. Probability Proportionate to Size Cluster

India has 29 States, each of which is further sub-divided into smaller administrative Districts of varying size and population. I need to download micro (firm-level) data from each state, but I do not ...
0
votes
0answers
15 views

Regression model when stratified randomization is used

I have been going through articles on stratified randomization but I haven't seen one that elaborate regression function generated and also elaboration of strata effect on the outcome. I will ...
0
votes
0answers
74 views

Stratified Kfold splits by inputs instead of just being based on outputs

It's known that a stratified split can easily be done if there is a known imbalance in the output distribution (or output classes). Is it possible to do a stratified k-fold using the input ...
0
votes
0answers
21 views

What are the differences between Domain Estimation and Poststratification

Both of these two methods will firstly select a simple random sample without replacement and decide which groups these observations belong to and use ratio estimation to get quantities of interest. It ...
0
votes
1answer
348 views

Difference between Multistage Sampling and Stratified Random Sampling?

I know the question is a very elementary one, but I simply cannot understand the difference other than the fact that an SRS is a form of Multi-Stage Sampling. Can anyone provide a simple example(s) to ...
0
votes
0answers
23 views

How can stratified kfolds perform worse than regular kfolds?

I am working with unbalanced classes to solve a classification problem (whether individuals pay their fees or not). My class imbalance is 75% positive (paid) and 25% negative (unpaid). I have read ...
0
votes
1answer
55 views

what type of sample is this?

I have the folowing table: according to this example, there are 40 observations distributed over 10 stores and 4 weeks of the month. Objective: to make a sample of 90%, 80%, 75% and 50% of the 40 ...
1
vote
0answers
30 views

Benefit of scaling survey design weights

In the european social survey the design weights are scaled to the sample size (see quote and source): As with the design weights also the post-stratification weights are scaled to the sample size, ...
1
vote
0answers
30 views

Sampling - optimal allocation for quantiles?

Say we have variable with a typical heavy tailed distribution following the Pareto principle. We divide the population into two strata (following the 80 / 20 rule) and use a stratified sampling design ...
0
votes
0answers
21 views

Should the same train/test set be used for all models if training multiple binary models for multi-class classification?

I have 100 classes in my input space. I plan to build 100 random forest classifiers that will determine if a given input matches a class (1) or not (0), such that a True/False model exists for each ...
0
votes
1answer
33 views

Cox model with a predictor variable within only one stratum

I'm investigating survival in a cancer patients cohort. The Cox model I'm using is stratified by stage and adjusted for several variables. I would like to add one variable RT (Radiotherapy) which is ...
0
votes
0answers
38 views

Prove significant effect of third variable on a correlation

So I was measuring correlations in Boxscores of basketball players in the NBA. 3PA DRB -0.205499 I was trying to find some interesting correlations. ...
1
vote
0answers
161 views

svydesign fpc term in 2stage stratification [closed]

I am having some problems with svydesign() in R. My sample design is a 2 stage stratification. ...
1
vote
1answer
11 views

What is the error of the global mean given known equal errors for each stratum?

This was asked to me by a colleague. It seems to be an easy one but I wasn't able to find the derivation online. I've added my own attempt below.
0
votes
0answers
23 views

Combine Surveys

I have a quick question in combine surveys of different years. Suppose that we have a complex survey conducted each year for five year in a row and I want to combine the five surveys into one. Shall ...
0
votes
0answers
35 views

Negative variance with ratio and regression estimators

Considering multivariate stratified sampling for two study variables $y_1$,$y_2$ and two auxiliary variables $x_1$,$x_2$ with specific correlation, I generated populations for four strata with ...
0
votes
1answer
69 views

How to resample from uneven strata

I've got records from patients with different cancers. Naturally, common cancers were registered often, and the cases in this group are then overrepresented and vice versa for the rare cancers. Let's ...
2
votes
0answers
53 views

On outcome stratified random forest, problems?

Hello Crossvalidated! I have a question that I can't figure out. I am working on building a classifier for a dichotomous outcome (0, 1). I use R for this. I used a Random Forest algorithm from the ...
0
votes
0answers
115 views

Stratified random sampling with multiple variables - alternatives to clhs

I would like to select samples from a data set. As an example I modified the iris data set from R. I deleted 25 observations of the species setosa. 50 observations are species versicolor, 50 ...
3
votes
1answer
565 views

Bootstrapping dataset with imbalanced classes

I am trying to build an ensemble model to classify dataset with imbalanced data, where some of classes have just a few samples. And, because of this dataset property, when I am doing re-sampling with ...
4
votes
2answers
126 views

Are the precision gains from stratified sampling a free lunch?

I'm following the discussion in Field Experiments by Gerber and Green, Chapter 3 as well as these resources: http://ocw.jhsph.edu/courses/StatMethodsForSampleSurveys/PDFs/Lecture4.pdf http://home....
2
votes
0answers
29 views

Variance Reduction: “Smaller Samples Have Less Variance”

I was working on stratified sampling for variance reduction for monte carlo estimation, and I found an odd statement from this website (link posted below). The first line on his site is, "Intuitively,...
2
votes
1answer
811 views

Stratification vs. interaction

I'm doing a secondary analysis on a large sample of children from 4- to 18-years-old using logistic regression. In addition to analyzing effects of predictors (age, sex, IQ, autism severity, medical ...
1
vote
1answer
84 views

How to combine two sets of samples from an unnormalised distribution?

Imagine that I have an unnormalised distribution $P$ with density function $p(x)$ for $x \in \mathbb{R}^d$. $P$ has two well-separated modes and there are two sets of i.i.d. samples with the size $n$ ...
1
vote
1answer
2k views

Target versus sampled population

I'm having a difficult time understanding the difference between target population and sampled population using stratified sampling. For example, say I want to run some statistics on university ...
7
votes
0answers
174 views

How to construct confidence limits based on small stratified samples of finite populations?

Imagine a business wishes to audit its transactions. It has a database summarizing the transactions, which constitute a sampling frame for the population. It would be time-consuming and expensive to ...
1
vote
0answers
17 views

Checking for regional effects in survey that is stratified according to region

I have access to two surveys of the population in a specific country - one where the country is divided into 10 regions that are used as sampling strata, and another one where the country is divided ...
1
vote
1answer
53 views

Proof that the one-step estimator from logistic regression is the Mantel Haenszel estimator?

I was rereading some sections from the Breslow and Day IARC publication and noted the following: Clayton (1982) has shown that [the Mantel Haenszel] estimate arises at the first stage of ...
0
votes
0answers
132 views

How to adjust for confounding variables across different study periods?

I have a continuous & categorical outcome variables in three groups of patients, where the groups are defined by time periods 2010-2011, 2012-2014, 2015-2016. I found out that age and gender are ...
2
votes
1answer
430 views

Stratified random sampling when strata overlap

I am sure the title might be confusing, but here is what I am dealing with: I am running a survey at a health care center. The health center has around 15k active visitors. There are 5 departments ...
0
votes
1answer
75 views

Sample stratified according to region - how representative is this sample on the regional level?

I am doing a survey analysis of a specific country, and I am interested in comparing different regions of that country. Generally speaking (if possible), when a sample is stratified according to ...