Questions tagged [survey-sampling]
Creating samples from a well-specified population (human: all adults; registered voters; individuals with diabetes; students of a university; establishment: all firms; firms with employment of 200 or more in New York City; resource: all land of a country or a state/province) using a probabilistic method, with the purpose of inference to that specific population
245
questions
2
votes
0
answers
20
views
Use calibration weights to correct for unit non-response bias?
I have a question about how calibration weights can be used to sufficiently correct for unit non-response bias. Suppose the sample is s and the response set is r.
Calibration is applied to the ...
- 362
2
votes
1
answer
78
views
In stratified sampling, why is the stratum population variance obtained by dividing by 1 less than the stratum size
I am aware that flavors of this question get asked a lot, for e.g., here. I am fine with the sample variance being divided by $n-1$ and that is what makes it an unbiased estimator of the population ...
- 275
0
votes
0
answers
14
views
What weight to use for using NAMCS and NHAMCS together?
I am interested in analyzing the total prescription of aspirin in NAMCS and NHAMCS (https://www.cdc.gov/nchs/ahcd/index.htm) during a given year for all visits. NAMCS and NHAMCS each had a weight and ...
- 1,416
0
votes
2
answers
85
views
Reliability of online surveys
I'm trying to get an idea about reliability of online surveys: I found some indication that "internet-based surveys produce data that is at least as reliable, valid, and of equal quality as data ...
- 103
1
vote
0
answers
30
views
Sampling inquiry for thesis [closed]
I have a mixed-method thesis ongoing and I plan collecting data on my own college (namely college X), specifically from students and faculty members on my department. Evidently, that would be ...
- 41
0
votes
1
answer
50
views
comparing two samples drawn using two different sampling methods
This is a hypothetical question, so I don't have a lot of additional details to give. However my question is pretty straightforward:
Is it theoretically valid to conduct tests (e.g. for comparing ...
- 57
0
votes
0
answers
30
views
Can I add a variable to a complex sample, and run a regression?
In a survey, a complex sample was collected, and the sample was designed to provide estimates at national level. In other words, individuals from one state were more likely to be sampled due to ...
- 439
0
votes
0
answers
51
views
Adjusting the sampling probability during sampling
Let $n$ individuals in a statistical population be identified by $p.id \in \{1, 2, ..., n\}$ where the order is randomised. Assume, for simplicity, that all individuals are included in the sampling ...
- 582
1
vote
0
answers
66
views
Measuring the reliability of a survey data
I have a survey data and I applied KR20 on it. The KR20 score is 0.63 which means this survey result is not consistent and reliable, at least not in a reliable range with the definition of a reliable ...
- 31
0
votes
0
answers
18
views
Effective sample size when the estimated proportion is zero
In order to estimate the proportion of fradulent invoices, we did a two-stage probability weighted sample. A subset $m$ out of $M$ departments were chosen in the first stage, and $n_m$ invoices were ...
0
votes
0
answers
25
views
Sampling error for proportion with finite population - which correction to use?
I am trying to calculate sampling error for a questionnaire that was answered by some of the participants in a program (say about . I want to calculate the sampling error for the proportion of the ...
- 134
0
votes
1
answer
33
views
How to treat age-eligibility thresholds in household surveys (e.g. HRS)?
Most household surveys have age-eligibility thresholds. The HRS interviews individuals aged 51 and older, plus their spouse (if any) using PPS sampling.
Do I need to drop individuals who are younger ...
- 41
1
vote
0
answers
43
views
Unbiased estimate of mean test score of pupils in a country (sampling frame of schools is avaible only)
My primary goal is to get unbiased estimate of mean test score of every pupil in a country. I have no sampling frame of all pupils to randomly sample from. But I have a sampling frame for every school....
- 111
1
vote
1
answer
93
views
When to use replicate weights in complex survey analysis
I am curious about when it is recommended to use replicate weights in survey analysis. I compared the usual survey analysis with using replicate weights, as illustrated below.
Based on the paper "...
- 362
0
votes
0
answers
12
views
Study changes of association between an independent variable and a categorical outcome with more than 2 categories
Suppose I would like to study the association between sex (male and female; independent variable) and taste preference (sweet, bitter, and sour; dependent variable). I have three cross-sectional ...
- 362
2
votes
1
answer
72
views
Different ways to define survey design object under MCAR assumption
I have a stratified random sample, and would like to conduct complete-case analysis, assuming Missing Completely At Random. However, I find that there seem to be two ways to define survey design ...
- 362
1
vote
2
answers
93
views
Is it reasonable to subset a survey design object by dependent (outcome) variable and fit a weighted logistic regression model?
I would like to study which factors are associated with an outcome which has more than two categories. After considering multinomial logistic regression model (which I find is very challenging to ...
- 362
0
votes
0
answers
12
views
Longitudinal sample with varying levels of non-response
I'm using answers to a specific question from the General Social Survey ("do you feel rushed"?) to compare statistics over multiple years.
The answers are "Always" "Sometimes&...
- 31
0
votes
0
answers
113
views
What is the difference between a repeated cross-sectional survey design and a trend survey design?
Most of the references I have checked for repeated cross-sectional design and trend design (a type of longitudinal design) have said that they are one and the same. However, my professor says that ...
1
vote
1
answer
64
views
Domain (subgroup) estimation in a stratified random sample
I want to ask a question about domain estimation (i.e., estimation of a parameter among subpopulations) in a stratified random sample.
It seems to me that in a stratified random sample, domain ...
- 362
0
votes
0
answers
99
views
How can I reweight survey data
I have survey data from a complex survey with stratification, weights and clustering.
I'm using the survey package in R to run regressions:
...
- 235
2
votes
1
answer
40
views
Cluster sampling result in larger sample-to-sample variability
I'm reading STATA's Survey Data Reference Manual.
There is written that:
Cluster sampling typically results in larger sample-to-sample variability than sampling individuals directly.
Do you have an ...
- 2,261
0
votes
1
answer
48
views
Can I make a proportional-to-size without replacement sample (PPS WOR) self weighted?
Let's say I have 100 schools and each has a different number of students. I want to estimate which % of students are in schools with electricity. Simulation and theory indicate it is more efficient to ...
0
votes
0
answers
18
views
How can I test if two clustered survey samples come from the same population?
Say I have two samples coming from surveys with complex sample design (stratification, clustering, unequal probabilities of selection, etc...). How can I test if the the two samples come from the same ...
- 1
0
votes
0
answers
55
views
A numerical example for combining post-stratification weights
I'm reading Using Weights in the Analysis of
Survey Data by David R. Johnson .
When we conduct a survey, people have different likelihood to respond. For example, suppose there are 50% males and 50% ...
- 2,261
2
votes
1
answer
152
views
Appropriate way to use post-stratification weights when running statistical tests SPSS
I have used Complex Samples in SPSS (and SUDAAN in SAS, Survey in R) when working with survey data that were collected using a sampling design that was not random. For example, when an oversample was ...
- 21
1
vote
0
answers
18
views
Small Area Estimation techniques when no micro information is available
Small area estimation (SAE) techniques combine information from household surveys with existing auxiliary information at population level to make inferences of certain indicators for population groups ...
- 11
7
votes
1
answer
163
views
Who created the "soup analogy" for sampling
The soup analogy is,
You only need a single spoon to sample the soup, provided it is well stirred.
It has been used several times here Sampling distributions of sample means and What is your ...
- 497
3
votes
1
answer
73
views
What are the differences and common points, if any, between oversampling as a survey design method and oversampling in a machine learning context?
I've seen the term "oversampling" used in a survey design methodology context and in a machine learning context (e.g. methods like SMOTE). I'm intrigued by the differences between the two.
...
- 33
3
votes
0
answers
72
views
What is the (Ratio estimator for the) covariance of two weighted means? [closed]
In a previous question I've asked How to estimate the (approximate) variance of the weighted mean?, specifically, how to prove the following formula:
$$
\widehat{\sigma_{\bar{y}_w}^2} = \frac{1}{(\sum{...
- 21.6k
5
votes
1
answer
137
views
Why does the survey package in R and SPSS complex samples add-on give different standard errors?
I was comparing results that I generated in R for complex survey analysis using the survey package to results from SPSS using the complex samples analysis add-on. The sample size is large ~ N=5500
...
- 517
1
vote
0
answers
27
views
Conformal prediction for model-assisted survey estimation
In model assisted survey estimation, one typically uses the generalized difference estimator:
$$
\hat{t}_{ma} = \sum_{k \in U} \hat{m}(\mathbf{x}_k) + \sum_{k \in S} \frac{y_k - \hat{m}(\mathbf{x}_k)}{...
- 11
5
votes
0
answers
135
views
Question concerning svydesign and svyglm in R
I have a complicated data set which was made by a multistage stratified cluster design. I had originally analysed this using glm, however now realise that I have to use svyglm. I'm not quite sure ...
- 63
0
votes
0
answers
23
views
Definition of rotated panel sampling
I am doing exercises and I come across a question that asks me to describe sampling with rotated panel.
What does rotated panel sampling mean?
- 73
2
votes
1
answer
41
views
Can I CUT a sample to become representative?
Suppose that, from a finite population, we estimated the minimum sample size as 1000 to reach our desired confidence level and error.
Data was collected using an online survey and the survey remained ...
- 439
0
votes
0
answers
29
views
Is it appropriate to pre-stratify and post-stratify along different delineations of the same variables in a single survey?
I am working in the context of opt-in, web-based surveys. Often the desire is for accurate population estimates, and often at a country-wide level. The standard approach at this organization is to ...
1
vote
0
answers
19
views
How can I show probability of selection change when adding stratification to a survey design
I have a survey that uses a stratified sampling approach with optimal allocation.
The team conducting the survey has asked that we make two changes:
Subdivide one of the strata into smaller pieces. ...
- 123
2
votes
0
answers
196
views
Survey with two simple random samples without repetition
I have an particular exercise of sampling survey, or sampling theory, which I report below.
One is interested in knowing the price per gram of gold produced by 100 companies. A monthly survey of a ...
- 73
0
votes
1
answer
20
views
Population bias in survey leading to inaction
This isn’t exactly an academic statistics question, but it is a real problem that I’m trying to understand with regards to bias in survey statistics leading to issues in real-world decision making.
I’...
3
votes
1
answer
96
views
Is post-stratification inherently non-Bayesian?
It is increasingly common to employ regression with post-stratification. Since probability-weighting is incoherent in Bayesian inference (thus why sampling/survey weights and weighted psuedo-...
- 761
0
votes
0
answers
87
views
(i.i.d) Random sampling assumption in practical situations
This is a practical question.
Assume that there are two finite populations X and Y in the real world. For example, we want to compare $\bar{X}$ and $\bar{Y}$. We can use a probability sampling scheme ...
- 135
8
votes
5
answers
2k
views
When sampling a population for surveys we can often limit our sample size to hundreds, but when doing a Monte Carlo simulation we need way more. Why?
I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me do my best.
I‘m trying to develop an intuition for sample sizes and when they are sufficient ...
- 183
0
votes
1
answer
47
views
How to interpret this Cumulative distribution function? [closed]
My colleagus has asked me to read through the ETOS material for estimating confidence intervals (published by Statistics Sweden) and point estimates, knowing I have a bachelor's degree in statistics. ...
- 671
1
vote
0
answers
19
views
How to top-up a panel survey to also get population estimates
I'm running two sequential surveys on the same population, and I have a question about the proper sampling methodology in the second round of a panel that is also meant to get population estimates. I ...
- 133
2
votes
2
answers
66
views
Analyzing data from a non-randomized sampling design (ecological monitoring)
I have 2 questions about analyzing data that was not randomly sampled from a population.
I work with "ecological monitoring" data that involves repeatedly taking measurements from the same ...
- 1,529
0
votes
1
answer
150
views
How do you calculate the total sample size in stratified sampling?
I know that we can allocate observations from the total sample to each strata either using proportional allocation ($n_{h}/N_{h} = n/N$) or optimal allocation:
$$n_{h} = \left [ \frac{\frac{N_{h}S_{h}}...
- 59
5
votes
3
answers
213
views
How to check the data is generated by machine or human?
I have a bunch of data points (about 300 samples in total), each sample is a number from 1 to 3 (from {1, 2, 3}).
These numbers are supposed to come from a survey. Are there any statistical methods to ...
- 185
2
votes
0
answers
40
views
Alternatives to Fuller’s (2009) Sampling Statistics
I’m taking a self-study course in sampling statistics this semester and my professor chose Fuller’s (2009) Sampling Statistics for both the content and the homework questions.
However, I am really ...
- 61
1
vote
1
answer
164
views
Sample size calculation for a difference between two groups with clustered data
I want to compare proportions or means in two groups in a clustered sample. Suppose the sampled clusters are schools or hospitals or Census areas, and we sample from each of these an equal number in ...
- 266
1
vote
0
answers
51
views
multiple questions about setting up survey weights with the application of a combination of different types of weights - ESS
Checking out this file published by the european social survey website
https://www.europeansocialsurvey.org/docs/methodology/ESS_weighting_data_1.pdf
it states that :
• when analysing data for one ...
- 367