# Questions tagged [survey-weights]

survey weights are used when data are collected according to a probability sampling design with unequal probabilities of selection and/or response

222 questions
Filter by
Sorted by
Tagged with
1 vote
29 views

### Quantile regression to compare two populations at different time points

I am trying to compare two different populations (e.g., 2001 and 2011) on the same variable. These are different, independent populations (this is NOT a longitudinal study; rather, two cross-sectional ...
• 11
29 views

### How are effect sizes typically defined under complex sampling?

In some fields it is common to quote comparisons in terms of standardised effect sizes. For example, a difference in means gets scaled by the sample standard deviation to give an effect size. This ...
• 43.7k
10 views

### Pooling survey data with panel households

I am analyzing some data from a national survey. I am working with two sets of data for the same variable (wealth) and some of those households are panel (i.e. interviewed both times). Now I want to ...
• 1
1 vote
17 views

### Handling Missing Groups in Stratified Sampling for Weighted Mean Calculation

I conducted a statistical survey using a stratified sample to measure the knowledge of Italian students on a specific topic. The population was stratified according to the following categories: Area (...
17 views

### Defining a variable based on two different variables with different weighting schemes in NHANES

I want to define a derived variable (Let's call it $Z$) using two original variables ($X$ and $Y$) in NHANES. If any of $X$ or $Y$ meets the criteria, the value for $Z$ should be 1; otherwise, it ...
1 vote
27 views

### Combining Survey Weights

I have an annual survey that is somewhat complex in design. Sample frames are pulled quarterly and overlap. Each quarter's sample is removed from the subsequent quarter's frame. Samples are stratified ...
73 views

### Is bootstrapping inherently Frequentist? If so, how do we do a Bayesian non-parametric two-sample test?

I normally use frequentist statistics but I now want to use Bayesian statistics as I want to carry out a two-sample (randomised control trial) test that includes prior information. I have an existing ...
• 987
13 views

### Do replicate weight, when the are available, supersede all the design-based procedures and analysis?

If the agency that conducted a survey and releases micro data at the individual or household level also supplies replicate weights for that sample, do these weights completely supercede any need or ...
• 3,185
12 views

### Whether to specify ddf in confint.svyglm()

I have a main question about whether to specify ddf in confint.svyglm(). Using the two specifications below generate slightly ...
25 views

### Weighing Data Issue

I am looking at e-cig prevalence within a city. I used surveys to collect data from residents, and I have a query around weighing data. I have made the assumption, due to over and underrepresentation ...
50 views

### Post-hoc tests of interaction for a negative binomial regression with survey weights?

I ran a negative binomial regression with survey weights using the R package survey and the function svyglm() and observed a ...
• 318
80 views

### Weighing Questions within a Survey

I work for a public child welfare agency. We have something called a level of care tool that categorizes children based on the amount of care they need. This helps us identify appropriate care options ...
22 views

### Use calibration weights to correct for unit non-response bias?

I have a question about how calibration weights can be used to sufficiently correct for unit non-response bias. Suppose the sample is s and the response set is r. Calibration is applied to the ...
1 vote
208 views

### How do I use something like predict.glm (in R) with a svyglm model and why don't my predictions match my data?

I'd like to estimate "cost" using some covariates with a weighted gamma model using svyglm. The weights sum to 1, and there are about 10,000 rows in the dataframe df total, with columns ...
• 203
127 views

### Are there coventions on reporting weighted sample sizes?

Suppose I analyze survey data and calculate weighted means. Should I report the sample size if it differs from the unweighted sample size, as would be the case with non-normalized weights? It seems ...
• 85
1 vote
53 views

### R survey package: compare weighted prevalence with literature result

I have a large dataset (>3000 cases) with results of serological tests. Based on these results i want to calculate the weighted prevalence of the disease. The data is categorical (0 = disease ...
1 vote
65 views

### Multilevel Regression and Poststratification (MRP) weighting in the opposite direction to Poststratification alone

We are using MRP to derive test norms for an IQ test (Culture Fair Test, CFT) based on the TwinLife data. We adjust for age, sex, education, and migration background. Although a probability sample, ...
• 11
30 views

### Can I add a variable to a complex sample, and run a regression?

In a survey, a complex sample was collected, and the sample was designed to provide estimates at national level. In other words, individuals from one state were more likely to be sampled due to ...
• 439
53 views

### Adjusting the sampling probability during sampling

Let $n$ individuals in a statistical population be identified by $p.id \in \{1, 2, ..., n\}$ where the order is randomised. Assume, for simplicity, that all individuals are included in the sampling ...
• 592
31 views

### Complex survey design with multiple waves

The organization I work for has collected data from individuals in multiple waves. Their goal was to collect 333 individuals in 6 different groups (genderXgroup). If the first Wave did not reach 333 ...
16 views

### Sampling correlated clusters and calculating their weights

In a survey I want to do I have the following problem: I have 20 clusters, and I need to choose 5. Each cluster has 10 observations, and I need to choose 2. Lets say that the probability of choosing a ...
• 1
34 views

### How to treat age-eligibility thresholds in household surveys (e.g. HRS)?

Most household surveys have age-eligibility thresholds. The HRS interviews individuals aged 51 and older, plus their spouse (if any) using PPS sampling. Do I need to drop individuals who are younger ...
• 41
1 vote
47 views

### Unbiased estimate of mean test score of pupils in a country (sampling frame of schools is avaible only)

My primary goal is to get unbiased estimate of mean test score of every pupil in a country. I have no sampling frame of all pupils to randomly sample from. But I have a sampling frame for every school....
• 101
1 vote
165 views

### When to use replicate weights in complex survey analysis

I am curious about when it is recommended to use replicate weights in survey analysis. I compared the usual survey analysis with using replicate weights, as illustrated below. Based on the paper "...
14 views

### Study changes of association between an independent variable and a categorical outcome with more than 2 categories

Suppose I would like to study the association between sex (male and female; independent variable) and taste preference (sweet, bitter, and sour; dependent variable). I have three cross-sectional ...
73 views

### Different ways to define survey design object under MCAR assumption

I have a stratified random sample, and would like to conduct complete-case analysis, assuming Missing Completely At Random. However, I find that there seem to be two ways to define survey design ...
1 vote
140 views

### Is it reasonable to subset a survey design object by dependent (outcome) variable and fit a weighted logistic regression model?

I would like to study which factors are associated with an outcome which has more than two categories. After considering multinomial logistic regression model (which I find is very challenging to ...
99 views

### Is it valid to compute survey weights using the distribution of a hypothetical/"imaginary" population?

I'm informally reviewing a study by a coworker, but as I'm not a specialist of survey weighting procedures, I need a second opinion about something I disagree with him. He collected a convenience ...
• 57
65 views

### Should we use survey::svyglm() to compute correct standard errors with WeightThem?

I need to use multiply imputed datasets and weights before using linear models (linear, logistic and negative binomial). I have 2 sources of informations that point to different directions to compute ...
74 views

### writing a simple linear (and logistic) regression equation that incorporates survey weights

I am running a basic linear (and then logistic) regression that incorporates basic survey weights. I would like to specify the general regression equation with the survey weights for a manuscript. But ...
62 views

### Longitudinal survey data weights

I'm dealing with a longitudinal survey data now. Do we need to use survey sample weights while running panel data models (e.g., Fixed Effects, Random Effects)? In other words, would it be fine if I ...
• 223
1 vote
64 views

### Is it possible to use poststratification when some observations have missing values on the variables used as strata?

This is a theoretical question, so I don't have data to share. Let's say I know the percentage of men and women in my population of interest, as well as the distribution of occupations and age ...
• 13
1 vote
74 views

### How to interpret survey data with demographic information?

I have little statistical experience, but am helping to run a community needs survey for my organization. Many of the questions have a yes/no or multiple choice answer format. For example, "Do ...
• 11
12 views

### Longitudinal sample with varying levels of non-response

I'm using answers to a specific question from the General Social Survey ("do you feel rushed"?) to compare statistics over multiple years. The answers are "Always" "Sometimes&...
1 vote
90 views

### Domain (subgroup) estimation in a stratified random sample

I want to ask a question about domain estimation (i.e., estimation of a parameter among subpopulations) in a stratified random sample. It seems to me that in a stratified random sample, domain ...
147 views

### How can I reweight survey data

I have survey data from a complex survey with stratification, weights and clustering. I'm using the survey package in R to run regressions: ...
• 216
1 vote
67 views

### Variance test with survey weights

When not working with surveys, you do a variance test with var.test(). What do you do when you want to account for complex survey design?
1 vote
23 views

• 21.8k