Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [survey-weights]

survey weights are used when data are collected according to a probability sampling design with unequal probabilities of selection and/or response

0
votes
0answers
5 views

Probability Weights and Dropping Observations

I am trying to determine how applied empirical analyses adjust probability weights after dropping observations. For example, say I have a strict subset of the population that takes a 2013 cross ...
0
votes
0answers
4 views

How to aggregate sampling weights/probabilities to high levels when outcome is count?

I have sample weights at two levels, and I want to calculate a test across two groups of the count, within group, of a binary variable. I have a (survey) sampling probability at the individual level ...
0
votes
0answers
11 views

How to calculate “weight” that balances the sample dataset when we are given population categories ? (find survery weights)

I am very unfamiliar with survey designing and this might be a very basic question to statisticians and surveyors, but still, I seek help finding the weight for each sample data that will address the ...
0
votes
0answers
11 views

How does missing data affect analyses using svyset?

I am running some simple statistics using Stata and its svyset command. Does listwise deletion of cases during analyses affect the svyset? Are results still going to be weighted properly and the ...
0
votes
0answers
7 views

Design effect formula

I saw two formulas for design effect. One is deff = 1 + rho (n – 1) , where rho is the interclass correlation and n is the number of elements in the cluster. Another formula is defining DE or ...
0
votes
0answers
27 views

Weights in “visited website” survey

I have a dataset with the browsing history of people in a country with age and gender, my goal is to give some information regarding some websites like : the market shares between several website ...
0
votes
0answers
56 views

Survey weights: calibration with continuous variables

I'm using the R survey package and trying to run the calibrate function. My setup: For each individual I have age, gender, ...
1
vote
0answers
15 views

How to include survey weights into a random intercept model? [duplicate]

I'm trying to run a random intercept model in R on an adolescent dataset with >100 schools (the school being the intercept). The data include a survey weight value for each observation, however lme ...
0
votes
1answer
48 views

How to apply sampling weights in R

I'm working with a large, national survey that was collected using complex survey methods. In order to make my results representative I need to account for sample weights and other survey design ...
1
vote
0answers
22 views

How do I convert a survey scale [7-point, -3 to 3] to a 7-point scale [1-7]?

I am working with a survey scale that is from -3 to 3. I have a mean value of .94 and I want to identify if there are ceiling effects, but I need to change the entire scale to 1-7 in order to ...
0
votes
0answers
24 views

Should weights be applied in generated quantities block in stan?

I want to do predictions via generated quantities block in stan. I have two questions: Should the weights be applied again in the generated quantities block in addition to the likelihood in the ...
0
votes
0answers
43 views

Weighted Empirical Cumulative Distribution Function (CFD): order values before or after weighting? [before]

My input data are some observations of a continuous variable, let's say the number of kilometers of motorbikes. I did a survey and I collected some observations. Somehow, I computed weights for all ...
0
votes
0answers
47 views

Confidence intervals for survey-weighted Poisson regression in R where counts are totals of the survey weights

Forgive me if this is a very basic question. I am using a large database of healthcare encounters that uses a stratified sampling approach. Each row in the database is a sampled encounter, and has a ...
0
votes
0answers
23 views

Regarding frequency and inverse probability weights

Deploying inverse probability weighting on a 3-group Setup, I examined for outlier activity, aswell deployed in a survey bin. Regression model. These estimates of ...
0
votes
0answers
30 views

Error variance estimation with weights

I am using data which include a (sample-)weight for each observation, i.e. the data is from a survey that has weights to make the sample representative for the US-population. I perform OLS to get some ...
1
vote
0answers
18 views

What is the impact of seed weights in raking (iterative proportional fitting)?

In survey weighting, I've seen that first a design weight adjustment is made (to reflect over- or under-sampling), and then a non-response adjustment is made (to reflect groups that are less likely to ...
1
vote
0answers
17 views

Modeling rates with complex survey data

I have data derived from a stratified, cluster random sample with post-stratification weights (corresponding to the inverse probability of response). These are person-level data. Let's say I want to ...
0
votes
0answers
16 views

How to calculate percentages and ratios for weighted surveys

I have a data set from a survey conducted by an expert across several countries, as depicted below ...
4
votes
1answer
77 views

Margins in “R” throws confidence intervals that do not contain cero, yet p-value > 0.05. Is this possible?

I am running a logit model on survey data using the svyglm function in the survey package in R. I am using the margins function to find the average marginal effects, but then something weird happens. ...
1
vote
0answers
24 views

Benefit of scaling survey design weights

In the european social survey the design weights are scaled to the sample size (see quote and source): As with the design weights also the post-stratification weights are scaled to the sample size, ...
1
vote
0answers
42 views

The set of variables used for weighing-up changes the resulting estimates

When comparing the effects of the set of variables passed to the svyby function on the resulting estimates and standard errors, I discovered that weighing up a single variable and two variables yields ...
1
vote
0answers
19 views

ulti-cohort longitudinal panel data: how to apply weights to models that incorporate variables from different years?

I'm running Stata 15.1 on OSX. The dataset in question comes from The American Panel Survey in which three cohorts of participants filled out surveys each month (some of which measured the same items) ...
1
vote
0answers
20 views

How Much More Information (as bits) is Gained (if any) from a Ranking vs. Likert Scale Survey of 100 Questions's / 1-5 Scale?

All other sources of noise controlled, I, know that asking users to rank their preference on a collection of items from "best" (5) to "least" (1) in lieu of having them rate each one individually on a ...
0
votes
0answers
21 views

Use of cross-sectional survey weights when employing mixed-effect regression models using multiple cross-sectional data

I have conducted an analysis using multiple-cross sectional datasets (i.e. combining different waves of the same survey). The survey provides cross-sectional weights for each wave. Considering that a ...
1
vote
0answers
12 views

when is it ok not to weight a national database analysis

I am running an analysis using a national database that has weights available to produce national estimates. However, I am comparing 2 procedures that are very specific to research hospitals only. ...
1
vote
1answer
40 views

Testing change over time with different sampling frames

In 2017 a representative sample survey of 400 schools was conducted with a stratified two-stage sample design. The sampling frame was an earlier school census. In 2018, a second round of the survey ...
0
votes
0answers
275 views

Combining multiple survey datasets with design weights in a single model

The analysis of survey data with design weights is a difficult topic. In my case, I am working with two datasets: 1) NHANES data, which makes use of cluster sampling and stratification, and 2) Survey ...
1
vote
0answers
60 views

Accounting for complex survey design for structural equation modeling

I am using proc calis procedure in SAS to perform structural equation modeling (SEM). I have a nationally representative survey data with person-level weights, strata and cluster variables. However, I ...
1
vote
0answers
47 views

Applying robust regression to complex survey data

My team is conducting an analysis using a large dataset of health data from >150 demographic and health surveys with the aim of identifying optimal metrics to quantify early childhood growth at the ...
1
vote
0answers
43 views

Can analytic weights be converted into sampling weights?

I am running a linear probability model, so I know I need to correct for heteroskedasticity. Since I know the variance of the error (from theory) to be $y(\pmb x)(1-y(\pmb x))$ where $y$ is the ...
2
votes
0answers
27 views

What do I do about unequal sampling probabilities for second-stage sampling units in a PPS sample?

Say that I am drawing a two-stage simple random sample. The first stage selectes a unit that is a cluster, the second stage selects units within the cluster. There are two different types of units ...
1
vote
1answer
94 views

Cox proportional hazards: time dependent covariates with survey weights

I'm analyzing data from a survey that utilized multistage probability sampling. I'm using R and therefore the bulk of my analyses with these data utilize the survey package to account for the ...
1
vote
0answers
57 views

How to weigh samples (representative of population) when comparing group means

I want to clarify my understanding of using sample weights when comparing means of sub-groups of a sample. Here is an artificial case with data that can be replicated in r (see code below): Let’s ...
2
votes
0answers
127 views

Equivalence of svyglm and glm for simple random surveys

I have been exploring the use of the svyglm function in R's survey package to analyse surveys with both equal and unequal sampling probabilites. For an unequal ...
0
votes
1answer
141 views

Converting survey results from a 1-4 scale average to a 1-5 scale average [duplicate]

I'm completely new at analyzing survey answers, and it will be great if anybody can help me out here with conversion technique. Survey participants were provided answer choices on a ranking scale of 1-...
1
vote
0answers
292 views

Replicate weights and the Current Population Survey

The Current Population Survey’s Annual Social and Economic Supplement (abbreviated, oddly, as ASEC) is the USA’s longest running and most detailed annual survey of income and employment. Along with ...
0
votes
0answers
93 views

How to calculate the standard deviation to be used for a confidence interval on a weighted data set?

Although there were some similar questions on the board, none seemed to quite be the same as what I'm asking. I have a set of survey values (satisfaction ratings) that have been weighted for non-...
1
vote
0answers
281 views

Test difference of population proportion and weighted sample proportion

I want to test for differences of the known proportion of the population vs. the proportion of a sample. The sample is weighted by sampling weights. The sum of weights is equal to the size of the ...
1
vote
1answer
198 views

Combining Multiple Years of Survey Data - Adjusting Survey Weights

I am working with the HCUP NIS dataset and have aggregated 5 years of data (2009-2013) for analysis. I am interested in doing trend analysis by the year (percent mortality each year, etc) as well as ...
2
votes
0answers
38 views

Should Mixed effects models with repeated cases have the same results as Weighted Mixed effects model?

I have a conceptual question that might also be a question about STATA and GLLAMM. Conceptually: Should duplicating some groups in a mixed effects model have the same effect as giving those groups a ...
2
votes
0answers
22 views

Problem computing population quantiles with survey micro data

All the major federal surveys come (American Community Survey, Current Population Survey, others) come with survey weights, such that the individual household observations times the population weights ...
0
votes
1answer
337 views

Difference of Two Proportions Hypothesis Test with Weighted Sample Data

I have survey data which contain respondents' answers to several questions. As the survey contained a disproportionate number of people from certain demographic groups, the survey results are weighted ...
0
votes
0answers
28 views

Survey weights and population size

When doing complex survey design, does weights necessarily gross up the data to the whole population size or just up to a certain level, e.g. 50% of the actual population?
0
votes
1answer
610 views

How to calculate sampling weight for small sample?

I have a very small sample size on drowning data of Bangladesh in following way Now I want to give sampling weight for further analysis. How can I calculate sampling weight for the data? I have ...
0
votes
1answer
173 views

Using poisson regression model to model change in prevalence

I am working with 3 waves of survey data. Many people have been surveyed multiple times, but many others are present only in 1 or 2 waves due to drop-off/resampling. Therefore, my design is multiple ...
1
vote
0answers
56 views

sampling and weighting algorithms for political survey

I'd like to find a readable reference (code or algorithmic description) for the sampling (méthode des quotas) and weighting (redressement des résultats bruts) algorithms used in political surveys. In ...
1
vote
0answers
86 views

Does exists a routine to perform Sensitivity analysis after weighting by inverse probability of treatment weight?

I am employing a propensity score matching to get the treatment group and the control group balanced. I employ the inverse probability weights times some sampling weights (I am using a survey, hence I ...
1
vote
1answer
308 views

Assessing Proportional Hazards Assumption of a Cox Model with Caseweights

I have data that I have used the R package twang with multinomial propensity scoring, to assign caseweights based on an ATT model. Once these caseweights have been assigned, they are typically used ...
1
vote
1answer
21 views

Harmonizing variables across countries

Say, I have run an experiment in 2 separate countries, the U.S. and Tchad. While the outcome was isomorphically measured in both settings, one key background variable was not. Specifically, income was ...
3
votes
0answers
125 views

multilevel longitutudinal model with missing data and survey weights

I'm estimating a multilevel longitudinal model in lme4, using publicly available survey data. The data include sampling weights, and there is substantial missing data (over 27%). I understand multiple ...