Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [survey-weights]

survey weights are used when data are collected according to a probability sampling design with unequal probabilities of selection and/or response

1
vote
0answers
11 views

Wald Chi-square with survey weights in Python [on hold]

I am trying to perform a Wald (Chi-square) test in Python using survey data with sample weights. I have looked in Scikit learn and statsmodels, but neither seem to support this test where the sample ...
0
votes
0answers
10 views

Weighting community-level observations in representative survey data

I am working with survey data that contain information at the individual, household and community level. The survey is representative at the national and first-administrative level but provides ...
0
votes
0answers
14 views

Model for taking a weighted average of a number of things, based on factors determining their significance

I am trying to model the following situation: There are a number of "events", each with a (real-valued) outcome. Ahead of each event, a varying number of parties can submit an estimate for the ...
0
votes
1answer
47 views

Why it is important to make survey design object (svydesign function in R with id, strata, weights, fpc) from raw data and after clean data in object?

I am planning to analyse a survey. I have been told that if I clean the data (e.g. data subsetting, value recoding, creating new variables from existing etc.) and afterwards create a survey design ...
3
votes
1answer
94 views

Correct use of the sample weights in a complex survey design for association analysis (Logit OR)

I've doubts about the correct use of sample weights in the NHANES survey, which uses a complex, multistage probability sampling design (1). I'm aware about the importance of the use of the sample ...
0
votes
2answers
18 views

Duplicating stata survey design using svrepdesign from survey package in R

I am trying to use the R package 'survey' to produce some weighted descriptors of a dataset (Fragile Families) for a meta-analysis. According to the documentation, the weights are provided by the ...
1
vote
0answers
20 views

Utilizing ipfraking to apply post-stratification weights for a Community Based Survey in STATA

I am a community data analyst for a small non-profit in South Florida. We are cleaning and preparing a local community survey for analysis and need to apply post-stratification weights to the survey ...
0
votes
0answers
7 views

Calculation of Sampling Base Weights when Sample Unit is different from observation unit

We conducted a survey where the sampling units are households but the observation unit is a single person in the household. These households were selected using an Address Based Sampling Frame. To ...
1
vote
1answer
41 views

How does the TraMiner Package Calculate Standard Error Using Weighted Data?

The TraMiner Package includes an option to include sampling weights in the analysis. However, I haven't found any discussion in the package documentation (or associated user manual) of how standard ...
0
votes
0answers
9 views

Probability Weights and Dropping Observations

I am trying to determine how applied empirical analyses adjust probability weights after dropping observations. For example, say I have a strict subset of the population that takes a 2013 cross ...
0
votes
0answers
9 views

How to aggregate sampling weights/probabilities to high levels when outcome is count?

I have sample weights at two levels, and I want to calculate a test across two groups of the count, within group, of a binary variable. I have a (survey) sampling probability at the individual level ...
0
votes
0answers
64 views

How to calculate “weight” that balances the sample dataset when we are given population categories ? (find survery weights)

I am very unfamiliar with survey designing and this might be a very basic question to statisticians and surveyors, but still, I seek help finding the weight for each sample data that will address the ...
0
votes
0answers
12 views

How does missing data affect analyses using svyset?

I am running some simple statistics using Stata and its svyset command. Does listwise deletion of cases during analyses affect the svyset? Are results still going to be weighted properly and the ...
0
votes
0answers
33 views

Design effect formula

I saw two formulas for design effect. One is deff = 1 + rho (n – 1) , where rho is the interclass correlation and n is the number of elements in the cluster. Another formula is defining DE or ...
0
votes
0answers
28 views

Weights in “visited website” survey

I have a dataset with the browsing history of people in a country with age and gender, my goal is to give some information regarding some websites like : the market shares between several website ...
0
votes
0answers
80 views

Survey weights: calibration with continuous variables

I'm using the R survey package and trying to run the calibrate function. My setup: For each individual I have age, gender, ...
1
vote
0answers
24 views

How to include survey weights into a random intercept model? [duplicate]

I'm trying to run a random intercept model in R on an adolescent dataset with >100 schools (the school being the intercept). The data include a survey weight value for each observation, however lme ...
0
votes
1answer
90 views

How to apply sampling weights in R

I'm working with a large, national survey that was collected using complex survey methods. In order to make my results representative I need to account for sample weights and other survey design ...
1
vote
0answers
31 views

How do I convert a survey scale [7-point, -3 to 3] to a 7-point scale [1-7]?

I am working with a survey scale that is from -3 to 3. I have a mean value of .94 and I want to identify if there are ceiling effects, but I need to change the entire scale to 1-7 in order to ...
0
votes
1answer
69 views

Should weights be applied in generated quantities block in stan?

I want to do predictions via generated quantities block in stan. I have two questions: Should the weights be applied again in the generated quantities block in addition to the likelihood in the ...
0
votes
0answers
77 views

Weighted Empirical Cumulative Distribution Function (CFD): order values before or after weighting? [before]

My input data are some observations of a continuous variable, let's say the number of kilometers of motorbikes. I did a survey and I collected some observations. Somehow, I computed weights for all ...
0
votes
0answers
67 views

Confidence intervals for survey-weighted Poisson regression in R where counts are totals of the survey weights

Forgive me if this is a very basic question. I am using a large database of healthcare encounters that uses a stratified sampling approach. Each row in the database is a sampled encounter, and has a ...
0
votes
0answers
35 views

Regarding frequency and inverse probability weights

Deploying inverse probability weighting on a 3-group Setup, I examined for outlier activity, aswell deployed in a survey bin. Regression model. These estimates of ...
0
votes
0answers
33 views

Error variance estimation with weights

I am using data which include a (sample-)weight for each observation, i.e. the data is from a survey that has weights to make the sample representative for the US-population. I perform OLS to get some ...
1
vote
0answers
19 views

What is the impact of seed weights in raking (iterative proportional fitting)?

In survey weighting, I've seen that first a design weight adjustment is made (to reflect over- or under-sampling), and then a non-response adjustment is made (to reflect groups that are less likely to ...
1
vote
0answers
20 views

Modeling rates with complex survey data

I have data derived from a stratified, cluster random sample with post-stratification weights (corresponding to the inverse probability of response). These are person-level data. Let's say I want to ...
0
votes
0answers
25 views

How to calculate percentages and ratios for weighted surveys

I have a data set from a survey conducted by an expert across several countries, as depicted below ...
4
votes
1answer
84 views

Margins in “R” throws confidence intervals that do not contain cero, yet p-value > 0.05. Is this possible?

I am running a logit model on survey data using the svyglm function in the survey package in R. I am using the margins function to find the average marginal effects, but then something weird happens. ...
1
vote
0answers
30 views

Benefit of scaling survey design weights

In the european social survey the design weights are scaled to the sample size (see quote and source): As with the design weights also the post-stratification weights are scaled to the sample size, ...
1
vote
0answers
43 views

The set of variables used for weighing-up changes the resulting estimates

When comparing the effects of the set of variables passed to the svyby function on the resulting estimates and standard errors, I discovered that weighing up a single variable and two variables yields ...
1
vote
0answers
20 views

ulti-cohort longitudinal panel data: how to apply weights to models that incorporate variables from different years?

I'm running Stata 15.1 on OSX. The dataset in question comes from The American Panel Survey in which three cohorts of participants filled out surveys each month (some of which measured the same items) ...
1
vote
0answers
21 views

How Much More Information (as bits) is Gained (if any) from a Ranking vs. Likert Scale Survey of 100 Questions's / 1-5 Scale?

All other sources of noise controlled, I, know that asking users to rank their preference on a collection of items from "best" (5) to "least" (1) in lieu of having them rate each one individually on a ...
0
votes
0answers
25 views

Use of cross-sectional survey weights when employing mixed-effect regression models using multiple cross-sectional data

I have conducted an analysis using multiple-cross sectional datasets (i.e. combining different waves of the same survey). The survey provides cross-sectional weights for each wave. Considering that a ...
1
vote
0answers
12 views

when is it ok not to weight a national database analysis

I am running an analysis using a national database that has weights available to produce national estimates. However, I am comparing 2 procedures that are very specific to research hospitals only. ...
1
vote
1answer
41 views

Testing change over time with different sampling frames

In 2017 a representative sample survey of 400 schools was conducted with a stratified two-stage sample design. The sampling frame was an earlier school census. In 2018, a second round of the survey ...
0
votes
0answers
314 views

Combining multiple survey datasets with design weights in a single model

The analysis of survey data with design weights is a difficult topic. In my case, I am working with two datasets: 1) NHANES data, which makes use of cluster sampling and stratification, and 2) Survey ...
1
vote
0answers
72 views

Accounting for complex survey design for structural equation modeling

I am using proc calis procedure in SAS to perform structural equation modeling (SEM). I have a nationally representative survey data with person-level weights, strata and cluster variables. However, I ...
1
vote
0answers
52 views

Applying robust regression to complex survey data

My team is conducting an analysis using a large dataset of health data from >150 demographic and health surveys with the aim of identifying optimal metrics to quantify early childhood growth at the ...
1
vote
0answers
56 views

Can analytic weights be converted into sampling weights?

I am running a linear probability model, so I know I need to correct for heteroskedasticity. Since I know the variance of the error (from theory) to be $y(\pmb x)(1-y(\pmb x))$ where $y$ is the ...
2
votes
0answers
28 views

What do I do about unequal sampling probabilities for second-stage sampling units in a PPS sample?

Say that I am drawing a two-stage simple random sample. The first stage selectes a unit that is a cluster, the second stage selects units within the cluster. There are two different types of units ...
1
vote
1answer
105 views

Cox proportional hazards: time dependent covariates with survey weights

I'm analyzing data from a survey that utilized multistage probability sampling. I'm using R and therefore the bulk of my analyses with these data utilize the survey package to account for the ...
1
vote
0answers
70 views

How to weigh samples (representative of population) when comparing group means

I want to clarify my understanding of using sample weights when comparing means of sub-groups of a sample. Here is an artificial case with data that can be replicated in r (see code below): Let’s ...
2
votes
0answers
147 views

Equivalence of svyglm and glm for simple random surveys

I have been exploring the use of the svyglm function in R's survey package to analyse surveys with both equal and unequal sampling probabilites. For an unequal ...
0
votes
1answer
200 views

Converting survey results from a 1-4 scale average to a 1-5 scale average [duplicate]

I'm completely new at analyzing survey answers, and it will be great if anybody can help me out here with conversion technique. Survey participants were provided answer choices on a ranking scale of 1-...
1
vote
0answers
345 views

Replicate weights and the Current Population Survey

The Current Population Survey’s Annual Social and Economic Supplement (abbreviated, oddly, as ASEC) is the USA’s longest running and most detailed annual survey of income and employment. Along with ...
0
votes
0answers
106 views

How to calculate the standard deviation to be used for a confidence interval on a weighted data set?

Although there were some similar questions on the board, none seemed to quite be the same as what I'm asking. I have a set of survey values (satisfaction ratings) that have been weighted for non-...
1
vote
0answers
318 views

Test difference of population proportion and weighted sample proportion

I want to test for differences of the known proportion of the population vs. the proportion of a sample. The sample is weighted by sampling weights. The sum of weights is equal to the size of the ...
1
vote
1answer
272 views

Combining Multiple Years of Survey Data - Adjusting Survey Weights

I am working with the HCUP NIS dataset and have aggregated 5 years of data (2009-2013) for analysis. I am interested in doing trend analysis by the year (percent mortality each year, etc) as well as ...
2
votes
0answers
40 views

Should Mixed effects models with repeated cases have the same results as Weighted Mixed effects model?

I have a conceptual question that might also be a question about STATA and GLLAMM. Conceptually: Should duplicating some groups in a mixed effects model have the same effect as giving those groups a ...
2
votes
0answers
22 views

Problem computing population quantiles with survey micro data

All the major federal surveys come (American Community Survey, Current Population Survey, others) come with survey weights, such that the individual household observations times the population weights ...