Skip to main content

Questions tagged [non-response]

Nonresponse (spelled as a single word) is the term used in survey literature to describe missing data problems; encompasses the issues of unit nonresponse, item nonresponse, and nonresponse biases

Filter by
Sorted by
Tagged with
0 votes
0 answers
25 views

Hypothesis testing on total surveys

How should one think about hypothesis-testing ratio scale variables that do not have a distribution resembling a normal/t-distribution, when the data comes from a total survey? Some background: I have ...
MalinU's user avatar
  • 1
0 votes
0 answers
12 views

Longitudinal sample with varying levels of non-response

I'm using answers to a specific question from the General Social Survey ("do you feel rushed"?) to compare statistics over multiple years. The answers are "Always" "Sometimes&...
ryan_coogler's user avatar
3 votes
1 answer
259 views

Combining multiple imputation and survey non-response adjustments (IPW)

Imagine the following scenario: A population cohort (assume no or equal sampling weights) of say 10000 people had various demographics and health factors measured at baseline $X_{base}$(with some ...
nstjhp's user avatar
  • 135
1 vote
0 answers
19 views

How to top-up a panel survey to also get population estimates

I'm running two sequential surveys on the same population, and I have a question about the proper sampling methodology in the second round of a panel that is also meant to get population estimates. I ...
Kees's user avatar
  • 133
0 votes
1 answer
42 views

Non-Response Rate: Outlier data, does it count?

I'm currently doing an undergraduate stats module and we're being asked to calculate the response rate and many people are conflicted by whether or not the excluded outlier data would constitute as a ...
kuri_cs's user avatar
1 vote
0 answers
24 views

Nonresponse weight adjustments in multi-stage household surveys

I have a question about nonresponse weighting in complex sample surveys in multi-stage designs, like say, The US National Comorbidity Survey Replication (NCS-R), the Health and Retirement Study (HRS), ...
SurveyStatLearner's user avatar
3 votes
1 answer
95 views

Using a sample of paid survey respondents to bias correct lower response rate among larger non-paid sample

I'm running a tracker survey on a website that has a low response rate of about 2%. The survey is not incentivized but the website traffic is large enough in volume I can always meet my sample target ...
C.Robin's user avatar
  • 131
5 votes
1 answer
150 views

Is overfitting an issue if all I care about is training error

I am working on a project where we perform non-response adjustment by weighting survey respondents by their probability of response. In order to do this, we need to estimate each respondents ...
astel's user avatar
  • 1,528
3 votes
0 answers
82 views

Adjusting for non-response bias in a survey

Say I have a target population of 10,000 for a survey, and only 2,000 respond, because they likely feel strongly about the survey topic (either happy or angry). I have clear, abundant non-response ...
Alex's user avatar
  • 497
1 vote
0 answers
25 views

Correcting for known imputation bias

I have a survey sample which includes income values by type of income for a significant number of high-income households. Some of the income data is measured, i.e. present in the responses of the ...
andrewH's user avatar
  • 3,117
3 votes
1 answer
2k views

How does non-response bias affect the Confidence Interval

I asked earlier what is the idea behind putting up Table 3. I have a follow up question on how non-response bias identified can justify the different sizes of Confidence Interval(CI) in Figure 3. My ...
Prashin Jeevaganth's user avatar
0 votes
1 answer
290 views

p-value of non-response

I came across this in a research article, and I wondered what the p-value is showing here and what does the sentence even mean? Can someone explain what is the null hypothesis relating to the p-value? ...
Prashin Jeevaganth's user avatar
1 vote
2 answers
392 views

Clustering with Likert items and N/A option

I am currently evaluating the results of a 72 question survey with response levels from "strongly disagree" to "strongly agree". I would like to cluster the questions by response patterns using R (I'm ...
Matthias's user avatar
  • 111
0 votes
1 answer
727 views

Sample Size when the sampling frame is small

I am sure this question has been answered, and may be obvious to those familiar with online surveys. But I am struggling with it. I am surveying a specific population (local leaders in a specific ...
user203133's user avatar
4 votes
1 answer
131 views

Should item nonresponses be removed before calculating Welch's t-test?

I performed a survey in which one of the questions used a grid to let people express preferences for different features of something, using a Likert-like scale for each feature. I coded the values as ...
mhucka's user avatar
  • 141
3 votes
2 answers
102 views

References on handling nonresponse (participant dropout) bias in experimental setting

Imagine I do a randomized experiment at the beginning of the school year. Incoming freshmen (a) participate in a diversity class or (b) do not. At the end of the year, I send them emails asking to ...
3 votes
1 answer
649 views

Can be Replacement a Way to Deal with Nonresponse?

When I've asked a teacher (in the past) about how could I handle, in a survey with simple random sampling, the participants I couldn't reach for some reason, he told me that I could use a pre ...
Ágatha's user avatar
  • 173
2 votes
1 answer
121 views

How do I estimate error when I know a survey is not representative?

Let's say that I have a survey of $n = 1000$ respondents from a population of $N = 3000$. Moreover, it is known that the ratio of male to female in the population is $50:50$. However, in the sample, $...
user avatar
1 vote
0 answers
69 views

Sample Weighting in regression

I have a survey data with no original instructions on how to do weighting. This survey is voluntary and has been taken by 207 hospitals out of 7000 hospitals in the U.S. There are some characteristics ...
Soumya 's user avatar
1 vote
0 answers
15 views

What do you do when you discover a mistake in survey implementation partway through implementation?

I'm working on a survey that is already partway through the implementation phase. It is a web survey, and unfortunately, one of my colleagues noticed that there was an error in the skip logic, leading ...
Caroline's user avatar
  • 111
1 vote
1 answer
43 views

How to deal with disparate survey response rate from different regions?

Hi & thank you all in advance for your help! I sent out a survey [to examine teacher satisfaction] to 3 school districts in New York state. District A is large, district B is medium, & ...
nora jones's user avatar
2 votes
2 answers
94 views

Is there a reasonable way to calculate when missing responses in a survey are too much?

I'm conducting analyzing a complex sample design survey of health institutions, which I've 70% of the overall planned sample. However, I've strata as high as 95% and as low as 47% response rate. To ...
Marie-Eve's user avatar
  • 205
1 vote
0 answers
135 views

What testing method can be used with demographic data to compensate for possible non-response bias?

(Hello CrossValidated, first poster here, so please have mercy with any transgressions of mine!) For my thesis, I am currently researching the correlation between stance to organizational change and ...
user9003's user avatar
5 votes
2 answers
1k views

Calculate confidence levels of a stratified sample with missing units

I'm conducting a stratified survey among health institutions; 700 units were allocated into one of the 30 strata designed to reflect the proportionality of the population. However, it's been difficult ...
Marie-Eve's user avatar
  • 205
0 votes
0 answers
79 views

Non-response in organization survey

I am a research analyst and recently conducted an employee satisfaction survey at the organization I work for. Ideally, I should have received completed questionnaires from all 380 employees (making ...
Yuri's user avatar
  • 1
0 votes
1 answer
70 views

Non-response bias (many waves, time span between waves not consistent)

I want to ask regarding non-response bias. I have sent my questionnaire on-line to SMEs in Malaysia. However, I have sent reminders many times (around 5 times). However, now I cannot recall when the ...
Kanaan's user avatar
  • 3
1 vote
1 answer
353 views

Margin of error (questionnaire response)

I sent a postal questionnaire to 1618 schools. In total, 220 responded (13.6% response rate). For one question, which had Yes, No and Don't know response options, 217 schools responded (Yes=85, No=127,...
nat davies's user avatar
3 votes
2 answers
6k views

Sample size vs response rate, which is more important?

While I was preparing an internet survey, I read from multiple sources which says it is more important to have a high response rate than large sample size. Q1. I don't quite understand the logic ...
qoheleth's user avatar
  • 1,512
8 votes
2 answers
369 views

Recommendations to analyze a survey of the entire sample frame with a 20% response rate

We surveyed all 10,000 professionals in a particular industry. The industry is highly-regulated, so we have contact information for everyone in our population of interest. We attempted to contact ...
Anthony Damico's user avatar
4 votes
1 answer
506 views

Calibration of weights for market research survey

I have a stratified random sample based on sampling frame formed from our CRM systems data. Now when I look responses in different strata they seem to differ. Some stratas have much higher ...
Analyst's user avatar
  • 2,665
1 vote
1 answer
384 views

self-selection bias due to nonresponse?

I have administrative data from the whole population of new doctorates, in a given year, from my region. We have also survey data from a sample of this same population (where the whole population was ...
Fuca26's user avatar
  • 1,097
1 vote
2 answers
2k views

How can I handle the non-response in this simple random sampling?

I am planning to conduct a simple random sampling for a population of $N$ patients with index $1,...N$. I have enough money to interview $n$ patients (sample size=$n$). In order to determine the ...
tiantianchen's user avatar
  • 2,111
1 vote
1 answer
1k views

Chi Square Test, to include or to exclude Non-Responses?

I want to apply a Chi-Square test, but I'm not sure whether to include or exclude non-responses. For example, I want to see if GENDER (male, female) is correlated with SATISFACTION on some public ...
Nick's user avatar
  • 11
2 votes
0 answers
107 views

Categorical Binary Variable

I'm attempting to draw an inference of accuracy be it by confidence interval or response rate, except typical methods don't really suite my problem for the reason that the entire population was ...
Andrew Alton's user avatar
7 votes
1 answer
2k views

Can one compute confidence intervals for a census with high nonresponse rates?

If a questionnaire was administered to an entire population (group of interest) and the response rate was 68% can the questionnaire results be generalized to the population (100%, including the 32% ...
nadia's user avatar
  • 89
6 votes
2 answers
594 views

For "Was this page helpful" data, should I take response rate into account?

To help me focus on which pages on a site to improve, I'm looking at user feedback to the question "Was this page helpful?" (Answers are "Yes" or "No".) The response rate (responses divided by unique ...
Joe Pairman's user avatar
8 votes
1 answer
868 views

Variables for post-stratification weights?

What justifies the usage of a variable for post-stratification? I am working with a constituent survey of a non-profit's constituent with 2500 responses out of a much larger sample and even larger ...
Andrew's user avatar
  • 666
5 votes
0 answers
528 views

Predicting response propensity in a rolling data collection

I'm working with a survey that uses a rolling data collection format (i.e., there are multiple waves of sampling and initial contacts). I'm trying to develop a model to predict how likely a sample ...
soupsandwich's user avatar
5 votes
4 answers
5k views

How to avoid and handle survey non-response?

One objective of a survey can be to understand the proportion male vs. female users. To the extent a specific gender correlates to particular use cases of a technology, product design, product/feature ...
user2661's user avatar
  • 151
2 votes
2 answers
8k views

Non-response rate

In a project that I am doing to evaluate customer behaviour, I have asked a set of questions such as whether they read the unit pricing before they decide to purchase a particular product or do they ...
Adhesh Josh's user avatar
  • 3,285
5 votes
6 answers
2k views

Inference to the population when the survey response rate is only 30%

I have conducted a survey in which the questionnaires were sent out to 450 individuals, but only 30% of them answered the questionnaires. Is it still valid to interpret the usual inference analysis (...
PaulS's user avatar
  • 425
3 votes
1 answer
2k views

How to calculate confidence interval when only a part of the samples are valid?

I will simplify our problem in this way. Say there are 100,000 cases in total to examine. Due to the time limitation, we randomly selected 2,000 of them. Then we found 1,000 of them are invalid, so we ...
evergreen's user avatar
  • 131