Questions tagged [survey]

An instrument used to collect a sample from a population. Surveying often refers to sampling of human populations and is primarily done by administering questionnaires or interviewing individuals.

Filter by
Sorted by
Tagged with
7 votes
1 answer
2k views

Can averaging all the variables be seen as a crude form of PCA?

This question just occurred to me out of the blue. PCA is a way to reduce dimensions. Another way that is often (perhaps too often) used is to take mean values of two or more variables. This is done a ...
user avatar
  • 831
3 votes
1 answer
3k views

Effect of two demographic IVs on survey answers (Likert scale)

I have 4 questions in a survey with Likert-style answers (i.e. 1–5) – and the participants have also answered the demographic questions (country and study-years) – which test do I need to find if the ...
user avatar
  • 133
6 votes
4 answers
3k views

How to interpret the margin of error in a poll?

Recently the media reported on a political poll that stated that "46% of Republican voters in Mississippi think that interracial marriage should be illegal". One example story (of many around the '...
user avatar
  • 161
12 votes
3 answers
8k views

Validating questionnaires

I am designing a questionnaire for my dissertation. I am in the process of validating the questionnaire I have applied a Cronbach's alpha test to the initial sample group. The responses to the ...
user avatar
5 votes
5 answers
34k views

How to calculate number of participants required to compare mean scores on a questionnaire between two groups?

I have to create a questionnaire that compares the sportiness of Facebook users vs. non-Facebook users. I need to calculate the number of participants that are required so that the result is ...
user avatar
2 votes
2 answers
10k views

Convert a 1-9 scale average to a 1-5 scale average

I am new at this and could use some help with a conversion. Survey participants were given the answer choices on a ranking scale of 1-9 for each question. We then averaged the results for each ...
user avatar
  • 23
6 votes
2 answers
2k views

Sample size for a variable number of answers

I have N different possible results (ex. red, yellow, or blue). I go to a population of infinite size and ask a bunch of people a question the answer to which is one of the N options.... How large ...
user avatar
5 votes
2 answers
4k views

How to combine data from 5 surveys from the same population spanning 10 years

I have results from 5 surveys each 2 years apart and let us assume that no subjects are selected in more than one survey. The sampling method used in these surveys are biased and I have sampling ...
user avatar
5 votes
1 answer
874 views

Data analysis for mixed within-subjects/between-subjects design?

I have run a survey with many respondents. There was a pool of questions, and each respondent was asked 3 of the questions (chosen uniformly at random and independently for each respondent). Now I'm ...
user avatar
  • 6,003
2 votes
1 answer
191 views

How to code values for males when they're only meaningful for females? [duplicate]

I'm building a predictive model for a medical condition that happens in both men and women. Physicians have reported that in some cases for women, their menstrual history seems to be a risk factor, ...
user avatar
  • 2,085
24 votes
2 answers
11k views

use of weights in svyglm vs glm

I would like to know how the treatment of weights differs between svyglm and glm I am using the ...
user avatar
  • 3,064
9 votes
3 answers
4k views

Using post-stratification weights in R survey package

I am analyzing a dataset that has a variable for post-stratification weights. As this is a complex survey, the plan is to use the R survey package. I have been ...
user avatar
  • 121
10 votes
2 answers
13k views

Can I combine several ordinal questions to create an index and/or composite measure?

I am using a survey that contains several questions about various dimensions of performance for policy research institutes. Here, performance in the policy arena is unpacked into things like: ...
user avatar
  • 101
10 votes
5 answers
6k views

What is calibration?

What does it mean to calibrate survey weights? Also, what are other definitions of calibration in statistics? I have heard it used in several contexts, particularly risk prediction (referring to ...
user avatar
  • 53.2k
12 votes
2 answers
42k views

How are margins of error related to confidence Intervals?

Can somebody tell me the difference between margins of error and confidence intervals? On the Internet I see these two meanings getting used interchangeably. Is it right to say, "Confidence ...
user avatar
  • 223
8 votes
3 answers
8k views

How to analyse a ranking and rating scale together?

In some market research consumers are asked to rank the features of a product based on priority. For example, Rank the following features for a device based on your priority (1 being the topmost ...
user avatar
11 votes
2 answers
2k views

What's the best way to visualize the effects of categories & their prevalence in logistic regression?

I need to present information about the main predictors of a candidate's votes using a public opinion survey data. I have run a logistic regression using all the variables that I care about, but I can'...
user avatar
5 votes
1 answer
3k views

How do I clean up inconsistent survey data?

I have some survey response data that are inconsistent and I'm not sure what is the best way to handle them. This is the nature of the inconsistency: Have you ever had a food poisoning episode that ...
user avatar
  • 2,085
4 votes
1 answer
1k views

How to interpret margin of error in a non-binary poll?

I know what margin of error means in a poll with two choices. For example, if a poll estimates two candidates are to have 45% and 55% of the vote respectively and the margin of error is 4%, then we ...
user avatar
1 vote
1 answer
228 views

Effects of ignoring the sampling strategy

Does the use of calibration/post-stratification imply that the sampling strategy/stratification/individual selection probabilities can be ignored altogether? In a survey reweighting exercise, I have ...
user avatar
  • 759
1 vote
2 answers
153 views

What is a "symbolically nested" model?

survey::anova.svyglm is a method of anova() that does model comparison for survey data. The details section of the documentation ...
user avatar
  • 917
1 vote
1 answer
221 views

Identify relations between categorical and ordinal/continuous variables

I'm evaluating a survey regarding opinions. Now I check for relations/similarities between the variables. My German workbook names the following condition for a Spearman rank correlation without ...
user avatar
0 votes
1 answer
604 views

Differences between conclusions from a p-value and confidence intervals

I have an issue with a result I just found. I ran a sub-population analysis (for 2 age groups) with a complex survey design. For this purpose I fitted a generalized linear model (family:normal,link:...
user avatar
  • 183
2 votes
4 answers
2k views

How to run svy: regress in R or get R-squared in R for complex survey data

I am trying to get r-squared, or explained variation, in a complex survey data using a linear regression (OLS). In Stata, this can be done by using svy: regress. In R, however, when I use 'survey' ...
user avatar
  • 31
1 vote
2 answers
2k views

How to measure correlation between multi-item likert scales?

I recently conducted a online survey and are now having trouble deciding for the right analysis method. For example: I wanted to see if there is a correlation between Factor A and Factor B. However in ...
user avatar
  • 11
1 vote
1 answer
177 views

Prediction when survey subsets create dramatically smaller Ns

Suppose you want to predict an outcome using a sample whose N is... 10,000 based on most demographic variables 9,000 based on Survey Question 1 3,000 who answered "Yes" to Question 1 and thus were ...
user avatar
  • 11.7k
19 votes
2 answers
616 views

How to calculate average length of adherence to vegetarianism when we only have survey data about current vegetarians?

A random population sample was surveyed. They were asked if they eat vegetarian diet. If they answered yes, they were also asked to specify how long they’ve been eating vegetarian diet without ...
user avatar
13 votes
5 answers
38k views

Why is it claimed that a sample is often more accurate than a census?

When learning the course of sampling, I meet the following two statements: 1) Sampling error leads to mostly variability, nonsampling errors lead to bias. 2) Because of nonsampling error, a sample ...
user avatar
  • 1,147
7 votes
3 answers
2k views

Looking for a good online resource about survey design and analysis

What is a good and relatively brief overview of good practice for getting valid results from surveys. I'm particularly interested in something about good survey design and analysis.
user avatar
7 votes
3 answers
4k views

Correcting biased survey results

Knowing that a population sample (non-random) is biased in terms of its demographics, what are the best practices to correct for this issue? That is, let's say that I can attach an array of ...
user avatar
  • 1,042
9 votes
1 answer
3k views

Machine learning with weighted / complex survey data

I have worked a lot with various nationally representative data. These data sources have a complex survey design, so the analysis requires the specification of stratification and weight variables. ...
user avatar
  • 475
6 votes
1 answer
6k views

Bootstrapping stratified sample that is weighted to population - reweighting during the bootstrap?

I'm using R to provide bootstrap (percentile and t methods) of estimated population totals, using data from a complex survey. It is a stratified survey of tourists expenditure that is weighted to ...
user avatar
  • 16.6k
5 votes
2 answers
499 views

Bayesian user survey with a credible interval

I work on a couple of library websites and we want to know who are users are so we can make decisions about how to design the site and focus efforts. These are the classes of users we are interested ...
user avatar
5 votes
1 answer
1k views

Addressing Non-response in a Convenience Sample

I am studying customer satisfaction in a large hierarchical organization. I plan to administer a voluntary survey to customers across the organization, and need to address non-response in my analysis. ...
user avatar
3 votes
0 answers
574 views

Matched Analysis with Complex Survey Data

Complex survey data is that typically found produced by the National Center for Health Statistics (NCHS) or the NSLY; it typically contains information on PSU, strata, and weights. To make nationally ...
user avatar
  • 151
11 votes
1 answer
2k views

Does SurveyMonkey ignore the fact that you get a non-random sample?

SurveyMonkey has steps and a chart for you to figure out what sample size you need for a given margin of error or confidence interval, based on your population size. SurveyMonkey sample size Does ...
user avatar
  • 213
8 votes
1 answer
1k views

Assessing the representativeness of population sampling

I am looking for some suggestions about assessing the representativeness of a particular dataset I am analyzing. In this dataset I am looking at the relationship between two variables (e.g., X and Y)...
user avatar
  • 629
7 votes
2 answers
1k views

What is the correct sample size when calculating CI for a subset of results?

Suppose I have a study of 3031 people that obtains responses to various questions (95% CL). One of the questions (Q1a) gets a yes response from 616 of the people. Of those 616, only 34 have a QualityB ...
user avatar
  • 433
5 votes
1 answer
219 views

Stratified survey calculations by hand and with survey package don't agree. Simulation results

Bounty info: I originally emailed Thomas Lumley at an old email address. He did respond to an email to his new address. Note: Long post (lots of code) I can’t seem to replicate the results of the <...
user avatar
  • 920
5 votes
2 answers
380 views

Can one force randomness in a sample?

I recently spoke to a large qualitative analysis company who were working on in-depth analysis of the potential customers of train company. I asked them how they chose the people to include in their ...
user avatar
  • 855
5 votes
2 answers
5k views

Comparing 2 time series in R

I was wondering what kind of tests one would use to compare these two time series. The first data set(in percentages) are results from a weekly survey that asks a YES/NO question on whether someone ...
user avatar
  • 51
3 votes
5 answers
2k views

Test for Poolability of Individual Data Series

How do I test/verify if I can analyze my panel like dataset by simply pooling the individual series? I have a dataset structured as a panel. Now I am wondering if I can simply pool the individual ...
user avatar
  • 133
3 votes
2 answers
980 views

Reliability and validity of a standard survey

I had eleven people play five versions of a video game in single sessions, for a total of 55 sessions (11x5). I used the Task Evaluation Questionnaire from the Intrinsic Motivation Inventory to ...
user avatar
2 votes
1 answer
1k views

multiple choice data simple logistic regression or multinomial logistic regression

I have a survey question where the respondent can check one choice or two choice maximum. Question looks like this: What is the more important characteristic when you buy chocolate? ...
user avatar
  • 528
2 votes
2 answers
4k views

Likert scale based composite variables

I am conducting a small research into the adoption of smart home technologies for elderly people. In this research I have conducted both questionnaires and interviews, with the questionnaire being ...
user avatar
  • 21
2 votes
2 answers
23k views

Likert scale and yes/no calculation of one score

My survey is based on observations and interviews. The observation questions are yes/no type questions and interview questions are 4 points. $1=$ never, $2=$ sometimes, $3=$ usually, and $4=$ ...
user avatar
  • 21
2 votes
3 answers
3k views

Likert Scale Analysis

What are some interesting techniques that can be used to analyze Likert data? As a frame of reference, I have constructed a survey with about 50 items which are intended to assess the attitudes of ...
user avatar
1 vote
1 answer
3k views

coding survey data for cosine similarity and euclidean distance?

I want to know how to code survey data such that a similarity function can be applied on it. Say I want to use cosine similarity. All the search results and QA I've found while in my search deal only ...
user avatar
1 vote
1 answer
72 views

Transforming between estimates of mean and total (complex survey design)

I want to calculate the relative fraction of schools classified as E(lementary), M(iddle), and H(igh) from a complex survey. I do this using the survey package in R:...
user avatar
11 votes
6 answers
26k views

Is there a site to post my survey to so I can get a sample representative of the population?

This is only for my high school senior project, so it doesn't have to be perfect. I'm doing a project on global warming, and I want to survey people for their opinions. I know that if I use a ...
user avatar
  • 113