Questions tagged [survey]

Refers to an instrument used to collect a sample from a population. Surveying often refers to sampling of human populations and is primarily done by administering questionnaires or interviewing individuals. Sampling individuals for surveys in stratified populations may require more complex sampling than simple random to get more precise estimates of population parameters. Sampling design and analysis of survey data fall under 'Survey Methodology'.

362 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6
votes
0answers
223 views

How to construct confidence limits based on small stratified samples of finite populations?

Imagine a business wishes to audit its transactions. It has a database summarizing the transactions, which constitute a sampling frame for the population. It would be time-consuming and expensive to ...
6
votes
0answers
856 views

Why would I use ratio estimation instead of regression estimation to estimate means?

I am taking a graduate course on survey data analysis. I was recently introduced to ratio estimation and regression estimation. I understand that using ratio estimator may be easier if we are ...
6
votes
0answers
5k views

When to use longitudinal (panel) weights vs cross-section weights in complex surveys

I'm currently working with a longitudinal dataset, the Kauffman Firm Survey. The survey tracks about 5000 firms starting from 2004 - 2009. Firms die out over the years. It has both cross-sectional ...
5
votes
1answer
86 views

Do I still need to include variables used to generate weights in a regression model when applying inverse probability weighting in estimation?

Say, I would like to run a regression like this: $y = x_1+x_2+x_3+x_4+x_5$. And I used $x_3$, $x_4$ and $x_5$ to generate a inverse probability weight($\pi$) for the availability of $y$. I generate ...
5
votes
0answers
239 views

Separation in logistic regression in a complex survey?

Firth's penalized maximum likelihood estimates, exact logistic regression and Bayesian logistic regression (e.g. bayesglm) can account for separation in logistic regression. But how to account for ...
5
votes
0answers
379 views

When to use a chi-squared test?

This is a very basic question however I do not have a statistical background and I am currently analysing some data for my dissertation. I have constructed a survey about healthy lifestyles & ...
5
votes
0answers
510 views

Predicting response propensity in a rolling data collection

I'm working with a survey that uses a rolling data collection format (i.e., there are multiple waves of sampling and initial contacts). I'm trying to develop a model to predict how likely a sample ...
5
votes
1answer
865 views

Assessing the representativeness of population sampling

I am looking for some suggestions about assessing the representativeness of a particular dataset I am analyzing. In this dataset I am looking at the relationship between two variables (e.g., X and Y)...
4
votes
0answers
224 views

Correcting Sample Selection Bias given actual Distribution

I have two datasets, both from the same population: The samples from the first survey are quite representative of the underlying truth. However, the second survey comes with a change in distribution ...
4
votes
0answers
108 views

Statistical significance of a difference between poll percentages with a small sample?

Analyzing my company’s internal survey results, I was stuck with calculating statistical difference between percentages. I usually used a Z-test as described below, but I am not sure whether it is ...
4
votes
0answers
27 views

How should I respond a survey?

As researchers working with survey data know, surveys are plagued with incomplete or missing data, measurement errors, selection issues, etc. I am soon going to take part in a survey. How should I ...
4
votes
0answers
2k views

Binomial logistic regression in SPSS using survey weights

I am running a logistic regression in SPSS with a sample that uses survey weights. The sample size is 1000 and the weights are along the lines of .86 or 1.23 depending on the case. I am using the ...
3
votes
0answers
131 views

Margin of Error for poll that allows selecting multiple options?

I have a poll with a known sample size (let's say n=1000) which has results that look like this: ...
3
votes
0answers
35 views

“Does not apply” category frequencies are much higher than the frequencies of any other category in the variable

I'm working with the data from a national survey. In some of the variables frequencies for "does not apply" category are much higher than for any other response in the variable. Do I just ignore the ...
3
votes
1answer
802 views

Questionnaire design for linear regression

I am trying to conduct a research on brand preferences and I am trying to analyze regression equation i.e. which factors affects the consumer preferences (dependent factor) and other determined ...
3
votes
0answers
673 views

Margins of error for a simple multiple-choice question

I wish to plot error bars on a bar chart that represents the answers of 200 respondents, randomly selected from a population of 50,000,000, to a simple multiple-choice question. Here are the ...
3
votes
0answers
109 views

Determine Chi Square Group Differences in multiple choice questionnaire

I'm trying to determine if there is a group difference in answering a multiple choice question. For example, I want to answer the question of, do "Change Instigators" (group A) answer "communication"...
3
votes
0answers
70 views

How is the hazard ratio in Cox proportional hazard models affected by the case sampling?

I'm trying to conduct survival analysis using Cox proportional hazard models, looking at a biomarker for heart disease. Age is a major risk factor, so I'm modeling the age as the time scale (counting ...
3
votes
0answers
102 views

Profiling survey respondents with both categorical and ordinal variables

I have a mixture of categorical and ordinal variables from a survey that I am trying to use to create "profiles" or segments that differ from one another with respect to a dependent variable (the ...
3
votes
0answers
721 views

Correcting for heteroscedasticity in logistic regression

I am using a large health dataset as a part of a research project (N = ~18 000). My colleagues and I are investigating whether smoking predicts the presence or absence of a mental illness. We are ...
3
votes
0answers
530 views

Analysis of survey data

This is the first time I am analyzing a survey. I have limited knowledge about stats and the best practices and would appreciate some pointers as to what kind of analysis I should perform on the data. ...
3
votes
0answers
547 views

Post-hoc power analysis of complex sample survey data

I am working with a complex sample survey data using Stata to determine the predictors of a given dependent variable. As part of my analysis result I want to report the post-hoc power for each ...
3
votes
0answers
1k views

Contingency tables, Chi-Squared analysis and next steps in R

I'm hoping one of the more experienced R programmers/statisticians out there can help me with something, or explain why what I'm trying to do is stupid :-) In the past, I've done analysis of survey ...
3
votes
0answers
4k views

Transforming scores between different rating scales – Importance of response options

I'm working on a meta analysis of the mean of a single variable (using arithmetic mean as the effect size, rather than the relationship between two variables). The attitude I'm assessing has been ...
3
votes
0answers
160 views

Google consumer survey stats

In Google's consumer survey product, they calculate confidence intervals using the Wilson score interval for the unweighted results. Does anyone know how they calculate the confidence interval after ...
3
votes
0answers
73 views

Randomized Response With Continuous Outcome

Can someone point me to an example of how to do randomized response with a continuous outcome $Y \in [ 0,\infty ]$, rather than a binary one? I am interested in the mean and variance of this outcome ...
3
votes
0answers
128 views

Are there guidelines for when to remove survey participants who blindly filled in the bubbles?

I just did a survey and I'm pretty sure some people just filled in the bubbles on the survey without reading the questions. A pretty obvious indicator are responses to items that are negatively coded (...
3
votes
0answers
451 views

Matched Analysis with Complex Survey Data

Complex survey data is that typically found produced by the National Center for Health Statistics (NCHS) or the NSLY; it typically contains information on PSU, strata, and weights. To make nationally ...
2
votes
0answers
19 views

Pooled Panel Data Regression and Questions on “Missing Values”

Lets say i want to identify the effect of some categorical variables x1 x2 x3 on a numeric y. I got data from 3 waves on the same individuals, but there are missing values on some variables because of ...
2
votes
1answer
38 views

Item sampling techniques to reduce processing time for questionnaire

I have a well-crafted draft of a questionnaire, containing 240 items. The average processing time is 20 secs per item, so the entire questionnaire would take around 1 hour 20 min to complete. I want ...
2
votes
1answer
48 views

Repeated measures, multilevel regression or another type of analysis?

I'm doing an experiment for which I've distributed a survey. People were asked in this survey to rate the attractiveness of 5 other people. I provided four groups of pictures and 1 of those groups ...
2
votes
0answers
117 views

Statistical significance of percentage difference for a poll question with multiple options?

The question is: how to calculate the statistical significance of difference between percentages in the case described below? Suppose we have a poll question with $n$ answer options $A_1, …, A_n$, ...
2
votes
0answers
83 views

Configuring survey design for multilevel modeling with National Inpatient Sample

I am a researcher looking to use multilevel mixed-effects models in Stata 14 to analyze the National Inpatient Sample. I am aware that the typical way that you configure the NIS' survey design for ...
2
votes
0answers
26 views

What statistics can compare individual survey responses & others that were measured as a group (from which we need to extract individual responses)?

The organization I belong to studies indigenous populations through primarily survey research. One study for example aims to identify the relationship between culture and the evaluation of odors. We ...
2
votes
0answers
239 views

Equivalence of svyglm and glm for simple random surveys

I have been exploring the use of the svyglm function in R's survey package to analyse surveys with both equal and unequal sampling probabilites. For an unequal ...
2
votes
1answer
220 views

fit indices for cfa based on 2 groups/samples?

I have a question regarding fit indices for a cfa based on 2 groups/samples. Specifically, I have fitted a cfa model with one factor based on 7 indicators (questionnaire items), and two samples (...
2
votes
0answers
742 views

pooling over imputation with LASSO in R

I've been trying to find an answer to my question, with no success. It could be I'm just not looking for it in the right way (I'm also learning about imputation and lasso as part of the process). So I ...
2
votes
0answers
70 views

Survey data and hypothesis testing

I am wondering if a certain thing is possible. I think it might not, but some of my colleagues try to persuade me that it it indeed possible. So here is the problem: I have some survey data, where ...
2
votes
0answers
35 views

Detecting a significant change in survey answers

I conducted a user study where participants were asked to rate the relevance of search results on the following scale: "very unrelevant", "unrelevant", "relevant" and "very relevant". Every ...
2
votes
0answers
34 views

Survey on how frequently a group use a particular device: Which analysis methods?

I surveyed a group of photographers and asked them how frequently they used a particular type of lens for a specific type of photograph. I now want to find out which lens or lenses are the most ...
2
votes
0answers
152 views

Ethical crossroad: dropping contradictory cases

I am currently working on my thesis and so I adopted 2 scales to measure two concepts. Before launching the survey, I 'paraphrased' the scales items in a hope to not copy them verbatim (excuse my fear ...
2
votes
0answers
47 views

Identifying trends when data points are averages with standard errors

I am trying to use a regression to identify trends in the poverty rate over time in county level Census data. I cannot use smaller geographies in my regression because the rates provided by Census ...
2
votes
1answer
28 views

Imputation for Industrial Survey

What do you think the best imputation method is for industrial surveys? Methodology reports usually mention historical background, administrative data or hot-deck, but according to the theory, the ...
2
votes
0answers
11 views

Can ANOVA be used to study effects when doing a one-off survey?

Just wanted to check whether ANOVA can be used to study effects (e.g.: effect of age on intensity of social media use) based on the data from a one-off survey. Frequency of social media use is ...
2
votes
0answers
272 views

PCA for questionnaire reduction

I'd like to have some opinion regarding if I'm in the right way with my questionnaire reduction. I have a questionnaire with 275 questions and 34 issues (so a couple of questions are related to each ...
2
votes
0answers
149 views

Proper Specification of Balanced Repeated Replicate Weights in R Survey Package

I am trying to properly apply BRR (balanced repeated replicate) weights in the R Survey Package and I am using the National Center for Education Statistics ELS 2002 dataset. I am not sure how to ...
2
votes
0answers
76 views

comparing survey responses

I have requested 30 participants to answer the same question about 100 images: "How easy is it for you to recognize this image?" on a scale from 0 to 100, where 0 is easy and 100 is difficult. I want ...
2
votes
0answers
617 views

How meaningful is to pool data from different surveys on the same target population?

Apologies for cross posting This is a very theoretical question for me but I would like to find an answer as I might want to use this in the (near) future. In many cases same questions are used in ...
2
votes
0answers
52 views

How do I assess correlation between ordinal responses to multiple survey questions

I have survey data on whether ~500 respondents would accept a hypothetical medical procedure in variable circumstances. Responses are graded 1 - definitely yes ; 2 - probably yes ; 3 - probably no ; 4 ...
2
votes
2answers
81 views

Detecting change in % responding to a question over time periods

A study has been asking the same ratings questions repeatedly year over year. Currently, the study is using a Column Means test in IBM SPSS Survey Reporter to compare the number of people responding ...

1
2 3 4 5
8