# Questions tagged [survey]

Refers to an instrument used to collect a sample from a population. Surveying often refers to sampling of human populations and is primarily done by administering questionnaires or interviewing individuals. Sampling individuals for surveys in stratified populations may require more complex sampling than simple random to get more precise estimates of population parameters. Sampling design and analysis of survey data fall under 'Survey Methodology'.

362 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
223 views

### How to construct confidence limits based on small stratified samples of finite populations?

Imagine a business wishes to audit its transactions. It has a database summarizing the transactions, which constitute a sampling frame for the population. It would be time-consuming and expensive to ...
856 views

### Why would I use ratio estimation instead of regression estimation to estimate means?

I am taking a graduate course on survey data analysis. I was recently introduced to ratio estimation and regression estimation. I understand that using ratio estimator may be easier if we are ...
5k views

### When to use longitudinal (panel) weights vs cross-section weights in complex surveys

I'm currently working with a longitudinal dataset, the Kauffman Firm Survey. The survey tracks about 5000 firms starting from 2004 - 2009. Firms die out over the years. It has both cross-sectional ...
86 views

### Do I still need to include variables used to generate weights in a regression model when applying inverse probability weighting in estimation?

Say, I would like to run a regression like this: $y = x_1+x_2+x_3+x_4+x_5$. And I used $x_3$, $x_4$ and $x_5$ to generate a inverse probability weight($\pi$) for the availability of $y$. I generate ...
239 views

### Separation in logistic regression in a complex survey?

Firth's penalized maximum likelihood estimates, exact logistic regression and Bayesian logistic regression (e.g. bayesglm) can account for separation in logistic regression. But how to account for ...
379 views

### When to use a chi-squared test?

This is a very basic question however I do not have a statistical background and I am currently analysing some data for my dissertation. I have constructed a survey about healthy lifestyles & ...
510 views

### Predicting response propensity in a rolling data collection

I'm working with a survey that uses a rolling data collection format (i.e., there are multiple waves of sampling and initial contacts). I'm trying to develop a model to predict how likely a sample ...
865 views

### Assessing the representativeness of population sampling

I am looking for some suggestions about assessing the representativeness of a particular dataset I am analyzing. In this dataset I am looking at the relationship between two variables (e.g., X and Y)...
224 views

### Correcting Sample Selection Bias given actual Distribution

I have two datasets, both from the same population: The samples from the first survey are quite representative of the underlying truth. However, the second survey comes with a change in distribution ...
108 views

### Statistical significance of a difference between poll percentages with a small sample?

Analyzing my company’s internal survey results, I was stuck with calculating statistical difference between percentages. I usually used a Z-test as described below, but I am not sure whether it is ...
27 views

### How should I respond a survey?

As researchers working with survey data know, surveys are plagued with incomplete or missing data, measurement errors, selection issues, etc. I am soon going to take part in a survey. How should I ...
2k views

### Binomial logistic regression in SPSS using survey weights

I am running a logistic regression in SPSS with a sample that uses survey weights. The sample size is 1000 and the weights are along the lines of .86 or 1.23 depending on the case. I am using the ...
131 views

### Margin of Error for poll that allows selecting multiple options?

I have a poll with a known sample size (let's say n=1000) which has results that look like this: ...
35 views

### “Does not apply” category frequencies are much higher than the frequencies of any other category in the variable

I'm working with the data from a national survey. In some of the variables frequencies for "does not apply" category are much higher than for any other response in the variable. Do I just ignore the ...
802 views

### Questionnaire design for linear regression

I am trying to conduct a research on brand preferences and I am trying to analyze regression equation i.e. which factors affects the consumer preferences (dependent factor) and other determined ...
673 views

### Margins of error for a simple multiple-choice question

I wish to plot error bars on a bar chart that represents the answers of 200 respondents, randomly selected from a population of 50,000,000, to a simple multiple-choice question. Here are the ...
109 views

### Determine Chi Square Group Differences in multiple choice questionnaire

I'm trying to determine if there is a group difference in answering a multiple choice question. For example, I want to answer the question of, do "Change Instigators" (group A) answer "communication"...
70 views

### How is the hazard ratio in Cox proportional hazard models affected by the case sampling?

I'm trying to conduct survival analysis using Cox proportional hazard models, looking at a biomarker for heart disease. Age is a major risk factor, so I'm modeling the age as the time scale (counting ...
102 views

### Profiling survey respondents with both categorical and ordinal variables

I have a mixture of categorical and ordinal variables from a survey that I am trying to use to create "profiles" or segments that differ from one another with respect to a dependent variable (the ...
721 views

### Correcting for heteroscedasticity in logistic regression

I am using a large health dataset as a part of a research project (N = ~18 000). My colleagues and I are investigating whether smoking predicts the presence or absence of a mental illness. We are ...
530 views

### Analysis of survey data

This is the first time I am analyzing a survey. I have limited knowledge about stats and the best practices and would appreciate some pointers as to what kind of analysis I should perform on the data. ...
547 views

### Post-hoc power analysis of complex sample survey data

I am working with a complex sample survey data using Stata to determine the predictors of a given dependent variable. As part of my analysis result I want to report the post-hoc power for each ...
1k views

### Contingency tables, Chi-Squared analysis and next steps in R

I'm hoping one of the more experienced R programmers/statisticians out there can help me with something, or explain why what I'm trying to do is stupid :-) In the past, I've done analysis of survey ...
4k views

### Transforming scores between different rating scales – Importance of response options

I'm working on a meta analysis of the mean of a single variable (using arithmetic mean as the effect size, rather than the relationship between two variables). The attitude I'm assessing has been ...
160 views

In Google's consumer survey product, they calculate confidence intervals using the Wilson score interval for the unweighted results. Does anyone know how they calculate the confidence interval after ...
73 views

### Randomized Response With Continuous Outcome

Can someone point me to an example of how to do randomized response with a continuous outcome $Y \in [ 0,\infty ]$, rather than a binary one? I am interested in the mean and variance of this outcome ...
128 views

### Are there guidelines for when to remove survey participants who blindly filled in the bubbles?

I just did a survey and I'm pretty sure some people just filled in the bubbles on the survey without reading the questions. A pretty obvious indicator are responses to items that are negatively coded (...
451 views

### Matched Analysis with Complex Survey Data

Complex survey data is that typically found produced by the National Center for Health Statistics (NCHS) or the NSLY; it typically contains information on PSU, strata, and weights. To make nationally ...
19 views

### Pooled Panel Data Regression and Questions on “Missing Values”

Lets say i want to identify the effect of some categorical variables x1 x2 x3 on a numeric y. I got data from 3 waves on the same individuals, but there are missing values on some variables because of ...
38 views

### Item sampling techniques to reduce processing time for questionnaire

I have a well-crafted draft of a questionnaire, containing 240 items. The average processing time is 20 secs per item, so the entire questionnaire would take around 1 hour 20 min to complete. I want ...
48 views

### Repeated measures, multilevel regression or another type of analysis?

I'm doing an experiment for which I've distributed a survey. People were asked in this survey to rate the attractiveness of 5 other people. I provided four groups of pictures and 1 of those groups ...
117 views

### Statistical significance of percentage difference for a poll question with multiple options?

The question is: how to calculate the statistical significance of difference between percentages in the case described below? Suppose we have a poll question with $n$ answer options $A_1, …, A_n$, ...
83 views

### Configuring survey design for multilevel modeling with National Inpatient Sample

I am a researcher looking to use multilevel mixed-effects models in Stata 14 to analyze the National Inpatient Sample. I am aware that the typical way that you configure the NIS' survey design for ...
26 views

### What statistics can compare individual survey responses & others that were measured as a group (from which we need to extract individual responses)?

The organization I belong to studies indigenous populations through primarily survey research. One study for example aims to identify the relationship between culture and the evaluation of odors. We ...
239 views

### Equivalence of svyglm and glm for simple random surveys

I have been exploring the use of the svyglm function in R's survey package to analyse surveys with both equal and unequal sampling probabilites. For an unequal ...
220 views

### fit indices for cfa based on 2 groups/samples?

I have a question regarding fit indices for a cfa based on 2 groups/samples. Specifically, I have fitted a cfa model with one factor based on 7 indicators (questionnaire items), and two samples (...
742 views

### pooling over imputation with LASSO in R

I've been trying to find an answer to my question, with no success. It could be I'm just not looking for it in the right way (I'm also learning about imputation and lasso as part of the process). So I ...
70 views

### Survey data and hypothesis testing

I am wondering if a certain thing is possible. I think it might not, but some of my colleagues try to persuade me that it it indeed possible. So here is the problem: I have some survey data, where ...
35 views

### Detecting a significant change in survey answers

I conducted a user study where participants were asked to rate the relevance of search results on the following scale: "very unrelevant", "unrelevant", "relevant" and "very relevant". Every ...
34 views

### Survey on how frequently a group use a particular device: Which analysis methods?

I surveyed a group of photographers and asked them how frequently they used a particular type of lens for a specific type of photograph. I now want to find out which lens or lenses are the most ...
152 views

I am currently working on my thesis and so I adopted 2 scales to measure two concepts. Before launching the survey, I 'paraphrased' the scales items in a hope to not copy them verbatim (excuse my fear ...
47 views

### Identifying trends when data points are averages with standard errors

I am trying to use a regression to identify trends in the poverty rate over time in county level Census data. I cannot use smaller geographies in my regression because the rates provided by Census ...
28 views

### Imputation for Industrial Survey

What do you think the best imputation method is for industrial surveys? Methodology reports usually mention historical background, administrative data or hot-deck, but according to the theory, the ...
11 views

### Can ANOVA be used to study effects when doing a one-off survey?

Just wanted to check whether ANOVA can be used to study effects (e.g.: effect of age on intensity of social media use) based on the data from a one-off survey. Frequency of social media use is ...
272 views

### PCA for questionnaire reduction

I'd like to have some opinion regarding if I'm in the right way with my questionnaire reduction. I have a questionnaire with 275 questions and 34 issues (so a couple of questions are related to each ...
149 views

### Proper Specification of Balanced Repeated Replicate Weights in R Survey Package

I am trying to properly apply BRR (balanced repeated replicate) weights in the R Survey Package and I am using the National Center for Education Statistics ELS 2002 dataset. I am not sure how to ...
76 views

### comparing survey responses

I have requested 30 participants to answer the same question about 100 images: "How easy is it for you to recognize this image?" on a scale from 0 to 100, where 0 is easy and 100 is difficult. I want ...
617 views

### How meaningful is to pool data from different surveys on the same target population?

Apologies for cross posting This is a very theoretical question for me but I would like to find an answer as I might want to use this in the (near) future. In many cases same questions are used in ...