Questions tagged [research-design]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
5
votes
1answer
2k views

Advantages/disadvantages of fractional factorial design vs completely randomized design

I'm new to the design of experiments (DoE) and will be running a screening experiment to estimate the effect of a large number of binary independent variables (approximately 10) on a single continuous ...
3
votes
1answer
70 views

Model selection with low N?

I've got a study which is kinda messed up by the design...Turns out I ended up with about 50 patients of which 80% have the outcome and 20% don't (binary outcome). I've been turning in my bed for the ...
3
votes
1answer
44 views

Crossing Frequentism and Bayesian Analysis

Has anyone considered giving the posteriors of an analysis a sampling distribution and seeing where, methodologically, things could go from there? For details, check out: https://sdba-stats.weebly.com
3
votes
1answer
23 views

Evaluate change in participant population characteristics

The Project I'm doing an analysis concerning a major drop in service uptake since the beginning of COVID. I have access to administrative data for those using services, including relevant demographic ...
3
votes
2answers
116 views

Can a cross-sectional study use incident cases?

I am struggling with the epidemiological definition of my clinical study design. Looking at the literature I take it that case-control studies are retrospective (i.e. you must look back on the ...
3
votes
1answer
196 views

Question about attributing change from a pre- to post- survey to the larger population if the respondents are different from time 1 to time 2?

I administered a front office staff customer service satisfaction survey anonymously to consumers at different mental health clinics. Then the front office staff at these clinics received a course ...
3
votes
0answers
24 views

To what degree does reproducibility of research differ across disciplines?

Have there been any statistics meta studies that compare the reproducibility of results, as well as the willingness of researchers to provide reproducible data, analysis, and code, in their studies ...
2
votes
1answer
117 views

Is most published research indeed false?

I have come across (Ioannidis, 2005) which explains several reasons (mainly statistics-related, that's why I post this question here) to justify the claim that most published research is indeed false. ...
2
votes
2answers
53 views

How to do meta-analysis of diagnostic tests with only sensitivity and specificity?

I am a junior physician, and I've run into some problems with the meta-analysis of diagnostic tests and I was hoping to get some input. Some background: Aside from my undergraduate statistics courses ...
2
votes
1answer
72 views

How to deal with treatment effect at state level but observations at school level?

I have a panel of schools and I want to estimate the effect of a state level policy on school level outcomes (all schools in a treated state are treated). I can't use a fixed effects model since the ...
2
votes
1answer
33 views

How to tell if one value is different from another?

I have a dataframe made up of counts in different time periods as so: ...
2
votes
1answer
35 views

Bayesian design for a small sample and how to include informed priors

I am new to Bayesian approaches so thank you in advance for your patience. I am looking to investigate the influence of a specific type of brain lesion on the lateralization of verbal memory in a data ...
2
votes
2answers
591 views

Is there a difference between controlling for population size directly vs. putting variables in per capita terms?

I want to look at the impact of a number of factors (e.g nutrition, alcohol sales, GDP, etc.) on mortality. I have a dataset with 10-30 years of data on these variables aggregated at the state level. (...
2
votes
1answer
42 views

Does 'proper' experimental design, in terms of ensuring scientific validity, require that the same skilled individual perform all of the measurements?

I'm not sure if this is on-topic here. If not, then please tell me and I'll delete it. I have a question about the proper way to design biomedical experiments that involve human-administered ...
2
votes
0answers
84 views

Imposing a distribution on a dependent variable to increase variation in the dependent variable - disaggregating data

The question I have essentially has to do with dis-aggregating data, based on a known distribution of the data with respect to a certain variable. It has some resemblances with post-stratification, ...
2
votes
0answers
38 views

What is the appropriate analysis for this type of repeated measures multi-binary data?

There is a popular theory within psychology that certain emotions will trigger "prototypical" facial expressions defined by the simultaneous contraction of specific facial muscles. For example, if a ...
2
votes
0answers
53 views

Variables common to all individuals in a panel

I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank. I have a panel of seven individuals (seven districts of Tajikistan) over 17 months. Dependent ...
1
vote
1answer
185 views

Real noise modeling/ noise map generation (image processing, deep learning)

I am working on a project with really noisy images. I have trained a detector that can detect the characters but fails in some cases (noise is high). So far I have gone through many denoising, ...
1
vote
2answers
36 views

What to do when there’s no statistical test for this type of data?

I am looking at the effects of resistance to a drug intended to increase serotonin levels on the course of depression. Basically, every participant (N=20) takes a pre measurement of serotonin levels (...
1
vote
1answer
14 views

Combining results of two studies due to incomplete data

I am doing a study looking at the effects of a certain virus in rats. We are looking at certain concentrations of bio markers in the blood. I came into this project part way through and no power ...
1
vote
1answer
37 views

When you have multiple replications of a study do you combine the data or analyze separately?

Assuming that I have multiple replications of survey data, each one with exactly 1000 unique participants, do I run statistical analyses by combining the data into one large set of 3000 participants? ...
1
vote
0answers
8 views

Statistical Responses/tests for Yes/No, Pre/Post surveys

I am completing a research paper regarding clinician adherence to a protocol. One of the questions is whether or not they use adjuctive therapy to the treatment. I have a pre and post survey, yes/no ...
1
vote
0answers
22 views

Is a three-way fixed effects model equivalent to a triple difference estimator?

I have a conceptual question about the fixed effects model and the difference-in-differences (DD) estimator. Since a two-way fixed effects model is equivalent to a DD estimator, I was wondering if ...
1
vote
0answers
22 views

Conceptual framework for predicting customer probability of changing to online purchases

I'm likely to be tasked to create a predictive model for predicting if our customers will start using our online store. I have 2 frameworks to do it. I'm pretty certain of one framework and very ...
1
vote
0answers
14 views

Ablation Study training until when?

Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on ...
1
vote
0answers
17 views

What statistical analysis should I use for this proposed study?

The aim of this study is to determine the impacts of monolingualism and bilingualism on the literacy skills of primary aged children with ASD. This experiment is a between subject’s design as it will ...
1
vote
0answers
20 views

Are these the major response variable types?

I am a biologist with an interest in experiment design. I recently refreshed my memory about what kinds of response variables that are possible, and made this chart (see jpeg). I would like feedback ...
1
vote
0answers
19 views

Research area about - Forecasting time series with added items

I'm wondering is there any time series research area about the change of forecasting with added items. For example, in the prototype below, when we check each recommended item, the forecast about ...
1
vote
0answers
39 views

Would a repeated measures MANOVA be appropriate for a 9DV, 2IV within subjects study design?

I am trying to get an estimate of participants to strive for in my study. Being rather new to the research and stats scene, I was hoping the community could help me out a little bit? The study has 9 ...
1
vote
0answers
31 views

Is causal relationship between two variables a theory?

I was asked if Y causes Z a theory, and I noticed that I have a gap in my knowledge on that. I know that theory could be causal, descriptive or predictive in its explanation. However, a theory is an ...
1
vote
0answers
22 views

How to correctly plan for Missing Data in Longitudinal / Repeated Measures Design?

Using an hierarchical questionnaire for a longitudinal study, I face strict constrains in how many items can be processed by each subject per week. The questionnaire contains 51 Items in total, but ...
1
vote
0answers
38 views

How to measure the difference between the results of 2 T-tests?

For some context, I am currently trying to come up with the right type of research methodology for my masters in education and my thesis is basically comparing the difference between performances of ...
1
vote
0answers
67 views

should I resample/downsample the patients in the control arms?

I have retrospectively collected clinical data of two sets of patients, one set with the diagnosis of tumor A (group A) and the other with tumor B (group B). There're 90 patients in group A, and 1100 ...
0
votes
2answers
66 views

Conceptual interpretations of predictive versus causal modeling

I'm a relatively non-technical clinician. And I recently came across an excellent paper paper (Schooling & Jones, 2018).The authors essentially implore biomedical researchers to use non-ambiguous ...
0
votes
1answer
31 views

What is the right machine learning research methodology to compare two neural network approaches against eachother?

I am new to machine learning research, and I have a general question regarding how to compare different models on the same data set. How does a top researcher do this, and what is expected from a ...
0
votes
1answer
183 views

How to calculate the sample size for a categorical independent variable with a dichotomous dependent variable

Suppose that in a large population group you have 5 different ethnic groups, and you wish to calculate the prevalence of a disease in each ethnicity(percentage of people in each ethnic group having ...
0
votes
1answer
38 views

Suggested books to study statistics [closed]

I am doing a research that requires me collecting and analyzing data samples in order to identify if there is correlation or no with respect to some parameter. I am looking for the best resources to ...
0
votes
1answer
45 views

Data analysis mess! Huge data set, 2 factors with 2 levels each, but the levels are the same

To explain the hypothess a little bit: The factors would be emotional words and neutral words; the levels of both factors are left and right visual hemifields. The data is the participants response ...
0
votes
1answer
60 views

Statistical analysis, repeated measures t test or anova? Trouble with input when running any test

I've tried using google sheets/excel, but I can't figure how to run a 2 factor without repetition ANOVA (if that's the appropriate test for this data set). I think it's the way I set the spreadsheet ...
0
votes
1answer
478 views

Regression with mostly binary and categorical variables in R

I am looking to run regression using a variety of predictor variables: Chemical exposure (1 or 0) - variety of chemicals but all are binary predictors, Illness diagnosis (1 or 0), and TBI severity (0 ...
0
votes
1answer
193 views

What is a good machine learning academic research workflow/tools? [closed]

I'm interested in ML research and want to get some insights into how its done in practice. In particular: What kind of data are you dealing with? How are you dealing with hyper-param optimization? ...
0
votes
0answers
17 views

Is this a valid method to test textual difference?

For some research I am trying to reject/ not-reject the null-hypothesis that the proportion of a word is higher in a certain sample of a text than in the rest of the text. The full text is a ...
0
votes
0answers
4 views

Advice on how to analyze effectiveness of two categorizations of the same data set

I have a set of samples that were categorized based on two different sets criteria. (Low vs High), and (Mild, Moderate, Severe). These categories are supposed to predict the likelihood of becoming ...
0
votes
0answers
8 views

Power analysis for anova when one set of comparisons is particularly of interest

I've been messing around with how to perform a power analysis for an experiment with three groups: control, disease model, and disease model + treatment. From past studies I have a good estimate of ...
0
votes
0answers
12 views

Questionnaire design taking into account info from an older questionnaire

5 years ago, we designed a questionnaire with 300+ questions and we got responses from 1400 people, all of them from the same country. We then applied a PCA in order to reduce the dimensionality. We ...
0
votes
1answer
18 views

measurement error in categorical dependent variable

Let's just say that in my field several studies find some significant associations between a variety of CEO attributes and some organizational policy (binary categorical dependent variable). Many use ...
0
votes
0answers
14 views

How to test whether group membership type 1 predicts group membership type 2?

I am planning an experiment in which I will categorize participants into groups based on performance on two tasks. Based on task 1, participants will be categorized into a "high performer" ...
0
votes
0answers
28 views

Relating Temp / Size / Time to Mortality Rates from Catch and Release Fishing

I am conducting a fish catch and release mortality study and have hit a wall with the statistics portion of my report and could use a nudge in the right direction. I am trying to relate a few ...
0
votes
1answer
18 views

Is it possible to do correlational analyses on unmatched data? Trying to understand a research paper

My stats knowledge is average but not great, so I apologise if this is something I just haven't come across before. Basically, I've just read a paper which seems to state that it has conducted ...
0
votes
0answers
6 views

Number of Tests necessary for object detection (test/experiment design)

I want to find out the number of tests necessary to validate certain performance characteristics of an object detection system with a certain confidence. The system just detects if a relevant object ...