Questions tagged [research-design]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
5
votes
2answers
80 views

Latent Profile Analysis and Statistical Methods in Psychology

There has been a popular phenomenon that has several ‘hallmark’ components, and are uniquely associated with sexual abuse survivors. I would like to verify that the components can stand as a construct,...
5
votes
1answer
2k views

Advantages/disadvantages of fractional factorial design vs completely randomized design

I'm new to the design of experiments (DoE) and will be running a screening experiment to estimate the effect of a large number of binary independent variables (approximately 10) on a single continuous ...
3
votes
1answer
72 views

Model selection with low N?

I've got a study which is kinda messed up by the design...Turns out I ended up with about 50 patients of which 80% have the outcome and 20% don't (binary outcome). I've been turning in my bed for the ...
3
votes
1answer
44 views

Crossing Frequentism and Bayesian Analysis

Has anyone considered giving the posteriors of an analysis a sampling distribution and seeing where, methodologically, things could go from there? For details, check out: https://sdba-stats.weebly.com
3
votes
1answer
23 views

Evaluate change in participant population characteristics

The Project I'm doing an analysis concerning a major drop in service uptake since the beginning of COVID. I have access to administrative data for those using services, including relevant demographic ...
3
votes
1answer
342 views

Is a three-way fixed effects model equivalent to a triple difference estimator?

I have a conceptual question about the fixed effects model and the difference-in-differences (DD) estimator. Since a two-way fixed effects model is equivalent to a DD estimator, I was wondering if ...
3
votes
2answers
154 views

Can a cross-sectional study use incident cases?

I am struggling with the epidemiological definition of my clinical study design. Looking at the literature I take it that case-control studies are retrospective (i.e. you must look back on the ...
3
votes
3answers
920 views

Is there a difference between controlling for population size directly vs. putting variables in per capita terms?

I want to look at the impact of a number of factors (e.g nutrition, alcohol sales, GDP, etc.) on mortality. I have a dataset with 10-30 years of data on these variables aggregated at the state level. (...
3
votes
1answer
233 views

Question about attributing change from a pre- to post- survey to the larger population if the respondents are different from time 1 to time 2?

I administered a front office staff customer service satisfaction survey anonymously to consumers at different mental health clinics. Then the front office staff at these clinics received a course ...
3
votes
0answers
25 views

To what degree does reproducibility of research differ across disciplines?

Have there been any statistics meta studies that compare the reproducibility of results, as well as the willingness of researchers to provide reproducible data, analysis, and code, in their studies ...
2
votes
3answers
40 views

In a RCT, what are the risk of selection bias if no allocation bias is present?

In the Wikipedia page about Randomized Controlled Trials (RCT), the procedures section states that RCT minimize selection bias and allocation bias. My understanding is that selection bias "occur ...
2
votes
1answer
20 views

What is a "split-body" RCT?

I am reading the RCT Wikipedia page, in particular the classification by study design. There are described four types of RCT: (i) parallel groups (ii) crossover (iii) cluster (iv) factorial. Then ...
2
votes
1answer
124 views

Is most published research indeed false?

I have come across (Ioannidis, 2005) which explains several reasons (mainly statistics-related, that's why I post this question here) to justify the claim that most published research is indeed false. ...
2
votes
2answers
88 views

How to do meta-analysis of diagnostic tests with only sensitivity and specificity?

I am a junior physician, and I've run into some problems with the meta-analysis of diagnostic tests and I was hoping to get some input. Some background: Aside from my undergraduate statistics courses ...
2
votes
1answer
76 views

How to deal with treatment effect at state level but observations at school level?

I have a panel of schools and I want to estimate the effect of a state level policy on school level outcomes (all schools in a treated state are treated). I can't use a fixed effects model since the ...
2
votes
1answer
36 views

How to tell if one value is different from another?

I have a dataframe made up of counts in different time periods as so: ...
2
votes
1answer
38 views

Bayesian design for a small sample and how to include informed priors

I am new to Bayesian approaches so thank you in advance for your patience. I am looking to investigate the influence of a specific type of brain lesion on the lateralization of verbal memory in a data ...
2
votes
1answer
15 views

Combining results of two studies due to incomplete data

I am doing a study looking at the effects of a certain virus in rats. We are looking at certain concentrations of bio markers in the blood. I came into this project part way through and no power ...
2
votes
1answer
51 views

Does 'proper' experimental design, in terms of ensuring scientific validity, require that the same skilled individual perform all of the measurements?

I'm not sure if this is on-topic here. If not, then please tell me and I'll delete it. I have a question about the proper way to design biomedical experiments that involve human-administered ...
2
votes
0answers
84 views

Imposing a distribution on a dependent variable to increase variation in the dependent variable - disaggregating data

The question I have essentially has to do with dis-aggregating data, based on a known distribution of the data with respect to a certain variable. It has some resemblances with post-stratification, ...
2
votes
0answers
43 views

What is the appropriate analysis for this type of repeated measures multi-binary data?

There is a popular theory within psychology that certain emotions will trigger "prototypical" facial expressions defined by the simultaneous contraction of specific facial muscles. For example, if a ...
2
votes
0answers
75 views

Variables common to all individuals in a panel

I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank. I have a panel of seven individuals (seven districts of Tajikistan) over 17 months. Dependent ...
1
vote
1answer
271 views

Real noise modeling/ noise map generation (image processing, deep learning)

I am working on a project with really noisy images. I have trained a detector that can detect the characters but fails in some cases (noise is high). So far I have gone through many denoising, ...
1
vote
1answer
35 views

Imputing missing data using testing data

My supervisor has instructed another person in my lab to use both training and testing data to impute missing values for use building a machine learning model. The results of the analysis haven't ...
1
vote
1answer
46 views

Can this additional data improve the validity of Difference-in-Differences estimate

I am aiming to measure the impact of a treatment (a marketing stimulus) on product revenue. The data has resulted from a natural experiment. The set-up is tabulated below. Cells in the table indicate ...
1
vote
2answers
38 views

What to do when there’s no statistical test for this type of data?

I am looking at the effects of resistance to a drug intended to increase serotonin levels on the course of depression. Basically, every participant (N=20) takes a pre measurement of serotonin levels (...
1
vote
1answer
38 views

When you have multiple replications of a study do you combine the data or analyze separately?

Assuming that I have multiple replications of survey data, each one with exactly 1000 unique participants, do I run statistical analyses by combining the data into one large set of 3000 participants? ...
1
vote
0answers
10 views

How to call this experiment research design?

I am doing research in user interface design. I will conduct a user study where the participants will have to give label to a sentence(positive or negative sentiment). To label sentences, the user ...
1
vote
0answers
39 views

Sample Obtained is it Random Sample?

I feel embarrassed but I am confused with the below question. An interviewer plans to stand at an entrance to a popular shopping mall and conduct interviews. $$$$Is the below statement true? $$$$ ...
1
vote
0answers
10 views

Statistical Responses/tests for Yes/No, Pre/Post surveys

I am completing a research paper regarding clinician adherence to a protocol. One of the questions is whether or not they use adjuctive therapy to the treatment. I have a pre and post survey, yes/no ...
1
vote
0answers
27 views

Conceptual framework for predicting customer probability of changing to online purchases

I'm likely to be tasked to create a predictive model for predicting if our customers will start using our online store. I have 2 frameworks to do it. I'm pretty certain of one framework and very ...
1
vote
0answers
39 views

Ablation Study training until when?

Given that deep learning models can take weeks to train, having to train 20 different models becomes infeasible when performing an ablation study. Are there some formally accepted common practices on ...
1
vote
0answers
17 views

What statistical analysis should I use for this proposed study?

The aim of this study is to determine the impacts of monolingualism and bilingualism on the literacy skills of primary aged children with ASD. This experiment is a between subject’s design as it will ...
1
vote
0answers
25 views

Are these the major response variable types?

I am a biologist with an interest in experiment design. I recently refreshed my memory about what kinds of response variables that are possible, and made this chart (see jpeg). I would like feedback ...
1
vote
0answers
19 views

Research area about - Forecasting time series with added items

I'm wondering is there any time series research area about the change of forecasting with added items. For example, in the prototype below, when we check each recommended item, the forecast about ...
1
vote
0answers
50 views

Would a repeated measures MANOVA be appropriate for a 9DV, 2IV within subjects study design?

I am trying to get an estimate of participants to strive for in my study. Being rather new to the research and stats scene, I was hoping the community could help me out a little bit? The study has 9 ...
1
vote
0answers
31 views

Is causal relationship between two variables a theory?

I was asked if Y causes Z a theory, and I noticed that I have a gap in my knowledge on that. I know that theory could be causal, descriptive or predictive in its explanation. However, a theory is an ...
1
vote
0answers
22 views

How to correctly plan for Missing Data in Longitudinal / Repeated Measures Design?

Using an hierarchical questionnaire for a longitudinal study, I face strict constrains in how many items can be processed by each subject per week. The questionnaire contains 51 Items in total, but ...
1
vote
0answers
40 views

How to measure the difference between the results of 2 T-tests?

For some context, I am currently trying to come up with the right type of research methodology for my masters in education and my thesis is basically comparing the difference between performances of ...
1
vote
0answers
77 views

should I resample/downsample the patients in the control arms?

I have retrospectively collected clinical data of two sets of patients, one set with the diagnosis of tumor A (group A) and the other with tumor B (group B). There're 90 patients in group A, and 1100 ...
0
votes
2answers
97 views

Conceptual interpretations of predictive versus causal modeling

I'm a relatively non-technical clinician. And I recently came across an excellent paper paper (Schooling & Jones, 2018).The authors essentially implore biomedical researchers to use non-ambiguous ...
0
votes
1answer
66 views

Prospective study and ascertainment of the exposure during the follow-up period

This question landed here after two migration requests from "Medical Sciences" and "Operations Research" I'm reading several prospective studies published in top journals where a ...
0
votes
1answer
35 views

What is the right machine learning research methodology to compare two neural network approaches against eachother?

I am new to machine learning research, and I have a general question regarding how to compare different models on the same data set. How does a top researcher do this, and what is expected from a ...
0
votes
1answer
291 views

How to calculate the sample size for a categorical independent variable with a dichotomous dependent variable

Suppose that in a large population group you have 5 different ethnic groups, and you wish to calculate the prevalence of a disease in each ethnicity(percentage of people in each ethnic group having ...
0
votes
1answer
41 views

Suggested books to study statistics [closed]

I am doing a research that requires me collecting and analyzing data samples in order to identify if there is correlation or no with respect to some parameter. I am looking for the best resources to ...
0
votes
1answer
47 views

Data analysis mess! Huge data set, 2 factors with 2 levels each, but the levels are the same

To explain the hypothess a little bit: The factors would be emotional words and neutral words; the levels of both factors are left and right visual hemifields. The data is the participants response ...
0
votes
1answer
61 views

Statistical analysis, repeated measures t test or anova? Trouble with input when running any test

I've tried using google sheets/excel, but I can't figure how to run a 2 factor without repetition ANOVA (if that's the appropriate test for this data set). I think it's the way I set the spreadsheet ...
0
votes
1answer
512 views

Regression with mostly binary and categorical variables in R

I am looking to run regression using a variety of predictor variables: Chemical exposure (1 or 0) - variety of chemicals but all are binary predictors, Illness diagnosis (1 or 0), and TBI severity (0 ...
0
votes
1answer
199 views

What is a good machine learning academic research workflow/tools? [closed]

I'm interested in ML research and want to get some insights into how its done in practice. In particular: What kind of data are you dealing with? How are you dealing with hyper-param optimization? ...
0
votes
0answers
51 views

Using Pearson Moment Correlation For Establishing Validity Between Two Questionnaires

I'm moderately new to psychometrics and test design, and I'm currently in the process of attempting to develop a questionnaire that measures soft skills (communication, collaboration, work ethic, ...