# Questions tagged [methodology]

For questions about statistical methodology or choice of statistical methods.

324 questions
Filter by
Sorted by
Tagged with
19 views

### How to find patterns within groups when observing multiple groups of the same variables?

I'm looking for a statistical method to test whether or not the order of companies who won public procurements is random or more commonly the same. I have a large table of data- around 20 000 ...
1 vote
33 views

### Is this a meaningful method to determine spread around mean?

I have student ratings of 123 schools across the US. They represent 100% of this type of school across the US. The ratings are on the scale Poor, Fair, Good, and Superb, and I have the number and ...
171 views

### Is reporting univariate regression next to multivariate regression acceptable methodology?

In a paper published in Ebiomedicine (part of the Lancet family journals), the researchers built a logistic model including a variety of predictors and then reported both "univariate" ...
30 views

### Long-term event study vs. difference-in-differences (DID) analysis

I am trying to understand the differences between event studies and DiD analysis. In particular, if I want to estimate the specific effect of an event like certification adoption, CEO appointment, or ...
25 views

### Which method of logarithmic transformation is correct to use in linear model?

I try to do a simple linear model with logarithmic transformation of y values. I found that depending on which method I use the results differ and I don't ...
28 views

### Difference and difference with multiple time period

I would like to know if someone has a solution for running a difference in difference model in R with variation in treatment timing. I mean, normally a treatment dummy and a post treatment dummy ...
1 vote
31 views

### Why is internal consistency a measure of reliability?

Why is 'internal consistency' a measure of reliability? It looks like a measure of validity instead. Definitions: "Internal consistency reflects the extent to which items within an instrument ...
• 105
38 views

### Did D. Paul Sullens use proper methodology in his 2016 study on the children of gay parents? [closed]

When the study "Invisible Victims: Delayed Onset Depression among Adults with Same-Sex Parents" was released, a rebuttal was soon posted. Sullens posted a counter which stated at the end: I ...
1 vote
37 views

### How to deal with bias caused by data collected with different methods on a GLM?

I have two datasets from different years (2020 and 2021) that I needed to merge because my sample was too small. I'm investigating which morphological features (sex, age, weight, fat reserves and ...
• 11
27 views

### I’m trying to find the association between 2 variables by conducting a statistical test

My two variables are sex (male/female) and body mass index (BMI). I have a data set of 194 participants. Sex - 107 males (55.15%) / 87 females (44.85%) BMI - 23.88 +/- 5.03 I have no idea which test ...
11 views

### How can I use the trend of a graph to plot the next point?

I created a hypothesis for a chemistry assignment and then conducted an experiment. The experiment resulted in a graph that had a downward trajectory. It looked like this: I found the data points by ...
1 vote
30 views

### Combining multiple time series with unknown start dates

I have a small database of voltage information from multiple batteries (of the same type), with each measurement being a tuple of (battery id, battery voltage (as a percent) and measurement time). I ...
• 11
48 views

### Use LASSO & bootstrapping for inference stats - no machine learning

I have a simple question: it is valid to use a LASSO model for variable selection in a small dataset? I won't do any machine learning. The goal is to use LASSO for variable selection instead of ...
• 1
54 views

### "Ordinal" is to "level of measurement" as "dependent variable" is to __________ [closed]

The Question If I'm drawing up a table that describes some variables -- a data dictionary, say -- and I consider whether a variable is "ordinal", or "nominal", or "interval&...
• 659
64 views

### What statistical test to use

I want to carry out a study but I don’t know which statistical method to use for analysing the results. I have two buildings (say, houses A and B) and I keep daily records of some quantitative ...
1 vote
12 views

### Rerunning requests in meta-analysis

When performing a meta-analysis, is it advisable to run database requests more than once (i.e. not only in the initial inclusion phase)? If so, what is the expected added value? If not, how to deal ...
11 views

### How are samples selected when batching?

Suppose after being randomized samples in a dataset can be written $\{x_i\}_{i = 0}^n$ and are put into a batch for mini-batch gradient descent. Are the samples drawn randomly into a batch, or are the ...
• 121
21 views

### Why does rotating Pearson's $r$ in my simulation reduce its $MSE$? And could you use this with real data to improve $MSE$?

I've been running some Monte Carlo simulations in R to determine the impact on $MSE$ of rotating Pearson's $r$ (the sample statistic, not its data) by itself at various angles, for multiple levels of ...
• 110
34 views

### Proper method for comparing rates between subsets of a population

I've been handed a bunch of historical data on performance ratings of individuals in a number of organizations, and asked to identify any instances where there appear to be "abnormalities" ...
• 141
28 views

### Checking whether improvement is significant

I am looking to compare if there is a significant improvement between two test trials. As a background: some time ago as a practise I created a simple app aimed at improving pressure force accuracy. ...
• 1
37 views

### What is the proper way to externally validate clusters when I have only a sample of the dataset labeled, but want to cluster the entire dataset?

I have a dataset of text-based documents that I want to cluster. For a sample of this dataset (~10%) I have manually annotated labels (i.e., the ground truth). I would like to cluster this dataset to &...
• 21
12 views

### How to sample a study with a similar methodology but different data availability to another study?

I am working on a study following a methodology similar to an already published study. Our mutual objective is to test if a certain explanatory variable explains flows of average foreign investment ...
• 11
96 views

### Should I use Raw Counts, TPMs, or RPKM gene expression values for training ML models?

I am currently using TPMs(Transcripts per Million) in my ML models, but I have read recently that this may introduce unwanted relations into the data. I know the raw counts are used to find ...
1 vote
28 views

### Sensitivity analysis on secondary outcome

I plan to perform a meta-analysis with a primary outcome consisting in very rare events (sometimes not occurring in any group of some studies included), and a much more frequent secondary outcome. To ...
42 views

### Quantifying spatial correlations for independent images

I have a series of maps (100x100 pixels each) and for each map, each pixel is labeled according to what is located there (currently values are in RGB, where each color denotes a different substrate). ...
• 1
26 views

### Analysing non-outcome variables in meta-analysis

I am working on a meta-analysis project in suicidology. This is more like an academic exercise and will not necessarily be submitted for publication, but I try to be as rigorous as possible. Now here ...
26 views

### Can I flip the endpoints of my Likert scale?

I am using different validated scales for my survey and most of them go from negative (disagree) to positive (agree) endpoints. In order to ensure usability, I would like to keep all scales with such ...
453 views

### Causal inference where potential outcome is somehow "violated"?

The fundamental problem of causal inference says that only one potential outcome is observed for each unit. What happens if both outcomes from control and treatment can be observed? Can we still make ...
• 301
1 vote
29 views

### In sequence analysis, my confounders should be measured at the beginning, at the end or during the length of the study time of the sequences?

I'm working on a study for analysis patterns of treatment choices via sequence analysis (discrepancy). I have sociodemographic variables (age groups, sex, etc) that I have measured from baseline but ...
• 11
1 vote
57 views

### Method selection - multivariable non-parametric

I am not sure about the method selection for my data. Dependent variable: Continuous variable and grouped in ordered categories. As continuous it is not normally distributed but skewed to the right. ...
1 vote
22 views

### When to check model assumptions

Statistical methods are based on model assumptions. For example, an independent one-way ANOVA makes the following assumptions: Normally distributed residuals Homogeneity of variance Independence of ...
17 views

### Pooling in a Meta Analysis

I am looking to pool data for adverse events for a meta analysis and I wanted to see if my plan made sense I want to pool my AE together based on the Clavien Dindo categorizations, as this will make ...
1 vote
64 views

### Removing instances that decrease accuracy of Machine learning algorithm Methodology

Is it bad practice to run a Machine learning algorithm on an experimental dataset, check the MAE, and remove the instances that have a value of MAE above a certain limit? If we run the algorithm ...
1 vote
22 views

### Estimating the size of a population. Is the method employed valid?

Context: in North America there has been a Drug Overdose Epidemic for several years. In my own municipality, more people have died of overdose than of COVID during the pandemic. My workplace (a non ...
• 400
1 vote
24 views

### Statistical estimate of original data that has been merged together

I'm currently working with predicting monthly sales of maintenance for a certain type of machine. Say the machine types available are A, B and C, and I'm only interested in predicting maintenance ...
• 11
1 vote
50 views

### Data appear in both dependent and independent variable: what is this error called?

I want to find a proper name for the analytical problem I've identified below. One of the most accurate measure of firearm availability is the proportion of suicides committed with firearms, or FS/S (...
9 views

### Which method to use to compare a mean to the means from past surveys?

I have data for every year. The big dots are the means for every year. The lines are only to visualize the difference between means. Every mean in every year is based on an individual sample/cohort. ...
• 21
1 vote
56 views

### Model for predicting disease that is highly correlated with age

I am trying to train a model for predicting a disease that is correlated with age and gender. Extracted features seem to be both discriminatory for age, gender and the disease. What is a proper ...
• 11
36 views

### Methodology for machine learning models (classification or regression)

I'm wondering if there are any well-justified end-to-end methodologies for developing machine learning models (classification or regression). At work, there is a guy who developed a methodology for ...
• 243
21 views

### Methodology for exploratory analysis on dataset

This question is about finding the right methodology: A population of cash machine is being analyzed. The variable we are measuring is the money income produced. We are analyzing the variable over a ...
19 views

### How and what to test: symptom limited test without symptoms?

I'll try to explain the question as easy as possible with two example patients of my $\approx 100$ patient groups. All patients had a specific operation, prior and a year after operation they ...
15 views

### What are proper tests for analyzing choice between two options?

For surveys with the following responses, what are the appropriate statistical methods to analyze the data? The goal is to find which lists ultimately users prefer following several questions asking ...
• 41
18 views

### Machine learning based on changes in time

A project from my school goes like this: Let's say we are to develop a model to recommend stocks to a fund manager. The current model takes a whole list of stocks as input and outputs a list of stocks ...
16 views

### Is a linear mixed model appropriate to test 16 single, but nested pictures

as a pre-study, I want to let participants rate Likert scales for 16 pictures. These 16 pictures are nested as following: We took 4 photographs of 2 male and 2 female doctors, each assumed the exact ...
65 views

### Time data that aren't time series - except now, consider a duration aspect

This is a follow-up to the question How to approach time data that aren't time series?. I realized that my prior question was missing an important nuance, so I have to change the hypothetical ...
• 3,903
74 views

### Prospective study and ascertainment of the exposure during the follow-up period

This question landed here after two migration requests from "Medical Sciences" and "Operations Research" I'm reading several prospective studies published in top journals where a ...
• 342
1 vote
64 views

### How to approach time data that aren't time series?

Imagine a scenario where I managed to, in a three-column data structure, gathered a sample from a single population. The sample consists of a unique identifier for a household, a calendar year, and ...
• 3,903
21 views

### Power in meta-analysis: Determining the number of studies to reach a specific confidence interval width

Aim: I would like to do a prospective power-analysis (before data collection) to determine the number of studies that have to be included in my meta-analysis. Data Format: Heavy-metal concentration in ...
• 21
1 vote