Skip to main content

Questions tagged [small-sample]

Refers to statistical complications or problems due to having few data. If your question is about a small sample relative to the number of variables, please use the [underdetermined] tag instead.

Filter by
Sorted by
Tagged with
0 votes
0 answers
11 views

considering 96 observation for estimating the intercept (rule of thumb)

I remember Prof. Frank Harrell stated that in order to calculate the sample size using the rule of thumb, we must include 96 observations for just computing the intercept, hence the estimated sample ...
elisa's user avatar
  • 33
8 votes
5 answers
759 views

Correlation for Small Dataset?

I have an $x$ and a $y$ that I would like to find the correlation of to learn more about their relationship. Unfortunately, I only have $10$ points. Can I in good faith use the Pearson correlation ...
Camellia99's user avatar
0 votes
0 answers
15 views

Investigating seasonality and trend in short time series

I am interested in investigating the presence, or lack of, seasonality or trend in very short time series (typically max 12 observations). Case in point: suppose one is looking at average number of ...
Astral's user avatar
  • 133
15 votes
4 answers
1k views

Train-validation-test split for small and unbalanced dataset?

I have a dataset of around 100 rows, each with around 400 features. 93 of them are class 0, and 7 are class 1. I want to be able to split my 100 examples into a train set, a validation set, and a test ...
Thao Nguyen's user avatar
1 vote
1 answer
82 views

Distribution of a spread of observations in triplicate sample taken from Gaussian distribution

Suppose random triplicate samples are taken from a Gaussian distribution with known mean and SD. What should be the distribution of the maximum absolute difference between 3 possible pairs of ...
Maciej Tomczak's user avatar
3 votes
1 answer
43 views

How to deal with extremely small training dataset in machine learning? [duplicate]

I've around 100 rows of data with labels ...
zZzZ's user avatar
  • 79
1 vote
1 answer
141 views

How to deal with extremely small training data? [closed]

I've around 100 rows of data with labels ...
zZzZ's user avatar
  • 79
3 votes
2 answers
64 views

Mixed-effect logistic regression with small sample size: is it possible or do you have alternative solutions?

I want to run a mixed-effect regression model on a few data points. I have 24 participants and 4 trials per participant. I want to include two fixed effects and their interaction in the model, as well ...
chiaras15's user avatar
2 votes
0 answers
31 views

Regression with small sample size - LASSO or remove variables?

I'm trying to run a regression, but I only have 14 observations, each being a different city in the US. My dependent variable is the total number of trips per capita, and my explanatory variables are ...
BeyondConfused's user avatar
5 votes
2 answers
403 views

ANOVA vs Kruskal Wallis - Small sample size

I have data from an experiment comparing plant weights for 4 independent treatment groups. The data seem to be normally distributed (I have been warned about using statistical tests for normality). ...
user411569's user avatar
4 votes
1 answer
270 views

Small Sample size

I have collected primary data from 100 tech startups. However, there are 23k active tech startups. Given that, how will I justify the small sample size. I am collecting the data from an emerging ...
Anu's user avatar
  • 65
1 vote
0 answers
84 views

Hyperparameter tuning for small datasets

I have about 10 small imbalanced datasets (some of them only have about 150 samples). I want to try a bunch of balancing techniques on some models. For that, I'm using the repeated stratified cross-...
beautifularmy's user avatar
0 votes
0 answers
12 views

Engle-Granger cointegration test critical values

I am conducting the Engle-Granger cointegration test on a system of three time series: logged spot exchange rates, logged domestic price index, and logged foreign price index. I would like to use ...
Pavel Filip's user avatar
0 votes
0 answers
6 views

Statistical test for change in time series with one group

I have conducted a latent class trajectory analysis using growth mixture models on a sample of 150 individuals. Individuals are assigned to 2 classes - 1 consisting of 18 individuals and the second ...
j.rahilly_UCL's user avatar
3 votes
2 answers
177 views

Validity of R pwr package for extremely small sample sizes (<10)

Edit: this question is not: about programming About post-hoc power analysis (at least not with the intent to use sample statistics in post-hoc analysis - I have pretty good population estimates and I ...
W_vH's user avatar
  • 341
0 votes
0 answers
22 views

Aggregating daily sampling evidence into a monthly estimate

Suppose there's a business process that's sampled daily for quality review purposes, i.e., a population of items is generated in daily batches, and randomly sampled every day to identify production ...
st1led's user avatar
  • 242
3 votes
1 answer
93 views

How to calculate sample size? How to affect sample size?

We are trying to figure out sample size to our research. We are comparing to groups. Group 1 will get treatment and group 2 don't get treatment. From previous studies we know that there was recurrence ...
user405350's user avatar
4 votes
1 answer
202 views

Does it make sense to fit linear regression on single-case studies?

Just on principle, do you think it would make sense to make linear regression models for each individual in a study and treat replicates as data points? I don't mean reporting p-values or anything ...
maglorismyspiritanimal's user avatar
0 votes
0 answers
22 views

Estimating transition probabilities and their ranges

I have a system with multiple states (N) that can transition from one state to another at every discrete time increment, or stay in the same one. I want to obtain a good estimate of the transition ...
VDC's user avatar
  • 101
7 votes
2 answers
354 views

Intuition and reasoning why LASSO can only select $n$ features when $n \ll p$

I'm struggling to grasp the intuition behind why LASSO can only select at most $n$ features when $n << p$, where $n$ is the number of samples and $p$ is the number of features. I've read through ...
Jacob Bumgarner's user avatar
8 votes
2 answers
141 views

How can I use a variable as a covariate which exists only for specific range for some clusters/groups?

I want to know how to use Poisson GLMMs when we have unequal samples available for different groups/clusters/participants in data. Imagine a study where each of the 60 participants are given 1000 ...
medium-dimensional's user avatar
1 vote
0 answers
44 views

Comparing means of a small sample with non-normally distributed data

I am confused about how best to compare means when the sample is small and they are not normally distributed. I have survey data which measured the mental wellness status of a very small sample of a ...
kpm's user avatar
  • 59
0 votes
0 answers
31 views

Test Distribution Difference between small sample sizes

My first post of StackExchange. I am working on data analysis project for comparison of fraud and nonfraud transactions. My objective is to compare the feature vectors of nonfraud transactions and ...
confused_data_scientist's user avatar
0 votes
1 answer
141 views

Choosing a probability distribution for 4D data: dirichlet challenges and alternatives

I'm seeking the right distribution for my 4D data, where the sum of values in each sample equals one. Currently, I've chosen to employ the Dirichlet distribution. However, upon applying this ...
roan's user avatar
  • 1
2 votes
1 answer
102 views

Statistical test for rates that are very low with low count

I want to know if dataset suitable for test of significance, and if 'no' (which I am suspect) why exactly not as I must report it why not. I have three apples species (Gala, Pink Lady and 'new') and ...
lincoln80's user avatar
0 votes
0 answers
22 views

Sample size to achieve an error E on mean estimation, for a normal distribution with unknown variance

Disclaimer: This is actually related to a previous question. I decided to post this as a new question as I feel it specifies the problem enough to be considered a separate question. If mods believe ...
ren1's user avatar
  • 21
2 votes
0 answers
44 views

How to know if I have enough sample for a small sample t-test to be appropriate?

Say I have 15 or 20 samples each from two samples. The data shows evidence of strong skew. I am considering a two-sample t-test of means, based on the assumption that the sampling distribution of the ...
Estimate the estimators's user avatar
2 votes
1 answer
136 views

Finding probability that the mean of a sample is below a certain limit

I have a complicated physical model that can produce a certain quantity (real-valued) for a large (in the 1000's) number of points (N). We assume that mean and variance of the model output is a good ...
FrenchKheldar's user avatar
0 votes
0 answers
27 views

Hold-out Set -- Smallest Acceptable Size given somewhat rare event?

I am contemplating the appropriate percent train-test split (e.g. 90%-10%, 80%-20%) Note I am asking about model evaluation, not cross validation/model building. This is for creating a hold out set to ...
purple-blade's user avatar
0 votes
2 answers
74 views

Paired t-test for 2 patients?

For my doctoral thesis work, I conducted a small feasibility study on the use of a virtual reality therapy protocol in preventing aggressive recidivism in 2 treatment-resistant schizophrenic patients. ...
Servane Grall's user avatar
0 votes
0 answers
110 views

Correcting p-values when accounting for age and sex in a study where the main objective is to find differences between disease/control

So I analyzed my metabolomics data using Mann Whitney U tests and OPLS-DA. My data is super small, with the control group only having 5 samples and the other groups having 10 and 14 samples ...
maglorismyspiritanimal's user avatar
0 votes
0 answers
54 views

How to construct confidence interval out of a sample with small number of events?

I'm analyzing the results from an epidemiological study, where I have a sample of 2k persons with their respective ages and whether they were detected with a disease or not by different technologies. ...
egil137's user avatar
  • 11
0 votes
0 answers
22 views

Questions regarding small-sample time series models

Thanks for your time handling my issues. I have several time series models to be improved for the same data set. Time series regression The first model incorporates only 5 time stamps, whereas we ...
Tonggh's user avatar
  • 11
1 vote
0 answers
94 views

What is the minimum number of data points/observations required to use Theil-Sen?

I am working on an algorithm which requires estimating trend magnitudes of data points. I have been told to use Theil-Sen as it is more robust to outliers and it is non-parametric. As users will be ...
locus's user avatar
  • 11
1 vote
0 answers
85 views

What do you think of this analysis for a small dataset with a weird experimental design?

I have a very small dataset (n<30) that is divided in 3 groups: healthy controls, patients with condition A, and patients with condition B. I am going to do a lipidomics analysis of the samples, so ...
maglorismyspiritanimal's user avatar
7 votes
5 answers
381 views

Proper analysis for vernal pool study data

I am trying to analyze a dataset consisting of counts of amphibian egg masses (3 different species) in nine vernal pools over a four-year period (consecutive years, 2014 to 2017). During each count (...
Alex H's user avatar
  • 83
0 votes
1 answer
40 views

What is the best hypothesis test method for a sample dataset with values less than 0.1?

I have a dataset with attributes X, Y, W, and Z. X is the predictor, Y is the outcome, Z is the confounder and W is the mediator. I have defined 1 STL formula for each attribute denoted by f(X), f(Y), ...
Breeze's user avatar
  • 25
1 vote
1 answer
80 views

Small sample sizes and transfer learning

I have a very small dataset (n = 18) of patients with certain key data as well as imaging. I have performed a clustering analysis (via PCA and hierarchical clustering) to cluster these patients based ...
neriticzone's user avatar
1 vote
1 answer
42 views

What does small optimism in predictor effect mean?

I'm reading the following paper by Burke et al. Minimum sample size for developing a multivariable prediction model: Part I – Continuous outcomes The paper discusses the minimum number of samples ...
Connor's user avatar
  • 635
0 votes
0 answers
52 views

Do neural networks work with high-dimensional small sample data?

Are neural networks used for the classification of high-dimensional small sample data like gene microarray data, where the dimension may be on the order of 1000 features per sample with around 100 ...
Undertherainbow's user avatar
0 votes
0 answers
44 views

Resampling as prior distribution?

Suppose we've got a small dataset that we have no prior knowledge about and we're going to use linear regression on it. I have been wondering whether instead of fitting a normal OLS it would make ...
Fatafim's user avatar
  • 205
0 votes
0 answers
53 views

How do you deal with a high Feature/Sample ratio?

I am working on a machine learning task with a small dataset of 130 samples, each with 66 features. When I try to fit a model to this data, I encounter issues with either overfitting or underfitting. ...
Connor's user avatar
  • 635
3 votes
2 answers
50 views

Sample size Red flags for a data set I was asked to analyze, please help

I am working in polishing up work an undergraduate class did and the data set is raising a lot of red flags for me. Like to the point that if these concerns I have aren’t resolved by either redoing ...
JewJitsu11B's user avatar
1 vote
1 answer
50 views

Do monthly sales of a retail shop have a unit-root?

Simple question to understand if by nature monthly sales from a retail shop on the high street are likely to have a unit-root in its timeseries or not?
Alejandro Leno's user avatar
0 votes
0 answers
166 views

Strong difference between lambda.min and lambda.1se

I have run an elastic net on a relatively small sample (n= 320) with 17 predictors and 5-fold cross-validation (no train-test sample because of the small sample size) and 100 bootstraps. When I look ...
Kat's user avatar
  • 1
0 votes
0 answers
146 views

Is there some way to analyze nominal data with repeated measures when there is a very small sample size?

So I have some data of 16 patients who were subjected to a test a different number of times (some only once, some as many as 7 times). The response variable is definitely nominal (I wasn't involved in ...
maglorismyspiritanimal's user avatar
1 vote
0 answers
33 views

Unequally right-censored survival analysis

I'm trying to do a survival analysis and I want to know how to handle unequal right-censorship. Essentially, people enter the trial at different ages and exit either at death or at the end of the ...
Charles's user avatar
  • 1,238
4 votes
2 answers
396 views

Modeling continuous interaction effect with very small sample

I have a very small data set (n = 12) of high level athletes each with a set of measurements representing technique (5 variables) and a set of measurements representing strength (3 variables), and I ...
user avatar
1 vote
1 answer
41 views

small dataset for a regression task

I am trying to train a NN model in MATLAB to predict the amount of overflow for flooded junctions in an urban runoff system and I have 45 samples and 15 features. The issue is, I don't think 45 ...
Ari's user avatar
  • 11
6 votes
3 answers
1k views

P-value adjustment for a single test with low sample size

I have a dataset of 2 conditions. Each condition has 15 measurements. I tested them using paired t-test to find if the difference is statistically significant. Should I use a p-value correction method ...
hkarakurt8743's user avatar

1
2 3 4 5
15