Refers to any statistical complication or problem due to having few data.

learn more… | top users | synonyms

1
vote
1answer
39 views

Paired samples or independent sample hypothesis test for two time periods

I want to know if employees in an organization are surveyed in 2013 and again in 2014 if the samples from the two time periods are considered related and dependent or independent if they are asked the ...
0
votes
1answer
19 views

Using a measure of productivity which is determined by reviewers

Apologies for the ambigious title - I wasn't sure how a problem like this is expressed. I have a small sample of 20 individuals, of which the dependent variable (of interest) is binary with 5 ...
0
votes
0answers
24 views

OLS with dummy and few observations (12 mean values from 2.5k observations)

I have a dataset of 12 markets, in total ~2.5k trades happened over all markets. I now calculated 6 different measures for the each markets performance (my 12 observations per measure I want to use as ...
0
votes
0answers
16 views

Calibrated Probabilities for Outlier Detection Algorithm

I am currently developping a 2 class classification algorithm. However, as the dataset is at the moment really small (<50 observations) and imbalanced (~1/10 ratio), I decided to rather first ...
1
vote
1answer
71 views

Increasing sample size with bootstrap sampling

I'm trying to perform some classification analyses with a relatively small dataset (201 observations, 32 predictors). There are 8 classes in my data with unequal sample sizes ranging from 10 in the ...
1
vote
1answer
24 views

Size multilevel logit model

I want to estimate a multilevel logit model. But I'm confused about the minimum number of groups and observations per group. What would be the minimum number of observations per group? My case: I ...
1
vote
1answer
50 views

Using nonparametric tests with small samples even when data are normaly distrubuted

Is it appropriate to use a nonparametric test with a small sample (e.g., less than 65 people) even when data are normally distributed? For example, using the Spearman correlation? Actually my data is ...
0
votes
0answers
16 views

Small sample size : dealing with bootstraping for linear or nonlinear multiple regression

I am wondering to heal my ignorance from your experiences or your modeling knowledge. I have many matrices of quantitative variables, let me start with three matrices of proportions.To express ...
1
vote
0answers
17 views

Problem Approach: uncertainty about sample size

I have a time series of events (weekly aggregate date) Each event is information on contracts closed by a sales representatives during working weeks. The goal is to calculate what is the expected ...
4
votes
1answer
60 views

ANOVA-type test but with known population variance of each group

I have a set of $N$ samples $s_{i}$, each one sampled from a normal distribution with standard deviations $\sigma_i$, which are known. I would like to know if the distributions have the same mean. I ...
2
votes
1answer
44 views

MANOVA when sample size is smaller than the number of DVs

I need to compare $16$ quantitative variables, measured for two groups, A and B. I thought of applying MANOVA. However, there are only $4$ and $9$ cases for groups A and B respectively. I looked for ...
1
vote
0answers
9 views

Selecting the right DV in study of treatment effect on a small sample?

I want to run a simple experiment at work to see if making a single change F on a product, has any significant adverse effect on the performance. I need help to ...
0
votes
0answers
13 views

Optimizing selection from varying sets

On pages of website(s) I have a set of potential messages to choose from and only one or two slots to show them in. (think 'this product is on sale' or 'this product is new'). On each page the set ...
0
votes
0answers
18 views

Few-clusters bias correction for cluster robust covariance matrix in random effects model

I'm currently working on some experimental data. Subjects are randomly assigned to one of two treatments. For each treatment I ran three sessions with 20 subjects each. In each session, participants ...
2
votes
1answer
14 views

Cross validation and small samples

I have a sample of 415 observations. With a sample with this size, it's possible to use cross validation?
0
votes
0answers
47 views

Is my sample suitable for elastic net? What are the assumptions?

I was hoping to use multiple regression to identify significant predictors but I have a tiny sample size (group 1 n=9, group 2 n=37) so I'll be unable to do this. I have read that regularisation ...
0
votes
0answers
8 views

Model Specification tips for increasing the power of a GLM model with small sample size? (SAS)

I am working on a model that uses a wide variety of categorical predictors vs. a continuous dependent variable. Unfortunately, my usable n ends up being 28. I am having difficulty getting significance ...
2
votes
1answer
122 views

Regression with very small sample size

I want to run a regression with 4 to 5 explanatory variables, but I have only 15 observations. Not being able to assume these variables are normally distributed, is there a non-parametric or any other ...
1
vote
2answers
55 views

If one group has 23 participants and the second group has 117 participants in it, can we rely on the result of t-test? [duplicate]

I was evaluating a research paper in which the authors have 23 male participants and 117 female participants. They have applied t-test to calculate Gender differences and have even concluded on ...
1
vote
1answer
19 views

Increasing statistical power by having a highly sensitive outcome measure

Is it logical to say that you can increase statistical power by having a highly sensitive outcome measure? I say this because a highly sensitive test has low Type II error, and low Type II error leads ...
1
vote
0answers
15 views

Poisson confidence interval that accounts for time?

I've gathered Poisson-distributed data and would like to compute a confidence interval, but the number of events and the amount of time are very small. Since standard CIs for rates aren't appropriate ...
0
votes
0answers
53 views

Rule of Thumb for minimum length of time series for Autocorrection estimation

I had a related question answered here: Rule of Thumb for minimum length of time series for AR(1) estimation However the answer gives rise to a new question. I want to be able to estimate the Auto ...
2
votes
1answer
54 views

Rule of Thumb for minimum length of time series for AR(1) estimation

I have a data set of 350 points, I want to estimate the lag 1 auto correlation for different sub-sets of the data. More precisely I want to take non overlapping windows of length 1,2,3....n and ...
0
votes
0answers
19 views

regression analysis for dataset with few predictors and few samples

I have a small pilot dataset containing experimental measurements for 12 samples, 4 numeric predictors and 1 numeric outcome variable. The goal is to obtain a first rough estimate on the extent to ...
0
votes
0answers
53 views

Validating Bootstrapped Probability of Survival Results From Small Sample Size Data

Quite often in industry, due to cost and schedule constraints, decisions must be made on small sample size data. I have 4 cycles-to-failure values resulting from running samples to failure in a ...
1
vote
1answer
52 views

parametric bootstrap for low sample sizes

I believe that this question is sufficiently different from previous related ones to warrant a new post. (I apologize if it has been answered already) I need to decide between various resampling ...
0
votes
0answers
21 views

How to equalize lower accuracy on larger sample sets?

I have a collection of image samples that I want to OCR. I also have the ground truth of the text on these images. Now I OCR them and eg. 10 of 100 samples are wrong. So I got an accuracy of 90%. ...
1
vote
0answers
14 views

What are some suggestions for analysis of and model development for a small sample of data?

I originally planned on path analysis utilizing multivariate multiple regression to test my hypothetical model - but I am not getting my sample size. I have looked at non-parametric regression ...
1
vote
1answer
42 views

Compare two small groups (population vs sample) over time

I am studying banks behaviour according to 6 financial rations throughout a 3-years period. I have 32 observations separated into two groups: large (6) and medium-sized banks (26). However, since in ...
27
votes
4answers
783 views

Can bootstrap be seen as a “cure” for the small sample size?

This question has been triggered by something I read in this graduate-level statistics textbook and also (independently) heard during this presentation at a statistical seminar. In both cases, the ...
9
votes
2answers
231 views

Bootstrap: the issue of overfitting

Suppose one performs the so-called non-parametric bootstrap by drawing $B$ samples of size $n$ each from the original $n$ observations with replacement. I believe this procedure is equivalent to ...
1
vote
1answer
125 views

small sample size, large number of variables (most categorical) - how to proceed?

I would be grateful for general guidance/advice about data analysis with some data that is problematic for me because of the small sample size, and the large number of categorical data. I realize this ...
1
vote
2answers
96 views

Given a series of past coin tosses from an unfair coin, how can I calculate the confidence for the next toss result?

So this is really difficult for me, but I would like to know if this is possible. Let's assume I have an unfair coin (absolutely no assumptions can be made about the coin), and my past result has ...
2
votes
3answers
313 views

Pattern mining on a small data set

I have a small data set 30 features/predictors and 30 observations. My target variable is Oil production and my predictors are well & reservoir properties (depth, trajectory, temperature, pressure ...
1
vote
0answers
7 views

Modification of categorical outcomes in small samples

I have a set of abnormal lab findings and a set of tenderness outcomes in a small sample of "cases" and "positive controls". We hypothesize there may be some lab findings which differentially affect ...
1
vote
1answer
64 views

Should a Poisson regression be carried out with only 3 data points?

I'm trying to test the relationship between the number of adults counted and the percentage heather cover over 3 areas. The data looks like this: ...
1
vote
0answers
51 views

What are appropriate validation methods for a Bayesian network model with low sample size?

I am currently using a Bayesian network model with 20 variables and 210 data points, with 15 locations measured at 14 different time points each. There are also some restrictions on what types of ...
0
votes
0answers
10 views

What are some guidelines for sample size when constructing a Bayesian Network?

Both general advice and advice specific to my case below is welcome. I'm trying to contruct a Bayesian network with 20-30 continuous variables. I have 15 locations sampled, with 14 time points each. ...
1
vote
1answer
32 views

Which non-parametric test should I run on ordinal data from a small sample?

I have one group of six raters who scored recordings of two separate six-person groups of participants, each group under separate conditions. While the participants were divided into two independent ...
0
votes
0answers
14 views

What test to use when analysing methylation differences with very small sample size?

I have not been capable of figuring out which test to use for my data, so I hope you can guide me in the right direction. I have array DNA methylation data for 5 families. From each family I have ...
3
votes
1answer
135 views

OLS regression - robust estimates for parameter's variance

I'm estimating a model for corporate social responsibility (not important). I have found my variable of interest significant at 5% confidence level. My sample is $N=84$, cross-section. For this I ...
0
votes
1answer
76 views

What are appropriate tests for goodness of fit on glm with a small sample size?

I've thought quite a lot on large sample size inference where the strong law of large numbers is easily validated. In my case however, I'm trying to infer the sign and magnitude of an outcome where ...
1
vote
0answers
32 views

Random sampling the data again to keep equal size across groups

I have an experiment with a between-group variable. It has 3 groups in total. When conducting the experiment, although we did random assignment for participants, the size of the 3 groups end up ...
6
votes
2answers
347 views

Is the sampling distribution for small samples of a normal population normal or t distributed? [closed]

If I know that the population is normally distributed, and then take small samples from this population, is it more correct to claim that the sampling distribution is normal or instead follows the t ...
1
vote
2answers
114 views

How to choose predictors for regression model

I want to predict reaction times using several personality scores. I have 9 different personality scores. My sample consists of 23 participants. Aren't there too many predictors if I put all 9 in one ...
0
votes
0answers
31 views

Best estimator for small samples

I have a sample of an unknown distribution for which I would like an estimate of the true value and the expected error on that estimator. Since the underlying distribution is not necessarily Gaussian ...
1
vote
1answer
62 views

For a T-test, what would happen if one of my samples was made up of only one observation? [duplicate]

I must be missing something, or under-thinking what goes on with a basic T Test, but I was under the impression that if I do a T-test, and one of my samples was made up of only one observation, the ...
2
votes
1answer
68 views

Small sample, many observations. Is the sample large enough?

I am working on a project regarding the influence of temperature and other variables on the sales of 3 branches of one local bakery. The research goal is to be able to better predict bakery sales (in ...
1
vote
0answers
16 views

How to create a weekly alert system that works for different sample sizes?

I'm trying to build a weekly alert system to let me know when something unusual has happened in my analytics data that might require further investigation. Currently there is an outdated system in ...
3
votes
1answer
74 views

Can Poisson regression be run with a small sample?

I am just a beginner. I have a sample of 71. I wish to do a Poisson regression. Is this sufficient for estimating a Poisson model? Should I use only counts as $Y$ variable or should I use percentages ...