# Questions tagged [overlapping-data]

The tag has no usage guidance.

38 questions
Filter by
Sorted by
Tagged with
0answers
22 views

### A measure to prove distribution overlap?

Is there a statistical measure to show the overlap between two probability distributions? For example, see the violinplots of two example distributions above of a binary variable with orange being 0 ...
0answers
15 views

### Comparing survival times in overlapping groups

I have a following statistical setup I don't know how to attack: I have two therapies: say A and B. For some patients A works better, for other B works better. I want to direct patients to their ...
0answers
22 views

### Given a draw from two mixed normal distributions, how can I determine the probability it came from each distribution? [duplicate]

Apologies if this is too close to this question: Given a draw from one of two overlapping normal distributions, what is the probability it came from one vs. the other? but I did not see a ...
0answers
108 views

### Overlap of Two Probability Distributions in Python

So I saw someone use this code to find out how much overlap two normal distributions have. ...
0answers
19 views

### Simultaneous regressions for several overlapping time series

I have tried my best to keep this simple, because I am no stat buff, and I'm just trying to assess whether our choice of regression is ok. We've gathered time series data on daily small cap returns ...
1answer
25 views

### Cross checking AI Selections vs Random Chance

Fifty Three Images AI Selects 20 images based on various criteria. I Select 20 images based on personal criteria. In a two group selection of all 53 items what is the likely overlap due to random ...
1answer
83 views

### Survival Analysis on recurrent behavior time series predictor

We are trying to build a credit model to predict the default time (or finally closed the loans as censored). The predictor is a high-dimension time series of current observed previous payment behavior....
0answers
49 views

### Spatial regression with overlapping areas

Is it statistically correct to calculate a regression with overlapping areas? I have market areas as the spatial unit with different sociodemographic and (macro)economic variables and I´m examining ...
0answers
30 views

### (Another) What Statistical Test Should I Use?

If I ask 600 different people to rate 3 different images from 0-10 (i.e 3 samples of 200 people per image) and I calculate the mean scores per image as well as the overall mean for all 3 images, can I ...
0answers
31 views

### Probability of Finding Two Matching Subsequences in a Sequence

I'm currently studying DNA sequencing and am trying to find a formula which gives the probability that a subsequence of length $k$ appears twice in a sequence of $L$ bases (characters); this is pretty ...
0answers
34 views

### How to analyze combined data from studies with overlap in subjects?

I have data from multiple placebo-controlled cross-over trials (each with $n \simeq 20$) with unique phenotypes measured during the placebo phase. I'd like to combine the data from these measurements ...
2answers
91 views

### The minimum number of classes in the case of overlapping classes

I've a set of elements that should be grouped in the minimum number of groups, each element belongs to overlapping classes, for eg: a belongs to the classes x , y , z; b belongs to the classes x , y; ...
2answers
156 views

### 95% CI for GMC did not overlap but paired Wilcoxon signed rank test gave a p-value > 0.05

I measured antibodies for a pathogen on the same group of subjects measured at month 2 and month 7. Since antibody concentrations vary a lot from subject to subject, we decided to use Geometric Mean ...
0answers
98 views

### Forecasting with annual data that has a rolling quarter

I want to fit an ARIMA model for forecasting on a quarterly basis, but my data is a rolling year, updated quarterly, how can I use this most effectively? I'm really interested in the best estimate of ...
0answers
165 views

### Correcting estimate of covariance/correlation with overlapping/autocorrelated data

I'm wondering how to correct for the presence of autocorrelation/heteroscedasticity in estimating sample covariance matrices from data. I know there have been some questions on this before: ...
1answer
101 views

### how to merge multiple overlapping datasets with different units of measurement

I have many overlapping datasets of molecules and their respective binding affinities to a receptor structure. Each dataset comes from a different experimental assay and conditions, therefore the ...
0answers
44 views

### Intersection of significant differences

My data are signals in which each data point represents a pair of time point and location on the brain. I have a categorical variable with three levels: conditions A, B, and C. I have run non-...
1answer
532 views

### What is the probability (area) of overlap of two normal distributions having EQUAL variance

Can you please provide a math formula or an Excel example (math operations and Excel functions jointly used) to compute the probability (area) of overlap of two normal distributions having EQUAL ...
0answers
133 views

### Overlapping data and QQ plot

Problem Have a time series of data and want to look at changes over long periods so want to use overlapping changes, then want to compare these overlapping changes to overlapping changes from a normal ...
0answers
317 views

### How to analyse multiple choice and overlapping questions in MCA?

I need to analyze a survey about entrepreneurship which has around 50 categorical variables. Therefore, after some univariate analysis, I want to apply Multiple Correspondence Analysis (MCA) in order ...
2answers
354 views

### Comparing overlap and matches in different datasets

My goal: a measure/test/score/etc. that can give me a numerical value for how similar two datasets are. Let's say I have two datasets, each with a differing number of datapoints, where each datapoint ...
0answers
35 views

### How to estimate treatment effect with overlapping treatments?

I've taken over a project with an overlapping treatment design and I'm wondering how to estimate the overall effect. The description: Our organization sends 4 separate promotional postcards to our ...
0answers
31 views

### calculate percent of sample in overlapping distributions

I'm looking at 80k samples representing results of a test after a fixed period of time. I think it looks like a combination of normal curves. I see a fair amount of documentation about combining ...
0answers
37 views

### Can the data from two resources be mixed?

There are several sources of temperature-dependent viscosity data, which goes as following: |:--------------------------------| | 273.15 | 320.5 | 330.25 | |---------------------------------| | 1....
0answers
44 views

### Resampling in R to see if percentage of pairwise sharing between lists is significant

I have three lists of strings: ListA, ListB and ListC. First 3 lines of ...
0answers
546 views

### How to compute the normalized overlap area between two curves [duplicate]

I am trying to calculate the overlap area (normalized by the total area) of two plots. The plots are from X Y datasets. I saw a lot of questions about getting the overlap area but from normal ...
1answer
570 views

### Defining overlapping periods

I have a dataset containing the abundance of migrating bird species. In the figure below you can see that there are two "bell" shapes that are overlapping somewhere around September. One of the bell ...
0answers
552 views

### Overlapping clustering

It looks like "overlapping clustering" scheme where objects may belong to more than one cluster will fit my data. I've found some literature about this subject, but i'l be glad if anyone can point me ...
0answers
113 views

### Compare scores calculated for two groups who overlap?

I have three groups of ten children (A, B and C). They are each have different treatments (the treatments are to do with how they are taught about a certain biological feature). Two scores are ...
1answer
532 views

### Classification on Imbalanced and Overlapping Data

I am currently working on a project that not only is imbalanced but has a lot of overlap between the data points from the two classes. I am not quite sure how to go about solving this problem. What ...
1answer
62 views

### Misguiding data relationship between Y and X?

Background: I am currently surveying a number of articles related to subject of urban sprawl. One of the things that I have come across multiple times in the literature (a thing which seems to bother ...
0answers
52 views

### Comparing whether the aggregated measures significantly differ between overlapping samples

Let's say that I have some marketing data split between brands: 80% of respondents use brand a 60% of respondents use brand b This data is derived from surveys in which respondents answer questions ...
1answer
296 views

### Do I have endogeneity problem if I use overlapping observations in AR(1) model?

My dependent variable is $y_t=\frac{data_t}{data_{t-4}}-1$ with quarterly data and the model is standard AR(1): $$y_t=\alpha_1 y_{t-1}+\beta x_t+\varepsilon_t.$$ I was told that due to ...
0answers
455 views

### Overlapping linear regressions

I have observations x,y. I am trying to learn a linear model for y against x. The local slope of the relationship maybe a function of y itself, and the nature of that relationship isn't clear. To ...
2answers
624 views

### Covariance estimation of overlapping time series

I have two series $x_t,z_t$, and compute the differences like $\Delta_h x_t=x_t-x_{t-h}$. What is a good estimator of the covariance of changes? $$Cov[\Delta_h x_t,\Delta_h z_t]$$ The intervals are ...
0answers
331 views

### Empirical distribution function of overlapping time series data

If we model asset return volatility for periods of more than one (say more than one day) there is the square-root rule which holds true under some assumptions. On the other hand practitioners ...
0answers
935 views

### Correlation and coefficient with overlapping data

I have a time series data, with 5-period rates sampled at 1 period intervals. Essentially $$r_i = x_{i+5} - x_i ; ~~ i=1,...,N-5$$ This creates an overlapping data problem for regression. As far ...
0answers
72 views

### Using overlapping data as if it was not

I am looking again at a popular statistical testing method used in finance, suspect it's a bit naughty, but would like to have a more experienced eye take a look also. The method is the following, ...