Questions tagged [overlapping-data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
22 views

A measure to prove distribution overlap?

Is there a statistical measure to show the overlap between two probability distributions? For example, see the violinplots of two example distributions above of a binary variable with orange being 0 ...
0
votes
0answers
15 views

Comparing survival times in overlapping groups

I have a following statistical setup I don't know how to attack: I have two therapies: say A and B. For some patients A works better, for other B works better. I want to direct patients to their ...
0
votes
0answers
22 views

Given a draw from two mixed normal distributions, how can I determine the probability it came from each distribution? [duplicate]

Apologies if this is too close to this question: Given a draw from one of two overlapping normal distributions, what is the probability it came from one vs. the other? but I did not see a ...
0
votes
0answers
108 views

Overlap of Two Probability Distributions in Python

So I saw someone use this code to find out how much overlap two normal distributions have. ...
0
votes
0answers
19 views

Simultaneous regressions for several overlapping time series

I have tried my best to keep this simple, because I am no stat buff, and I'm just trying to assess whether our choice of regression is ok. We've gathered time series data on daily small cap returns ...
0
votes
1answer
25 views

Cross checking AI Selections vs Random Chance

Fifty Three Images AI Selects 20 images based on various criteria. I Select 20 images based on personal criteria. In a two group selection of all 53 items what is the likely overlap due to random ...
0
votes
1answer
83 views

Survival Analysis on recurrent behavior time series predictor

We are trying to build a credit model to predict the default time (or finally closed the loans as censored). The predictor is a high-dimension time series of current observed previous payment behavior....
3
votes
0answers
49 views

Spatial regression with overlapping areas

Is it statistically correct to calculate a regression with overlapping areas? I have market areas as the spatial unit with different sociodemographic and (macro)economic variables and I´m examining ...
1
vote
0answers
30 views

(Another) What Statistical Test Should I Use?

If I ask 600 different people to rate 3 different images from 0-10 (i.e 3 samples of 200 people per image) and I calculate the mean scores per image as well as the overall mean for all 3 images, can I ...
1
vote
0answers
31 views

Probability of Finding Two Matching Subsequences in a Sequence

I'm currently studying DNA sequencing and am trying to find a formula which gives the probability that a subsequence of length $k$ appears twice in a sequence of $L$ bases (characters); this is pretty ...
0
votes
0answers
34 views

How to analyze combined data from studies with overlap in subjects?

I have data from multiple placebo-controlled cross-over trials (each with $n \simeq 20$) with unique phenotypes measured during the placebo phase. I'd like to combine the data from these measurements ...
4
votes
2answers
91 views

The minimum number of classes in the case of overlapping classes

I've a set of elements that should be grouped in the minimum number of groups, each element belongs to overlapping classes, for eg: a belongs to the classes x , y , z; b belongs to the classes x , y; ...
2
votes
2answers
156 views

95% CI for GMC did not overlap but paired Wilcoxon signed rank test gave a p-value > 0.05

I measured antibodies for a pathogen on the same group of subjects measured at month 2 and month 7. Since antibody concentrations vary a lot from subject to subject, we decided to use Geometric Mean ...
4
votes
0answers
98 views

Forecasting with annual data that has a rolling quarter

I want to fit an ARIMA model for forecasting on a quarterly basis, but my data is a rolling year, updated quarterly, how can I use this most effectively? I'm really interested in the best estimate of ...
2
votes
0answers
165 views

Correcting estimate of covariance/correlation with overlapping/autocorrelated data

I'm wondering how to correct for the presence of autocorrelation/heteroscedasticity in estimating sample covariance matrices from data. I know there have been some questions on this before: ...
0
votes
1answer
101 views

how to merge multiple overlapping datasets with different units of measurement

I have many overlapping datasets of molecules and their respective binding affinities to a receptor structure. Each dataset comes from a different experimental assay and conditions, therefore the ...
0
votes
0answers
44 views

Intersection of significant differences

My data are signals in which each data point represents a pair of time point and location on the brain. I have a categorical variable with three levels: conditions A, B, and C. I have run non-...
1
vote
1answer
532 views

What is the probability (area) of overlap of two normal distributions having EQUAL variance

Can you please provide a math formula or an Excel example (math operations and Excel functions jointly used) to compute the probability (area) of overlap of two normal distributions having EQUAL ...
0
votes
0answers
133 views

Overlapping data and QQ plot

Problem Have a time series of data and want to look at changes over long periods so want to use overlapping changes, then want to compare these overlapping changes to overlapping changes from a normal ...
1
vote
0answers
317 views

How to analyse multiple choice and overlapping questions in MCA?

I need to analyze a survey about entrepreneurship which has around 50 categorical variables. Therefore, after some univariate analysis, I want to apply Multiple Correspondence Analysis (MCA) in order ...
0
votes
2answers
354 views

Comparing overlap and matches in different datasets

My goal: a measure/test/score/etc. that can give me a numerical value for how similar two datasets are. Let's say I have two datasets, each with a differing number of datapoints, where each datapoint ...
2
votes
0answers
35 views

How to estimate treatment effect with overlapping treatments?

I've taken over a project with an overlapping treatment design and I'm wondering how to estimate the overall effect. The description: Our organization sends 4 separate promotional postcards to our ...
1
vote
0answers
31 views

calculate percent of sample in overlapping distributions

I'm looking at 80k samples representing results of a test after a fixed period of time. I think it looks like a combination of normal curves. I see a fair amount of documentation about combining ...
0
votes
0answers
37 views

Can the data from two resources be mixed?

There are several sources of temperature-dependent viscosity data, which goes as following: |:--------------------------------| | 273.15 | 320.5 | 330.25 | |---------------------------------| | 1....
2
votes
0answers
44 views

Resampling in R to see if percentage of pairwise sharing between lists is significant

I have three lists of strings: ListA, ListB and ListC. First 3 lines of ...
1
vote
0answers
546 views

How to compute the normalized overlap area between two curves [duplicate]

I am trying to calculate the overlap area (normalized by the total area) of two plots. The plots are from X Y datasets. I saw a lot of questions about getting the overlap area but from normal ...
2
votes
1answer
570 views

Defining overlapping periods

I have a dataset containing the abundance of migrating bird species. In the figure below you can see that there are two "bell" shapes that are overlapping somewhere around September. One of the bell ...
1
vote
0answers
552 views

Overlapping clustering

It looks like "overlapping clustering" scheme where objects may belong to more than one cluster will fit my data. I've found some literature about this subject, but i'l be glad if anyone can point me ...
1
vote
0answers
113 views

Compare scores calculated for two groups who overlap?

I have three groups of ten children (A, B and C). They are each have different treatments (the treatments are to do with how they are taught about a certain biological feature). Two scores are ...
0
votes
1answer
532 views

Classification on Imbalanced and Overlapping Data

I am currently working on a project that not only is imbalanced but has a lot of overlap between the data points from the two classes. I am not quite sure how to go about solving this problem. What ...
5
votes
1answer
62 views

Misguiding data relationship between Y and X?

Background: I am currently surveying a number of articles related to subject of urban sprawl. One of the things that I have come across multiple times in the literature (a thing which seems to bother ...
0
votes
0answers
52 views

Comparing whether the aggregated measures significantly differ between overlapping samples

Let's say that I have some marketing data split between brands: 80% of respondents use brand a 60% of respondents use brand b This data is derived from surveys in which respondents answer questions ...
1
vote
1answer
296 views

Do I have endogeneity problem if I use overlapping observations in AR(1) model?

My dependent variable is $y_t=\frac{data_t}{data_{t-4}}-1$ with quarterly data and the model is standard AR(1): $$ y_t=\alpha_1 y_{t-1}+\beta x_t+\varepsilon_t. $$ I was told that due to ...
0
votes
0answers
455 views

Overlapping linear regressions

I have observations x,y. I am trying to learn a linear model for y against x. The local slope of the relationship maybe a function of y itself, and the nature of that relationship isn't clear. To ...
6
votes
2answers
624 views

Covariance estimation of overlapping time series

I have two series $x_t,z_t$, and compute the differences like $\Delta_h x_t=x_t-x_{t-h}$. What is a good estimator of the covariance of changes? $$Cov[\Delta_h x_t,\Delta_h z_t]$$ The intervals are ...
6
votes
0answers
331 views

Empirical distribution function of overlapping time series data

If we model asset return volatility for periods of more than one (say more than one day) there is the square-root rule which holds true under some assumptions. On the other hand practitioners ...
2
votes
0answers
935 views

Correlation and coefficient with overlapping data

I have a time series data, with 5-period rates sampled at 1 period intervals. Essentially $$r_i = x_{i+5} - x_i ; ~~ i=1,...,N-5$$ This creates an overlapping data problem for regression. As far ...
5
votes
0answers
72 views

Using overlapping data as if it was not

I am looking again at a popular statistical testing method used in finance, suspect it's a bit naughty, but would like to have a more experienced eye take a look also. The method is the following, ...