Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [overlapping-data]

The tag has no usage guidance.

0
votes
0answers
19 views

Overlap of Two Probability Distributions in Python

So I saw someone use this code to find out how much overlap two normal distributions have. ...
0
votes
0answers
15 views

Simultaneous regressions for several overlapping time series

I have tried my best to keep this simple, because I am no stat buff, and I'm just trying to assess whether our choice of regression is ok. We've gathered time series data on daily small cap returns ...
0
votes
1answer
23 views

Cross checking AI Selections vs Random Chance

Fifty Three Images AI Selects 20 images based on various criteria. I Select 20 images based on personal criteria. In a two group selection of all 53 items what is the likely overlap due to random ...
0
votes
1answer
54 views

Survival Analysis on recurrent behavior time series predictor

We are trying to build a credit model to predict the default time (or finally closed the loans as censored). The predictor is a high-dimension time series of current observed previous payment behavior....
3
votes
0answers
38 views

Spatial regression with overlapping areas

Is it statistically correct to calculate a regression with overlapping areas? I have market areas as the spatial unit with different sociodemographic and (macro)economic variables and I´m examining ...
1
vote
0answers
29 views

(Another) What Statistical Test Should I Use?

If I ask 600 different people to rate 3 different images from 0-10 (i.e 3 samples of 200 people per image) and I calculate the mean scores per image as well as the overall mean for all 3 images, can I ...
1
vote
0answers
23 views

Probability of Finding Two Matching Subsequences in a Sequence

I'm currently studying DNA sequencing and am trying to find a formula which gives the probability that a subsequence of length $k$ appears twice in a sequence of $L$ bases (characters); this is pretty ...
0
votes
0answers
32 views

How to analyze combined data from studies with overlap in subjects?

I have data from multiple placebo-controlled cross-over trials (each with $n \simeq 20$) with unique phenotypes measured during the placebo phase. I'd like to combine the data from these measurements ...
4
votes
2answers
90 views

The minimum number of classes in the case of overlapping classes

I've a set of elements that should be grouped in the minimum number of groups, each element belongs to overlapping classes, for eg: a belongs to the classes x , y , z; b belongs to the classes x , y; ...
2
votes
2answers
141 views

95% CI for GMC did not overlap but paired Wilcoxon signed rank test gave a p-value > 0.05

I measured antibodies for a pathogen on the same group of subjects measured at month 2 and month 7. Since antibody concentrations vary a lot from subject to subject, we decided to use Geometric Mean ...
3
votes
0answers
82 views

Forecasting with annual data that has a rolling quarter

I want to fit an ARIMA model for forecasting on a quarterly basis, but my data is a rolling year, updated quarterly, how can I use this most effectively? I'm really interested in the best estimate of ...
2
votes
0answers
123 views

Correcting estimate of covariance/correlation with overlapping/autocorrelated data

I'm wondering how to correct for the presence of autocorrelation/heteroscedasticity in estimating sample covariance matrices from data. I know there have been some questions on this before: ...
0
votes
1answer
90 views

how to merge multiple overlapping datasets with different units of measurement

I have many overlapping datasets of molecules and their respective binding affinities to a receptor structure. Each dataset comes from a different experimental assay and conditions, therefore the ...
0
votes
0answers
44 views

Intersection of significant differences

My data are signals in which each data point represents a pair of time point and location on the brain. I have a categorical variable with three levels: conditions A, B, and C. I have run non-...
1
vote
1answer
450 views

What is the probability (area) of overlap of two normal distributions having EQUAL variance

Can you please provide a math formula or an Excel example (math operations and Excel functions jointly used) to compute the probability (area) of overlap of two normal distributions having EQUAL ...
0
votes
0answers
119 views

Overlapping data and QQ plot

Problem Have a time series of data and want to look at changes over long periods so want to use overlapping changes, then want to compare these overlapping changes to overlapping changes from a normal ...
0
votes
0answers
43 views

Appropriate test for two overlapping samples

I have two potential routes for molecules to be transported from one cell to another. Some molecules travel via both routes. I have information on which molecules are consumed by the receiving cell (...
1
vote
0answers
283 views

How to analyse multiple choice and overlapping questions in MCA?

I need to analyze a survey about entrepreneurship which has around 50 categorical variables. Therefore, after some univariate analysis, I want to apply Multiple Correspondence Analysis (MCA) in order ...
0
votes
2answers
308 views

Comparing overlap and matches in different datasets

My goal: a measure/test/score/etc. that can give me a numerical value for how similar two datasets are. Let's say I have two datasets, each with a differing number of datapoints, where each datapoint ...
3
votes
0answers
34 views

How to estimate treatment effect with overlapping treatments?

I've taken over a project with an overlapping treatment design and I'm wondering how to estimate the overall effect. The description: Our organization sends 4 separate promotional postcards to our ...
1
vote
0answers
31 views

calculate percent of sample in overlapping distributions

I'm looking at 80k samples representing results of a test after a fixed period of time. I think it looks like a combination of normal curves. I see a fair amount of documentation about combining ...
0
votes
0answers
37 views

Can the data from two resources be mixed?

There are several sources of temperature-dependent viscosity data, which goes as following: |:--------------------------------| | 273.15 | 320.5 | 330.25 | |---------------------------------| | 1....
-1
votes
0answers
50 views

Data points with time intervals - how to analyse?

I have chemistry data of rocks, with assigned age intervals.My problem is how to deal with this singular data point specified over different time intervals (95% confidence intervals). e.g.: Data1: ...
2
votes
0answers
43 views

Resampling in R to see if percentage of pairwise sharing between lists is significant

I have three lists of strings: ListA, ListB and ListC. First 3 lines of ...
1
vote
0answers
544 views

How to compute the normalized overlap area between two curves [duplicate]

I am trying to calculate the overlap area (normalized by the total area) of two plots. The plots are from X Y datasets. I saw a lot of questions about getting the overlap area but from normal ...
2
votes
1answer
536 views

Defining overlapping periods

I have a dataset containing the abundance of migrating bird species. In the figure below you can see that there are two "bell" shapes that are overlapping somewhere around September. One of the bell ...
1
vote
0answers
481 views

Overlapping clustering

It looks like "overlapping clustering" scheme where objects may belong to more than one cluster will fit my data. I've found some literature about this subject, but i'l be glad if anyone can point me ...
1
vote
0answers
100 views

Compare scores calculated for two groups who overlap?

I have three groups of ten children (A, B and C). They are each have different treatments (the treatments are to do with how they are taught about a certain biological feature). Two scores are ...
0
votes
1answer
506 views

Classification on Imbalanced and Overlapping Data

I am currently working on a project that not only is imbalanced but has a lot of overlap between the data points from the two classes. I am not quite sure how to go about solving this problem. What ...
5
votes
1answer
62 views

Misguiding data relationship between Y and X?

Background: I am currently surveying a number of articles related to subject of urban sprawl. One of the things that I have come across multiple times in the literature (a thing which seems to bother ...
0
votes
0answers
46 views

Comparing whether the aggregated measures significantly differ between overlapping samples

Let's say that I have some marketing data split between brands: 80% of respondents use brand a 60% of respondents use brand b This data is derived from surveys in which respondents answer questions ...
1
vote
1answer
260 views

Do I have endogeneity problem if I use overlapping observations in AR(1) model?

My dependent variable is $y_t=\frac{data_t}{data_{t-4}}-1$ with quarterly data and the model is standard AR(1): $$ y_t=\alpha_1 y_{t-1}+\beta x_t+\varepsilon_t. $$ I was told that due to ...
0
votes
0answers
422 views

Overlapping linear regressions

I have observations x,y. I am trying to learn a linear model for y against x. The local slope of the relationship maybe a function of y itself, and the nature of that relationship isn't clear. To ...
6
votes
2answers
586 views

Covariance estimation of overlapping time series

I have two series $x_t,z_t$, and compute the differences like $\Delta_h x_t=x_t-x_{t-h}$. What is a good estimator of the covariance of changes? $$Cov[\Delta_h x_t,\Delta_h z_t]$$ The intervals are ...
6
votes
0answers
316 views

Empirical distribution function of overlapping time series data

If we model asset return volatility for periods of more than one (say more than one day) there is the square-root rule which holds true under some assumptions. On the other hand practitioners ...
2
votes
0answers
857 views

Correlation and coefficient with overlapping data

I have a time series data, with 5-period rates sampled at 1 period intervals. Essentially $$r_i = x_{i+5} - x_i ; ~~ i=1,...,N-5$$ This creates an overlapping data problem for regression. As far ...
5
votes
0answers
67 views

Using overlapping data as if it was not

I am looking again at a popular statistical testing method used in finance, suspect it's a bit naughty, but would like to have a more experienced eye take a look also. The method is the following, ...