Questions tagged [correlation]
A measure of the degree of linear association among a pair of variables.
5,921
questions
0
votes
0
answers
5
views
How do I correlate the increase in value of two seperate scales?
I am using two scales on a same set of population 3 times over the course of treatment, one of the tools/scales is HAM D (with values that are non continuous ie 1,2,3) and the other is Eortc h&n ...
- 1
0
votes
0
answers
3
views
interpreting correlation between a target varialbe and Fouriers coefficients
my dataset is composed by a set of time series, and a target variable.
So to analize the correlations between the time series and the target variable, i am extracting features from the time series, ...
- 1
0
votes
2
answers
13
views
Constraining correlations between two latent variables using CFA
I am running a model using CFA (laavan package) in R. Three-factor model fits the data well (for both female and male groups), the correlation between latent variables are different though, I'd like ...
- 1
0
votes
0
answers
6
views
Attrition bias with online text data (causality)
I have a dataset of online Reddit posts for unemployed individuals in two neighboring U.S. states, where unemployed workers in a given state received higher unemployment insurance UI benefits than the ...
- 63
1
vote
2
answers
38
views
Simulate correlated Bernoulli variables where the sample distribution is exactly the same as the population distribution [duplicate]
Is there a way to generate two correlated variables with a Bernoulli distribution where the sample distribution is exactly the same as the population distribution?
I can easily generate a pair of ...
- 33
0
votes
0
answers
18
views
Estimating of PD based on another model
my problem might not be easily solvable, but I am looking for some advices/ ideas as well.
I have few bank segments(Corporate, SME, Retail) in which I estimate the probability of default based on some ...
0
votes
0
answers
16
views
Joint distribution of X and Y given both of X and Y are random variables from normal distribution, but X and Y are correlated with ${\rho}$ [closed]
The difference between being two independent random variables and being uncorrelated?
- 111
1
vote
1
answer
32
views
Pearson and non-zero correlation
I have data from a genetic experiment, where we have two lenght measurements from each subject (one for each chromosome). In normal conditions I would expect both variables to be normally distributed ...
- 11
0
votes
0
answers
5
views
Influence of within-set pair-wise correlations to CCA (canonical correlation analysis)?
I am trying to understand the importance of observed within-set pair-wise correlations, to canonical correlation analysis (CCA).
Let's say my Y set is 'health'. Y is made up of two types of variables ...
- 1
1
vote
0
answers
15
views
How to generate two matrices with given (constrained to) column-wise and row-wise correlations in R? [closed]
I would like to generate two matrices X and Y, of the same dimensions (n x ...
- 11
0
votes
0
answers
11
views
Use covariate from original article in correlational meta-analysis?
I am conducting a correlational meta-analysis with r as the data. I've found lots of articles that aren't looking at my association of interest primarily (let's say X and Y), but include one or both ...
- 1
0
votes
1
answer
42
views
How to deal with high skewness and kurtosis
I have two dependent variables (soccer dataset) that I'm interested in. They have the following skewness and kurtosis:
Variable A: % of minutes played --> Skewness: 0.145 | Kurtosis: -1.03
...
- 21
2
votes
1
answer
17
views
Simple Linear Regression Question: How does correlation between X and Y affect MSE?
Suppose we know that the correlation between $X_1$ and $Y$ is $\rho_{X_1Y}$ and the correlation between $X_2$ and $Y$ is $\rho_{X_2Y}$. Furthermore, suppose $0 < \rho_{X_2Y} < \rho_{X_1Y}$. Now, ...
- 105
2
votes
1
answer
61
views
The PDF of the random variable Z=Y+Y*X
I have two independent random variables, $Y$ and $X,$ where
$Y$ is a random variable with a Gaussian distribution and a zero mean.
$X$ is a random variable with a Gaussian distribution and a zero ...
- 21
1
vote
0
answers
38
views
Correlation bounds on transformations of two random variables
Suppose I have 3 real-valued random variables, $X, Y, Z$ and their pairwise correlations, $\rho_{XY}, \rho_{YZ}, \rho_{XZ}$, and I am tasked with finding a 2d function $f$ such that $f(X,Y)$ has ...
0
votes
0
answers
36
views
How do i explain the difference of correlation between mean income and total income?
I am doing a report on the complaints made to the municipality by the people of an italian city. I'm doing the part of the analysis where I try to understand where people complain the most.
The ...
- 15
0
votes
0
answers
7
views
Cross-correlation of cumulative sum of cross-correlated random variables
Let's say we have two random variables a and b, which are correlated. Will their cumulative sums (A and B) be correlated too? I find it logical that corr(A,B) = corr(a,b). I am bit rusty in my ...
- 1
0
votes
0
answers
13
views
Sequence of statistical tests when analysing [closed]
When doing statistical testing analyses, which test is best to start with i.e., Normality then Correlation then Reliability then Factor analysis then Descriptives then hypotheses testing or the ...
0
votes
0
answers
7
views
Why is data whitening (decorrelation) not tried with a post multiplication of a whitening matrix?
The general procedure of whitening(decorrelating) a data $X$ with dimensions $(D, n)$ (n being the number of samples) rests upon finding a matrix $W$ with dimensions $(D, D)$ such that the transformed ...
- 1,905
0
votes
0
answers
10
views
How to get correlated output from multiple tensorflow probability distributions
I'm building a tensorflow probability model that will output multiple (2+) predictions where the outputs will be draws from learned probability distributions. It currently looks something like this:
<...
- 61
0
votes
0
answers
9
views
Kruskal-Wallis DV/IV relationship
I have conducted a Kruskal-Wallis test in a bid to determine the impact of a student survey's rotated component on attendance. The attendance is ranked with discrete values from 0 - 4, and the ...
0
votes
0
answers
41
views
+50
Spearman's partial correlation in R : ppcor or RVAideMemoire?
which is preferable for Spearman's ? RVAideMemoire::pcor.test() or ppcor::pcor.test() ?
I'm running a set of partial ...
- 471
0
votes
0
answers
38
views
How many "effective" observations from sliding window sampling?
I have data on the trajectory of a particle and am interested in the displacement of the particle in a given time period. In particular, I have information on how much a particle has moved in each ...
- 1
0
votes
0
answers
9
views
How to calculate correlation between two categorical variables in SPSS?
I have two types of variables. One is Gender (Male, Female) and the other is Satisfaction (1,2,3,4,5). Is it possible to calculate the correlation between these two variables? If so, what type of ...
- 43
1
vote
0
answers
16
views
Do covariates correlated with residuals in generalized linear models make estimates not consistent or other problems? [closed]
Do covariates correlated with residuals in generalized linear models make estimates not consistent or make other problems?
Economists raise an issue about endogenous variables in OLS and do some 2SLS ...
- 792
0
votes
0
answers
12
views
Comparing correlations between two variables across subgroups
I have the following experimental design. I elicit two continuous variables per subject, call them X and Y. Subjects are separated in four groups based on levels of a categorical variable, call it Z. ...
0
votes
0
answers
5
views
Confirmatory Factor Analysis: Inter-correlation between latent variables vs. cor.test of these latent variables
I am quite inexperienced in the field of statistics and have the following problem. (I work with the statistical software R)
I have given students a knowledge test and would like to calculate ...
- 101
2
votes
1
answer
37
views
Best fit line of bivariate normal data passes through extrema of level sets
I am learning about the idea of correlation in statistics, and I came across the following
Statement: the best fit line of bivariate normal data passes through extrema of level sets. That is, if $(X,Y)...
7
votes
2
answers
517
views
What is the 'right' slope formula of a regression? deltas or Pearson?
this may be a silly question, but still:
I've been told that the slope formula equals the rise/run ratio, like this:
$$
m = \frac{rise}{run} = \frac{y_2 - y_1}{x_2 - x_1}
$$
in which rise equals ...
- 471
0
votes
0
answers
19
views
How to remove the correlation parameter for categorical variables with lmer
Dear CrossValidated community,
could anyone help me understand what the workaround is to remove the correlation term within a linear mixed effects model random effect structure that includes ...
1
vote
0
answers
13
views
What happens to the Correlation coefficient for a multilevel random intercept regression?
Suppose we have a two level random intercept regression model:
that is, for i = 1,...n, $$X_{i} \sim N(\mu_{xi}, \sigma_{xi}) $$ and $$Y_{i} \sim N(\mu_{yi}, \sigma_{yi}) $$ where $$\mu_{yi} = a_{i} +...
- 21
0
votes
0
answers
13
views
Non-parametric measures of covariance?
We have non-parametric measures like Spearman's correlation and Kendall's correlation in addition to Pearson's correlation. What about covariance?
I guess one can normalize the variables to have zero ...
- 1,487
0
votes
1
answer
27
views
Correlation between people in a study and the probability of survival
I have a somewhat strange assumption that I am trying to validate. I am probably not going to explain this very clearly because I don't have a really strong statistical background so please bear with ...
- 135
0
votes
0
answers
12
views
Which method is appropriate to measure correlation when data are not linear or monotonic?
I have 2 datasets. Now, I want to check the correlation between these 2 datasets. I have plotted datasets in a scatter plot and plotting shows that they do not follow linear or monotonic relationships....
- 111
1
vote
0
answers
84
views
Can we isolate the effect of two different control variables in a semi-partial correlation?
I know that we are able to use a partial correlation when we want to correlate X and Y but Z affects both of them and that we may use a semi-partial correlation when we want to correlate X and Y and ...
- 471
0
votes
1
answer
33
views
Yearly average correlation vs Monthly average correlation
Based on this question, I am seeing negligible correlation between temperature and precipitation. Since, the data points represent annual averages for 42 years, will it make sense to correlate the ...
- 101
0
votes
0
answers
24
views
How to statistically determine if two files have identical content?
I'm writing a duplicate file finder application, and I do not want to have to read every byte of every file to determine which files are duplicates.
Hard drive storage is segmented into clusters of X ...
- 101
2
votes
0
answers
56
views
Is circular correlation maximized by points laying on a square grid on the plane?
Background
Circular correlation is given by:
$$R_{\operatorname{circular}} \triangleq \frac{\sum_{i=1}^m \sin (x_i - \bar x) \sin (y_i - \bar y)}{\sqrt{\sum_{i=1}^m \sin (x_i - \bar x)^2} \sqrt{\sum_{...
- 5,132
0
votes
0
answers
9
views
Nonlinearly-Correlated Brownian motions across different times and representation with independent processes
This is a more wide-net question of https://mathoverflow.net/questions/430053/two-increasingly-correlated-brownian-motions-and-williams-decomposition.
I posted this in MO, but I thought perhaps stats-...
- 151
1
vote
1
answer
69
views
Converting Cohen's $d$ to Pearson's $r$ $\ne$ calculated Pearson's $r$
I was calculating effect sizes for an analysis and noticed by chance that Pearson's $r$ calculated from Cohen's $d$ with a conversion formula is not the same as when I calculate the correlation given ...
- 35
0
votes
2
answers
62
views
How do I calculate the weighted variance, $\sigma^2$, of a set of $N$ random variables considering their correlation $\rho$? [duplicate]
In a finance textbook of mine, there is an equation for calculating the variance $\sigma^2$ of a portfolio of two risky assets (i.e. random variables) $X$ and $Y$ by considering the correlation $\rho$ ...
0
votes
0
answers
8
views
How to compare granger causality with 2 stationary time series of different sizes?
I want to compare 2 time series using granger causality. I found that one time series is stationary by itself without any transformations. But another time series requires differencing to make it ...
0
votes
0
answers
16
views
Generate a random variable with a defined correlation to an existing variable(s) considering copula
In this question it has been described how to generate a random variable with a defined correlation to an existing variable. My question is what happens if I want to have a specific pattern of ...
- 1
19
votes
7
answers
2k
views
Why is correlation only defined between two variables?
I am an MBA student is taking statistics courses.
Our statistics prof was teaching us about correlations in statistics. We learned about Pearson's Correlation of Coefficient which is defined as the ...
1
vote
0
answers
27
views
How to compute the variance for this process?
I have a sequences of random iid non-correlated positive integers sampled from some (unknown) distribution $\boldsymbol X=[n_1,n_2,...,n_N]$.
From it, I built another sequence in the following way:
$$ ...
- 569
1
vote
1
answer
39
views
Meaning of "average correlation" in Var$(\bar X)$
From some process I got a series of values. I want to compute the variance of the mean from this series. The series is built with contiguous sub-series. In each sub-series the values are correlated. ...
- 569
0
votes
0
answers
8
views
Use Sensor Data to Improve Render Time Predictions
I have several computers networked together to render 3D animations faster (a local render farm). I wrote a program that logs various sensor information while the render node is running to help me ...
- 121
0
votes
0
answers
64
views
Scatter Plot Interpretation for Temperature and Precipitation
The precipitation data points don't make a straight line along the blue regression line and most of them are present between 24.25-25.25 °C (approximately).
What does this tell me about the ...
- 101
2
votes
0
answers
22
views
Improving Cronbach Alpha after removing highly correlated questions [closed]
I am currently conducing a cronbach alpha analysis on some questionnaire data and the cronbach scores are low. I have created a correlation matrix to see which items are highly correlated and which ...
- 21
2
votes
0
answers
28
views
What should the diagonal values be in a correlation matrix with Stuart–Kendall Tau-c?
I'm trying to calculate a correlation matrix for ordinal variables in R. Kendall rank correlation coefficient, seems a good option, as it "is a statistic used to measure the ordinal association ...
- 121