Skip to main content

Questions tagged [pearson-r]

The Pearson product-moment correlation coefficient is a measure of the linear relationship between two variables $X$ and $Y$, giving a value between +1 and −1.

Filter by
Sorted by
Tagged with
0 votes
0 answers
26 views

Which correlation test to use

I'm working with datasets on economic inequality and crime rates at the county level to produce correlation matrices. My economic inequality data has several variables, which are percentage of county ...
Steven Morrison's user avatar
1 vote
0 answers
22 views

Interpretation of ICC and Pearson's r correlation

I am calculating intraclass correlation coefficient (ICC) values for response values at two different timepoints. I am also correlating the response values at the different timepoints using Pearson's $...
Lee's user avatar
  • 11
0 votes
0 answers
17 views

Should one account for the known variance of fixed X when estimating its relationship with random Y?

In Aldrich (2005), and specifically in sections 10 and 11, the author describes the sufficient statistic for the parameter $\beta$ in the simple regression of random $Y$ on fixed $X$, with a bivariate ...
virtuolie's user avatar
  • 642
3 votes
0 answers
42 views

What is the minimum Pearson sample correlation given a perfect sample rank correlation with no ties? [duplicate]

Let $(X, Y)$ be a random sample of finite size $n$ from a bivariate continuous distribution with unknown parameters $(\rho_{XY},\mu_X,\mu_Y,\sigma_X,\sigma_Y)$. Assume observed values are real numbers ...
virtuolie's user avatar
  • 642
1 vote
0 answers
16 views

Correlation of Group of Questions in Likert Scale answers

let's say that we have a response survey data frame with 6 columns.Each column is a question.Q1,Q2,Q3,...,Q6. The responses are from 1 to 5. 1 is translated to Very Bad,4 to Bad,3 to neutral,2 to good,...
Homer Jay Simpson's user avatar
3 votes
2 answers
160 views

Test for multicollinearity with binary and continuous independent variables

I have a question concerning multicollinearity: I have several independent variables. Some are binary and some continuous. The dependent variable is binary. Can I use the Pearson correlations to test ...
Lou's user avatar
  • 31
4 votes
1 answer
40 views

How does knowing the sign of the population correlation affect the sufficiency of its statistic?

As noted here, the sufficient statistic for the correlation under bivariate normality is Pearson's $r$, the maximum likelihood estimate of $\rho$. I suppose, however, this does not guarantee that $r$ ...
virtuolie's user avatar
  • 642
0 votes
0 answers
13 views

Why can't fit I fit a multivariate regression (OPLS) model when my variables are univariately (Pearson/Spearman) correlated?

I have a dataset of 950 lipids (X) and want to see if any are correlated with cognitive function (Y). When I try to fit an opls regression model, it errors and says that "No model was built ...
mkadz's user avatar
  • 51
1 vote
0 answers
63 views

Normality of $z$ transformation without preliminary assumption

Assuming data $X_1,...,X_n, Y_1,...,Y_n$ we have Pearson correlation $r=\frac{Cov(X,Y)}{\sigma_X\sigma_Y}$. Fisher's $z$ transform is then $$z=0.5\log\left(\frac{1+r}{1-r}\right)=\tanh^{-1}(r)$$ If $(...
Spätzle's user avatar
  • 4,032
1 vote
0 answers
25 views

Doing an independent study as a high schooler but can't seem to figure out the values that need to be used to get pearson's correlation coefficient

Here's the database, it's a rather small one: https://www.theadgalternative.com/world_cup_data.html I dont understand what my N, X, and Y values would be since nothing is really quantitative. I'm ...
anonymous1924's user avatar
3 votes
3 answers
335 views

Cronbach alpha - descriptive statistics

I researched thinking styles based on Sternberg's Investment Theory. I used a TSI questionnaire that measures preferences in thinking styles. The problem is that I got low scores of Cronbach's alpha ...
goldy's user avatar
  • 31
1 vote
0 answers
40 views

How to check linear independence of categorical features with a numerical target?

Suppose I am doing linear regression on a dataset. My dataset contains columns f1, f2 ,f3 ,f4 , f5 , target . Features (independent variables) are the column names starting with "f" and my ...
letdatado's user avatar
  • 367
0 votes
0 answers
18 views

Pearson correlation p-values plot which method better adjusted my p-values BH or BY? help me understand

I'm working on DEG dataset and I've done Pearson correlation to prepare my dataset for downstream analysis (co-expression network), so this isn't an exploration phase. When I do pearson on R using ...
Sief's user avatar
  • 1
7 votes
1 answer
444 views

What is a good journal for submitting my article on a conjecture in theoretical statistics, re: ancillary complement for correlation?

I'm working on a draft of a statistics article, and I'd like to plan for the journal where I'll ultimately submit. My problem is, the article topic is somewhat abstract—it's a conjecture in ...
5 votes
1 answer
174 views

What references discuss the problems with phi as an association measure?

(Olivier (2013) states that many have pointed out problems with $\phi$ as an association measure and advocate the use of odds ratios as an alternative Unfortunately, it does not give citations for ...
Mohan's user avatar
  • 939
0 votes
1 answer
58 views

Pearson & Spearman correlation coefficient in their extreme

I am working right now in R with correlation coefficients. I know that we can achieve approximately a Pearson coefficient r=0 and Spearman p=1, because Pearson is sensitive to outliers. However, I was ...
Made's user avatar
  • 121
2 votes
3 answers
409 views

When to use Pearson's test and when to use Spearman's test?

I want to do a correlation analysis on a dataset of 28 samples. I want to correlate the age with the size of a reflex response. But I don't understand whether I should use Pearson's or Spearman's test....
Oskar's user avatar
  • 21
3 votes
1 answer
30 views

Deducing from Ordinal to Binary Data

Assume I have two rank vectors $r^A, r^B$ of size $p$ - that is, each of them is some permutation of $1,...,p$. For the sake of simplicity, assume that $p$ is odd. Now, I take these vectors and recode ...
Spätzle's user avatar
  • 4,032
3 votes
3 answers
2k views

Pearson or Spearman? [duplicate]

After using the Shapiro-Wilk test for Bivariate Normality, I found different values of p. For the ones which were p<0.05 I used Spearman and the ones which were p>0.05 I used Pearson. Is it the ...
Rach's user avatar
  • 47
3 votes
0 answers
33 views

How do zero values affect the correlation between two twitter activity time series?

I have a time series of Twitter activities (lets call it time series 0) from which I extract two separate time series based on different sets of users (i.e. time series 1 contains the activity of a ...
Mim_Tauch's user avatar
0 votes
0 answers
56 views

Can I do Pearson cross-correlation between two time series of Twitter data without violating the assumptions?

I have a dataset of Tweets regarding a given topic (extracted by predefined keywords and hashtags). I aggregated the Tweets in bins of time (e.g. every ten minutes) to generate a time series of the ...
Mim_Tauch's user avatar
3 votes
3 answers
214 views

How to decorrelate $X$ and $X^3$?

We know that if $X$ is positive, then $X^2$ is highly positively correlated with $X$. I've plotted an array of integer numbers from 100 and 110 with the following code: ...
ricber's user avatar
  • 53
1 vote
0 answers
45 views

If X is positively correlated with Y and Y is positively correlated with Z, it is still possible for Z to be negatively correlated with X? [duplicate]

This is not assuming a perfect correlation between variables. I believe that the answer is yes as long as r<1.0. (r = Pearson product-moment correlation coefficient.) Bonus: if the question is ...
BigMistake's user avatar
1 vote
1 answer
56 views

What statistical test should I use for my dataset - Pearson's or Spearman's?

I'm not quite sure what statistical test I should be conducting for my dataset. I am aiming to find the correlation between two variables (concentration of copper vs concentration of chlorophyll). My ...
ducks's user avatar
  • 11
1 vote
0 answers
44 views

Yes or no: is Pearson’s r is a measure of goodness of fit to an affine function? [duplicate]

Is the statement "Pearson’s r is a measure of goodness of fit to an affine function" literally true? Why or why not?
BigMistake's user avatar
6 votes
3 answers
6k views

The meaning of the p-value for a correlation coefficient

Recently, I learnt that one can also calculate a p-value for the Pearson correlation coefficient. My question is not about computation of this p-value. (Based on what I read from other posts, we first ...
Tan Yong Boon's user avatar
1 vote
1 answer
26 views

Testing for correlation

I'm new to statistics. I'm solving a problem where I'm given three sets of data, the measured sizes of the population of rabbits, the drug dose that's been given to each of them and the method of ...
the_dude's user avatar
  • 193
0 votes
0 answers
33 views

Selection of covariates for partial correlation?

Are there any recommendations on procedures to identify relevant variables for a partial correlation between $r(X, Y)$? To me, it appears most reasonable to only include those $Z_1, Z_2,\ldots,Z_n$ as ...
a.henrietty's user avatar
0 votes
0 answers
11 views

correlation that is less sensitive to neighboring class changes

I am calculating the correlation between the scores a radiologist attributes to an MRI image (discrete 0,1,2,3), against the continuous quantification of disease (continuous between 0 and 1). I see a ...
lost_phd's user avatar
  • 101
1 vote
0 answers
46 views

Popcorn- what's the best way to compare the fit non-linear models for data that is not very complex?

I popped 7 bags of popcorn in 30 second increments and found the percentage of popped kernels in each time frame. I manipulated this data with sinusoidal, exponential, and cubic models. There is lots ...
robert's user avatar
  • 11
0 votes
1 answer
148 views

Can Pearson Correlation be Used Between Continuous and Dichotomous Variables for Feature Selection?

I'm working on a dataset that contains both continuous and dichotomous numerical features, the latter having values in the set $\{0, 1\}$. My objective is to apply feature selection to my dataset to ...
Connor's user avatar
  • 635
0 votes
0 answers
86 views

Measuring correlation at national level from state level data?

I have a dataset with 96 records in the following format: ...
user1355179's user avatar
0 votes
1 answer
675 views

Can I compare Pearson's r and Spearman's rho with Fisher's r to z transformation?

I'm using the tool in the following website to compare correlation coefficients: http://vassarstats.net/rdiff.html The tool uses Fisher's r to z transformation to ultimately compare two correlation ...
FastBallooningHead's user avatar
1 vote
0 answers
62 views

Different results of t test and biserial correlation?

I was wondering whether it is possible that a t test and a point biserial correlation can give different results (t-test shows groups differ significantly, correlation implies that variable does not ...
a.henrietty's user avatar
3 votes
2 answers
1k views

Why is the p-value of Pearson's correlation test large even when the sample size is sufficient?

I have two variables $Y1$ and $Y2$ and the sample size is $240$. I computed Pearson's correlation coefficient in python with pearsonr from scipy.stats. The following are my results: Correlation ...
fairy_bluebirb's user avatar
1 vote
0 answers
46 views

What would be the sample number if two variables have different number of samples?

While correlating two variables, which have different number of samples in each, how can I find the df? Eg. Sample-A has 35 observations, Sample-B has 22 observations, How to calculate df (N)-2? ...
Karnan's user avatar
  • 21
1 vote
1 answer
122 views

Why does there appear to be different types of Pearson's autocorrelation?

If you Google Images "auto-correlation", you will find many formulae of this form (from here):- I've implemented this and so with a sequence { 65, 66, 67, 68, 69, 70, 71, 72 }, $r_k = 0.625$...
Paul Uszak's user avatar
0 votes
2 answers
112 views

I have a moderate to high correlation and a p-value that is non-significant. Do I still reject the whole hypothesis?

I have a correlation of 0.777 but only a p-value of 0.069 (not significant) on my Pearson's test. My sample size was of 54. Should my hypothesis still be rejected even if there is a correlation? Is ...
broccolops's user avatar
0 votes
1 answer
126 views

Correlation between two datasets

I have two datasets having values : s1 = [25 ,75, 25, 75, 25, 75, 25, 75, 25, 75] and s2 = [46.24, 73.16, 27.13, 74.30, 25, 72.52, 53.15, 75, 40.15, 69.86] Pearson correlation coefficient = 0.90 and ...
Raj's user avatar
  • 33
1 vote
2 answers
75 views

What is this equation for?

$$t = \frac{r}{\sqrt{\frac{1-r^2}{n-2}}} \sim t_{n - 2}$$ with $$r = \frac{S_{xy}}{\sqrt{SC_{xx} SC_{yy}}}$$ I've just found this equation with no direct data to of what can I get from it, I couldn't ...
RodParedes's user avatar
4 votes
2 answers
727 views

How to calculate Pearson correlation coefficient of two 3-dimensional features?

The book I read, Applied Predictive Modeling Textbook, mentions: Even though, single features do not correlate with each other, sets of features can correlate with other sets of features. I have an ...
Mr. Panda's user avatar
  • 313
1 vote
1 answer
227 views

Question about deciding whether to use Pearson's and Spearman's correlation [duplicate]

Let's say I have two variables and I want to measure the association between them. I've been reading up on running Pearson's correlation vs. Spearman's. I understand that Pearson's measures linear ...
FastBallooningHead's user avatar
0 votes
0 answers
75 views

Questions about Pearson's correlation linearity assumption and Spearman's correlation assumption of monotonic relationship

I have a question about correlations. So let's say I have 9 variables: Y1, Y2, Y3, X1, X2, X3, X4, X5, and X6. All of the variables are measured on a ratio scale. Let's say I want to measure the ...
FastBallooningHead's user avatar
6 votes
2 answers
791 views

Question about running Spearman's correlation instead of Pearson's

I have a question about correlations. Let's say I want to measure the associations between a number of variables and all of them are measured on a ratio scale. I know I can use Pearson's $r$ ...
FastBallooningHead's user avatar
0 votes
0 answers
40 views

Question about correlations

Let’s say I want to measure the correlation between two variables, both measured on a ratio scale. Let’s say however that the relationship between the variables isn’t linear (so I can’t calculate ...
FastBallooningHead's user avatar
2 votes
0 answers
74 views

correlations for different variables and correlation matrix

I have a continuous target variable and 40 independent variables - some of them are ordinal, some are binary (Yes/No). When creating a correlation matrix I get correlations between: continuous and ...
Vicky's user avatar
  • 21
1 vote
1 answer
110 views

Lower correlation in sub-group than in main-group

Variable 1: Points in the NBA in Year 1; Variable 2: Points in the NBA in Year 2; Objective: Calculate the year-to-year correlation coefficient Let's say the correlation coefficient for the entire ...
Lasnik23's user avatar
1 vote
1 answer
65 views

Sign of pearson correlation with negative regression coefficient

I want to obtain the pearson correlation of "experienced disfluency" and "narrative engagement" from the attached unstandardized coefficients for my meta-analysis. The paper is ...
Jennifer Lau's user avatar
1 vote
1 answer
134 views

Cross-lagged Pearson correlation in R

I have a dataset where I have two recordings (sessions) of two different variables. ...
Inkling's user avatar
  • 299
1 vote
0 answers
369 views

How to [properly] correlate environmental variables to NMDS ordination axes?

Data + setup: I've constructed an NMDS ordination from a Bray-Curtis distance matrix calculated from relativized abundances (basal areas) of trees. Samples include ~40 forested plots that have been ...
theforestecologist's user avatar

1
2 3 4 5
11