0
$\begingroup$

I have a vector $Y$ where I only know the mean $\overline \mu_Y$ but not the single data points.

How can I generate a vector $X$ so that $Cor(X,Y)$ is high (>0.5). Is that possible at all? What else would I have to know?

The formula for the sample Pearson correlation coefficient is:

$$ r_{xy} =\frac{\sum ^n _{i=1}(x_i - \bar{x})(y_i - \bar{y})}{\sqrt{\sum ^n _{i=1}(x_i - \bar{x})^2} \sqrt{\sum ^n _{i=1}(y_i - \bar{y})^2}} $$

$\endgroup$

closed as unclear what you're asking by Silverfish, Nick Cox, gung, Sven Hohenstein, conjugateprior Nov 6 '15 at 17:56

Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • $\begingroup$ Do you know anything more about X and Y ? $\endgroup$ – Tim Nov 6 '15 at 13:34
  • $\begingroup$ @Tim the vector X can be as I want, it is my goal to generate a vector X that is highly to correlated to Y where I only know the mean of Y. $\endgroup$ – spore234 Nov 6 '15 at 13:53
  • $\begingroup$ There are infinitely many solutions to problem defined like this. E.g. you can simply generate values from bivariate normal with all parameters set as any values besides one of the means... Also, "highly correlated" is very ambiguous (see example here stats.stackexchange.com/a/132538/35989). $\endgroup$ – Tim Nov 6 '15 at 13:59
  • $\begingroup$ @Tim thanks, I already assumed that this problem is infeasible $\endgroup$ – spore234 Nov 6 '15 at 14:01
  • $\begingroup$ Asking for a high covariance is unclear - what counts as "high"? Perhaps if you said you wanted to achieve a specified covariance, that would be clearer. I'm not sure why you jump from covariance in the second paragraph to correlation in the third. $\endgroup$ – Silverfish Nov 6 '15 at 14:22
1
$\begingroup$

Correlation is

$$ \rho_{X,Y} = {\sigma_{X,Y} \over \sigma_X \sigma_Y} $$

Your problem is that you dou don't know $\sigma_Y$, have only loose idea of desired $\rho_{X,Y}$ (> 0.5), don't know $\sigma_{X,Y}$ and allow $\sigma_X$ to be possibly any value, then there is infinitely many solutions for such problem. At the same time

I input a vector $X$ into a black box. This box knows $Y$ and spits out the correlation of $X$ and $Y$. What vector $X$ do I have to feed the box to get a high correlation.

what makes your problem hopeless since among infinite possible values only some are correct. Notice also that your question is contradictory, because you say

I don't know what is in $Y$ and I cannot use it to generate $X$.

and at the same time, you want to generate $X$ such that it is dependent on $Y$ (correlation measures dependence, or degree of association). Independently of $Y$ you want to generate $X$ that is dependent on it.

In this case possibly the only thing that you could do is to generate some totally random data and hope that by pure luck one of the samples will appear correlated with $Y$. To be more efficient, you could try to learn from output of your black box and somehow adapt (e.g. using some genetic algorithm) based on output (correlations returned by the black box).

$\endgroup$
-1
$\begingroup$

This should meet your criteria?

# R code
y.mu <- 32
y <- sort(rnorm(100, y.mu, sd=1))
x <- sort(rnorm(100, 30, sd=3))
cor(x, y, method='pearson')
# 0.9879412

Edit relative to comment.

y.mu <- 32
y <- rnorm(100, y.mu, sd=1)
x <- 3 * y + 22 + rnorm(100, 0, 1.7)
cor(x, y)
# 0.8685377

It is unclear why you would need two such vectors.

$\endgroup$
  • $\begingroup$ thanks, but the assumption that Y is ordered is pretty strong and not available in my case. $\endgroup$ – spore234 Nov 6 '15 at 14:17
  • $\begingroup$ I don't know what is in Y and I cannot use it to generate X. I just know its mean y_mu $\endgroup$ – spore234 Nov 6 '15 at 14:30
  • $\begingroup$ @spore234 if you don't know what is Y than you simply cannot generate even the values of Y, not talking about X correlated with it! $\endgroup$ – Tim Nov 6 '15 at 14:37
  • $\begingroup$ As @Tim indicated, there are an infinite number of solutions to your problem they way it is specified. Using is y to generate x is a sufficient but not necessary condition. y <- 3 * 1:100 + 22 + rnorm(100, 0, 1) x <- 3 * 1:100 + 22 + rnorm(100, 0, 1) y.mu <- 32 y <- y - (mean(y) - y.mu) mean(y) # 32 cor(x, y, method='pearson') $\endgroup$ – ui_90jax Nov 6 '15 at 14:44
  • $\begingroup$ @Tim The situation is as follows: I know y_mu. I input a vector X into a black box. This box knows Y and spits out the correlation of X and Y. What vector X do I have to feed the box to get a high correlation. $\endgroup$ – spore234 Nov 6 '15 at 14:48

Not the answer you're looking for? Browse other questions tagged or ask your own question.