12
$\begingroup$

Problem: I am parameterizing distributions for use as a priors and data in a Bayesian meta-analysis. The data are provided in the literature as summary statistics, almost exclusively assumed to be normally distributed (although none of the variables can be < 0, some are ratios, some are mass, and etc.).

I have come across two cases for which I have no solution. Sometimes the parameter of interest is the inverse of the data or the ratio of two variables.

Examples:

  1. the ratio of two normally distributed variables:
    • data: mean and sd for percent nitrogen and percent carbon
    • parameter: ratio of carbon to nitrogen.
  2. the inverse of a normally distributed variable:
    • data: mass/area
    • parameter: area/mass

My current approach is to use simulation:

e.g. for a set of percent carbon and nitrogen data with means: xbar.n,c, variance: se.n,c, and sample size: n.n, n.c:

set.seed(1)
per.c <- rnorm(100000, xbar.c, se.c*n.c) # percent C
per.n <- rnorm(100000, xbar.n, se.n*n.n) # percent N

I want to parameterize ratio.cn = perc.c/perc.n

# parameter of interest
ratio.cn <- perc.c / perc.n

Then choose the best fit distributions with range $0 \rightarrow \infty$ for my prior

library(MASS)
dist.fig <- list()
for(dist.i in c('gamma', 'lognormal', 'weibull')) {
    dist.fit[[dist.i]] <- fitdist(ratio.cn, dist.i)
}

Question: Is this a valid approach? Are there other / better approaches?

Thanks in advance!

Update: the Cauchy distribution, which is defined as the ratio of two normals with $\mu=0$, has limited utility since I would like to estimate variance. Perhaps I could calculate the variance of a simulation of n draws from a Cauchy?

I did find the following closed-form approximations but I haven't tested to see if they give the same results... Hayya et al, 1975 $$\hat{\mu}_{y:x} = \mu_y/mu_x + \sigma^2_x * \mu_y / \mu_x^3 + cov(x,y) * \sigma^2_x * \sigma^2_y / \mu_x^2$$ $$\hat{\sigma}^2_{y:x} = \sigma^2_x\times\mu_y / mu_x^4 + \sigma^2_y / mu_x^2 - 2 * cov(x,y) * \sigma^2_x * \sigma^2_y / mu_x^3$$

Hayya, J. and Armstrong, D. and Gressis, N., 1975. A note on the ratio of two normally distributed variables. Management Science 21: 1338--1341

$\endgroup$
4
  • $\begingroup$ should I post the Update question about calculating the variance on random draws from the Cauchy as a separate question? $\endgroup$ Commented Oct 15, 2010 at 17:39
  • $\begingroup$ david - since your variables are all positive, why do you want to fuss with $\mu = 0$? btw - in your simulation, you seem to be generating variables per.c and per.n that are independent. is that correct - and if so, is that what you want? $\endgroup$
    – ronaf
    Commented Oct 18, 2010 at 2:25
  • $\begingroup$ no, I don't want to fuss with $\mu$ = 0; these variables are generally treated as independent, and covariance data is rarely available. Since C is fairly constant, independence is a reasonable assumption. $\endgroup$ Commented Oct 18, 2010 at 16:47
  • $\begingroup$ I don't understand why the expectation of the ratio doesn't exist. If $ X $ and $ Y $ are jointly normally distributed with mean different than zero, then the mean of $ Z = \frac{X}{Y} $ is given by $ \int \int \frac{x}{y} p \left( x, y \right) dx dy $, what am I missing? $\endgroup$
    – Royi
    Commented Apr 13, 2015 at 18:39

2 Answers 2

6
$\begingroup$

You might want to look at some of the references under the Wikipedia article on Ratio Distribution. It's possible you'll find better approximations or distributions to use. Otherwise, your approach seems sound.

Update I think a better reference might be:

See formulas 2-4 on page 195.

Update 2

On your updated question regarding variance from a Cauchy -- as John Cook pointed out in the comments, the variance doesn't exist. So, taking a sample variance simply won't work as an "estimator". In fact, you'll find that your sample variance does not converge at all and fluctuates wildly as you keep taking samples.

$\endgroup$
5
  • $\begingroup$ Thanks for the reference, that is where I found the Haaya 1975 reference and the equations in my question, although I'd appreciate reassurance that the equations are appropriate for my problem. $\endgroup$ Commented Oct 15, 2010 at 17:43
  • $\begingroup$ Taking a quick look at Haaya, it seems that they're concerned with obtaining a Normal approximation for the ratio and use simulations to determine when that applies (using the coefficient of variation, cv). Does the cv in your case meet the criteria? If so, the approximations apply. $\endgroup$
    – ars
    Commented Oct 15, 2010 at 17:58
  • 1
    $\begingroup$ @David: use Marsaglia 1965 instead as updated in the answer. $\endgroup$
    – ars
    Commented Oct 15, 2010 at 19:18
  • $\begingroup$ NB: Marsaglia published an update in JSS in 2004. $\endgroup$ Commented Feb 11, 2013 at 19:43
  • $\begingroup$ I don't understand why the expectation of the ratio doesn't exist. If $ X $ and $ Y $ are jointly normally distributed with mean different than zero, then the mean of $ Z = \frac{X}{Y} $ is given by $ \int \int \frac{x}{y} p \left( x, y \right) dx dy $, what am I missing? $\endgroup$
    – Royi
    Commented Apr 13, 2015 at 18:41
0
$\begingroup$

Could you not assume that $y^{-1} \sim N(.,.)$ for the inverse of a normal random variable and do the necessary bayesian computation after identifying the appropriate parameters for the normal distribution.

My suggestion below to use the Cauchy does not work as pointed out in the comments by ars and John.

The ratio of two normally random variables follows the Cauchy distribution. You may want to use this idea to identify the parameters of the cauchy that most closely fits the data you have.

$\endgroup$
16
  • $\begingroup$ a. I need to estimate the variance and the variance of the Cauchy distribution is not defined. $\endgroup$ Commented Oct 15, 2010 at 17:26
  • $\begingroup$ b. If I understand your second point, yes, I could assume that y-1 ~ N(mu, sigma), but I still need to calculate mu and sigma from the summary statistics given for y; also, I've chosen not to consider distributions with values < 0 for variables only defined > 0 (even though in many of the cases p(X<0 | X~N(mu,s)) -> 0 ) $\endgroup$ Commented Oct 15, 2010 at 17:32
  • $\begingroup$ Doesn't the Cauchy apply for zero mean normals? $\endgroup$
    – ars
    Commented Oct 15, 2010 at 17:57
  • $\begingroup$ @ars You are correct. The cauchy then may be of limited use. $\endgroup$
    – user28
    Commented Oct 15, 2010 at 18:15
  • $\begingroup$ Ars: Yes, I believe the Cauchy result requires zero means. But that still means that at least in that special case, the variance that David is trying to estimate DOES NOT EXIST. $\endgroup$ Commented Oct 15, 2010 at 18:15

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.