I want to estimate the mean of a function f, i.e. $$E_{X,Y}[f(X,Y)]$$ where $X$ and $Y$ are independent random variables. I have samples of f but not iid: There are iid samples for $Y_1,Y_2,\dots Y_n$ and for each $Y_i$ there are $n_i$ samples from $X$: $X_{i,1},X_{i,2},\dots, X_{i,n_i}$
So in total I have samples $f(X_{1,1},Y_1) \dots f(X_{1,n_1},Y_1 ) \dots f(X_{i,j},Y_i) \dots f(X_{n,n_n},Y_n)$
To estimate the mean I compute $$\mu=\sum_{i=1}^n 1/n * \sum_{j=1}^{n_i}\frac{ f(X_{i,j},Y_i)}{n_i}$$ Obviously $$E_{X,Y}[\mu]=E_{X,Y}[f(X,Y)]$$ so $\mu$ is an unbiased estimator. I am wondering now what $Var(\mu)$, i.e. the variance of the estimator is.
Edit 2: Is this the correct variance? $$Var(\mu)=\frac{Var_Y(\mu_i)}{n}+\sum_{i=1}^n \frac{Var_X(f(X,Y_i)))}{n_i*n^2}$$ It seems to work in the limit, i.e. if n=1 and all $n_i=\infty$ the variance just becomes the variance of the means. And if $n_i=1$ the formula becomes the standard formula for the variance of estimators. Is this correct? How can I proof that it is?
Edit (Ignore this):
So I think I made some progress: Let us first define $\mu_i=\sum_{j=1}^{n_i}\frac{ f(X_{i,j},Y_i)}{n_i}$ which is an unbiased estimator of $E_X[f(X,Y_i)]$.
Using the standard formula for variance we can write:
$$Var(\mu)=1/n^2 \sum_{l=1}^n \sum_{k=1}^n Cov(\mu_l,\mu_k)$$ This can be simplified to $$1/n^2( \sum_{i=1}^n Var(\mu_l)+ 1/n^2\sum_{l=1}^n \sum_{k=l+1}^n 2*Cov(\mu_l,\mu_k))$$ and because the $X_{ij}$s are drawn independently we can further simplify this to $$1/n^2( \sum_{i=1}^n 1/n_i Var(f(X_{i,j},Y_i))+1/n^2 \sum_{l=1}^n \sum_{k=l+1}^n 2*Cov(\mu_l,\mu_k))$$ And for the covariance: \begin{align} Cov(\mu_l,\mu_k)&=Cov(\sum_{j=1}^{n_l} \frac{f(X_{j,l},Y_l)}{n_{l}},\sum_{j=1}^{n_k} \frac{f(X_{j,k},Y_k)}{n_{k}})\\ &=\frac{1}{(n_k*n_l)}*Cov(\sum_{j=1}^{n_l} f(X_{j,l},Y_l),\sum_{j=1}^{n_k} f(X_{j,k},Y_k))\\ &=\frac{1}{(n_k*n_l)}*\sum_{j=1}^{n_l}\sum_{j=1}^{n_k}Cov( f(X,Y_l), f(X,Y_k))\\ &=\frac{n_k*n_l}{(n_k*n_l)}Cov( f(X_{i,l},Y_l), f(X_{i,k},Y_k))\\ &=Cov( f(X,Y_l), f(X,Y_k)) \end{align} So plugging this back in we get $$1/n^2( \sum_{i=1}^n 1/n_i Var(f(X,Y_i))+1/n^2 \sum_{l=1}^n \sum_{k=l+1}^n 2*Cov(f(X,Y_l),f(X,Y_k)))$$ I have multiple questions now:
Is the calculation above correct?
How can I estimate $Cov(f(X,Y_l),f(X,Y_k)))$ from the samples given?
Does the variance converge to 0 if I let n go to infinity?