Is there a article/textbook that treats probability distributions on functions just like basic textbooks cover the classical distributions for scalar variables?

Suppose the random function $f$ has a gaussian process distribution with some mean function $m$ and covariance function $w$. I know how to generate random (functional) deviates from that distribution.

What I'd like to know, for example, is given another function $g$ (that can be evaluated at an arbitrary number of points over the same range than where $f$ is defined), what is the probability that $g$ or a more extreme function was drawn from $f$'s distribution. There must be a way to define a cumulative distribution function and a probability density function for functions!

Since you can only observe function $g$ at finite number of points $x_1,...,x_n$, then your problem is identical to testing whether the observed vector comes from particular multivariate distribution with given mean and covariance matrix. So if $g(x)=(g(x_1),...,g(x_n))$ comes from multivariate distribution with mean $\mu$ and covariance matrix $\Sigma$ we get
$$(g(x)-\mu)'\Sigma^{-1}(g(x)-\mu)\sim\chi^2_n.$$
• I meant finite-dimensional distributions. I wrote quickly, sorry for the mistake. As for your second comment, you describe different problem from the one posted in your question. If you have infinite number of observables, then naturally there are more options, but still the end result will be your $g$ plugged in some functional of the process. – mpiktas Dec 13 '11 at 16:55