Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

Has the idea of a maximum entropy probability distribution been explored for function spaces, and if so what are some key papers, books, or terms to look for?

For $\mathbb{R}^n$ (and discrete spaces), the problem appears to be well studied - one maximizes the quantity, $$-\int f(x) ~ log f(x) ~ dx,$$ over the set of feasible candidate densities $f$, where the integral is taken with respect to the standard Lebesgue measure in $\mathbb{R}^n$ or counting measure in discrete spaces. There seems to be much literature about this problem which goes under names such as "non-informative priors", "maximum entropy distributions", "Jeffrey's priors", and the like.

However, I've found little on this topic in the infinite dimensional (function space) setting. Can concept of maximum entropy priors be generalized to function spaces, or is the idea of entropy fundamentally incompatible with infinite dimensional space?

Note: this thread wasn't getting answers here so I reposted at mathoverflow.

share|improve this question
add comment

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.