Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

Specific question on Gaussian Processes and dimensionality reduction. I saw a a method for dimensionality reduction for the squared exponential covariance function (not ARD) whereby one uses a GxD projection matrix P (G < D, D = dimension of the inputs) such that the squared distances are calculated in a lower dimensional space. E.g. the kernel function K(x, x') = c * exp(-1/2*(P(x-x'))T*(P(x-x'))) with T denoting transpose. I'm trying to use this in my implementation of gpr, but I'm not sure how to get the gradient with respect to P for optimization. E.g. I need the derivative of the marginal likelihood w.r.t. P to maximize (well minimizing the negative log marginal likelihood in actuality). Has anyone seen this method before or have any suggestions? Thanks.

share|improve this question
can you give a reference to the paper? – Dikran Marsupial Jun 14 '12 at 8:52
Yep no problem. I'm looking at "Variable noise and dimensionality reduction for sparse Gaussian processes", Snelson and Ghahramani. You can see what I've been reading lately. link here: gatsby.ucl.ac.uk/~snelson/snelson_uai.pdf – tomas Jun 14 '12 at 12:51

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.