Is kriging suitable for high dimensional regression problems? I would like to point out that I am new to this field, so if I am not clear please forgive me (and correct me).
I set up a DoE (Design of Experiment) with 11 inputs and 121 runs. I used a STOA (Strength-Two Orthogonal Array) to fill the domain and I ran my test. I measured 5 outputs, so at the end I have a 121x11 input array and a 121x5 output array.
My task is to generate a RSM (Response Surface Model) from these data and I am currently using the kriging algorithm but I do not get good results in terms of accuracy (the RMSE (Root Mean Square Error) is quite high).
My questions are:


*

*since kriging comes out from geostatistics applications, it is correct to say that it works well just with 2D or 3D spaces and it loose its accuracy with high dimensional spaces? Why or why not?

*given my training set, how can I choose the best algorithm to fit my RSM?   


EDIT1: @whuber - I got your concerns. I actually have some lack about data analysis and I want to look into it. Where can I start? Do you know some god books or websites?
EDIT2: @GeoMatt22 - 


*

*I performed a Leave-One-Out Cross Validation and I plotted the Actual vs Predicted graph. For some outputs the distribution of points is rather spread and the RMSE is high. I suppose I should do some data analysis. What should I look at? Variance of data? Covariance?

*Goal is optimization.


EDIT3: @David Kozak - Thanks for your observations. I will take a look to the Rasmussen and Williams.
 A: You might look into Gaussian Process Regression... Kriging is the name used for Gaussian Processes in Spatial Statistics, and is the domain in which they found the most use until relatively recently. There's an excellent book freely available online by Rasmussen and Williams on the topic. 
Without knowing more about your problem or your data it would be difficult to suggest where to look as far as off-the-shelf algorithms go. I'd suggest that 121 observations is too few for that many dimensions without a strong prior understanding of what your parameter values ought to be, so perhaps make sure that they're all needed, and try some sort of feature selection or dimension reduction if they're not. 
A: I completely agree with David Kozak's answer, but I would like to bring some additional points:
11 inputs is not too high for Gaussian process regression (GPR)/Kriging. I have already dealt with problems with a dozen of variables with success using GPR
121 observations is indeed quite small, and the second concern about the training dataset is that it has been created with an Orthogonal Array (OA). While they are fell suited for linear regression, they are not for GPR. GPR with stationary kernels (the most common and simple ones) use the distances between points of the training set and need as much diversity in these distances, but OA have only few distances compared to a random design of the same size. When using GPR, it is better use rather Latin Hypercube sampling or random design.
But I guess that you cannot change your design of experiment... As Kriging may give disappointing results, I would advise you to test more simple methods as linear regression, GAM... Random Forests (or more simply a decision tree) might give interesting results too.
