Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [radial-basis]

A radial basis function (RBF) is a real-valued function whose value depends only on the distance from the origin. Gaussian function is one example.

1
vote
1answer
98 views
+50

Probabilistic Interpretation of Radial Basis Function

I was wondering if someone could flesh out the probabilistic interpretation of using the Radial Basis Function to compute the probability between an observation and some reference value. My question ...
1
vote
0answers
37 views

Adding new center in an RBF network without memorizing previous training examples

Suppose we train an RBF by minimizing the LSE on a couple of training points and we are doing it incrementally in an online fashion. So basically we update the QR factorization using e.g. Givens ...
1
vote
0answers
39 views

Why are Radial basis function networks not particularly suitable for extrapolation?

Assuming you have a regression problem where the test data is quite likely to be outside the range of the training data; hence, the model needs to extrapolate from the training set. Why are RBF ...
0
votes
1answer
529 views

How to interpret a SVM plot

Hi, so i'm using support vector machine for some statistical project and this is a plot of from a using a sigmoid kernel. There are 9 variables and 300 data points. The way i interpret this plot is ...
3
votes
2answers
3k views

Can someone explain the RBF Kernel to me?

I have read every explanation out there on this but nobody at all seems capable of explaining this very well (either that or I'm utterly stupid). For an SVM RBF Kernel we often say that: But what ...
1
vote
0answers
132 views

SVM: (Using the RBF as a Kernel) vs (Using the RBF to create a new set of features)

I apologize for the verbose description, but (after searching several places for an answer) maybe the best way to phrase it is to lay things out explicitly. Say we are trying to build an SVM model ...
1
vote
0answers
38 views

Coefficient in GLM, find the important factor

I am using the GLM to model my data. The response variable is binary and there are two predictors, namely, speed (cm/s) and position (cm). First of all I have used the Zernic basis functions to model ...
1
vote
0answers
486 views

How to choose bandwidth parameter for RBF

I am implementing a logistic regression with RBF (Gaussian) kernel. Here are the steps I tried: first finding centers with k-means perform the transformation using $e^{-(||x-c_i||)^2/2\sigma^2}$ ...
2
votes
1answer
1k views

How to build and use the kernel trick manually in python?

So... I have been trying to make a radial basis kernel for hours but I am not sure of what my final matrix should look like. I have 30 features and 200000 data points. Should my matrix K be 200000*...
1
vote
1answer
406 views

How to calculate decision boundary from nonlinear svm in R?

As a follow up to this question - How to obtain decision boundaries from linear SVM in R? Is it possible to do the same with non linear SVM? (Radial for example). What do the weights represent?
1
vote
1answer
4k views

RBF kernel algorithm Python

I have this algorithm to compute the RBF kernel and it seems to work just fine. But I would like to understand what kind of operations are involved, for example: What are the trnorms vectors? What ...
2
votes
2answers
1k views

100% training accuracy despite a low cv score

I am working on an assignment where we have to study the affect of gamma and C parameters on SVM with RBF kernel. I use python's sklearn library and grid search with 10 fold cross validation (with a ...
1
vote
1answer
131 views

Weighted Minkowski RBF kernel

The radial basis function (RBF) kernel is given by $$K_{\text{RBF}}(\mathbf{x}, \mathbf{y})=\exp[-\gamma\|\mathbf{x}-\mathbf{y}\|^2_2]$$ where $\|\mathbf{x}-\mathbf{y}\|^2_2$ is the squared ...
1
vote
1answer
241 views

RBF transformation on a Normally Distributed Random Variable

I have a random vector $\mathbf{X} \sim \mathcal{N}(\mathbf{m,\Sigma})$ which is transformed by a Gaussian Radial Basis Function into the random variable $\mathbf{Y} = K(\mathbf X) = \exp(-\lambda ||\...
1
vote
0answers
82 views

How does one extend radial basis function (RBF) networks formally from regularization but with vector valued outputs?

I was reading the following paper on hyper & radial basis function (HBFs & RBFs) networks and also this one that kind of summarizes the first one and was trying to understand how to extend ...
1
vote
0answers
91 views

How should one learn the centers for an hyper basis function network (HBF)?

I was reading the following paper on hyper basis function (HBF) (similar to radial basis function RBF network) and was trying to figure out how one learns the movable centers of the hyper basis ...
1
vote
1answer
140 views

Can one derive Radial Basis Functions (RBFs) with movable centers from Tikhonov regularization?

It is well know that the "usual" Radial Basis Function can be derived from Regularization that imposes small derivates. More precisely it is well known that the following: $$ f(x) = \sum^{N}_{n=1} ...
2
votes
0answers
155 views

Is it meaningful to compute a radial kernel density estimate from 2D data?

I am working with 2D spatial data, $(X_i, Y_i),\; i=1, \cdots, N$. My current research requires estimating the density of the distances between those data points in each of the two dimensions. So ...
1
vote
0answers
107 views

Are RSM and RBFN essentially GLM?

Is response surface methodology (RSM) the same as a generalized linear model (GLM) with quadratic terms and normal error distribution? Is radial basis function network (RBFN) also the same as a ...
2
votes
0answers
96 views

How to prove that Radial Basis Function can be derived by mapping function?

How to prove the radial basis function $k(u,v) = \int_{\mathbb{R}^d} \phi_t(u)\phi_t(v)dt $ can be integrated out by mapping function? $$\phi_{t}(u) = \frac{1}{(2\pi\Sigma)^{d/2}} \exp\left\{-\frac{\|...
2
votes
1answer
287 views

SVM RBF performance on “dissimilar” data

I've been studying the performance of machine learning algorithms on "dissimilar" data (that is, prediction on new data that are not that "similar" to the training set) and I came up with this ...
4
votes
1answer
3k views

libsvm on MATLAB with rbf kernel: Compute distance from hyperplane

I have a One-Versus-All classification task with 80 different labels. In order to parallelize the problem to take advantage of multiple nodes on a computer cluster, I first trained 80 binary SVM ...
0
votes
0answers
84 views

How to interpret basis function that yields vector in machine learning algorithm?

I'm struggling to understand what $\phi(x_{N+1})$ is in this excerpt of an algorithm (namely Linear Bayesian Regression embedded in other algorithm): $c_i = \gamma_i / \sum^L_{j} \gamma_j$ $V_i^{N+1}...
4
votes
3answers
2k views

SVM: non-linear versus linear models

In the context of classification on somewhat large datasets (say at least 50Kx50K), I am wondering in which cases non-linear models are superior to linear ones to warrant the added complexity. I often ...
2
votes
1answer
725 views

Binary classification using radial basis kernel SVM with a single feature

Is there any interpretation (graphical or otherwise) of a radial basis kernel SVM being trained with a single feature? I can visualize the effect in 2 dimensions (the result being a separation ...
1
vote
0answers
372 views

How to select a radial basis function?

Currently I am investigating interpolation of 3D data with radial basis functions (RBF) and I am wondering that there are quite a few families of such (see table1 here). However, I cannot find any ...
3
votes
1answer
431 views

Weights of radial basis function networks

If I use radial basis function networks (RBFNs) for probability estimation by plugging the output of the RBFNs into the Logistic function are weights between 0 and 1 sufficient?
3
votes
2answers
179 views

Optimal basis for regression problem

Consider the training set $\{(x_i; y_i)\}_{i=1}^N, x_i \in \mathbb{R}^n, y_i \in \mathbb{R}$. The goal is to find regression function, like, $f(x) = \sum_{i=1}^K a_i g_i(x) + a_0$. The least-squares ...