Questions tagged [radial-basis]

A radial basis function (RBF) is a real-valued function whose value depends only on the distance from the origin. Gaussian function is one example.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

encoding the true labels of radial basis neural network for binary classsification

I am working on a binary classification problem (my class labels are 1 or 0) and I have three layers (input, hidden, output) radial basis neural network. I put two neurons, one per class, in the ...
0
votes
0answers
17 views

Using k-means clustering to train radial basis neural network for highly imbalanced dataset

I am trying to find prototype neurons for my radial basis neural network. My dataset has 30 attributes (of which 28 of them are the result of a single PCA) and 300.000 observations. It is a binary ...
1
vote
0answers
57 views

What is the basis for the default sigma value used by svmRadial in caret? [closed]

I am looking at the source code (I think) for the "svmRadial" function in the caret package. It looks like the default sigma values are calculated by first using the kernlab package's "sigest" ...
0
votes
0answers
54 views

How to use a gaussian basis function

I am trying to build a linear regression model and one of my features when plotted against the output looks like a bell curve. So intuitively I figured that if I use the raw data for that feature my ...
0
votes
0answers
32 views

Estimate RBF-kernel mapping function given graph/space

Problem Provide a mapping function $𝜑(x)$ that enables us to draw a linear separator between the two classes in the mapped space. Attempt I tried to use a radial basis function by finding 4 ...
0
votes
0answers
18 views

Mairhuber-Curtis Theorem, Adaptive Bases and Neural Networks

I am reading the paper Positive Definite Kernels: Past, Present and Future by GE Fasshauer in which he describes computing with PD kernels. In section 3.2 he mentions the Mairhuber-Curtis Theorem, ...
1
vote
0answers
38 views

How to prove 1-norm radial function is kernel?

How should I prove that is a valid kernel: $K(x,y)=exp(-\alpha||x-y||_1) $ As I understand, there are three ways to prove that prove $K(x,y)=<\phi(x) ,\phi(y) >$ prove $\sum_{j,k=1}^n a_j\,...
0
votes
0answers
12 views

How many output neurons should I use for handwritten digits classification using a radial basis function network?

I have to develop a Radial Basis Function network for handwritten digits classification and have some problem of how many neurons on the output neuron should I use. I have two ideas: -1 10 hidden ...
1
vote
1answer
124 views

Probabilistic Interpretation of Radial Basis Function

I was wondering if someone could flesh out the probabilistic interpretation of using the Radial Basis Function to compute the probability between an observation and some reference value. My question ...
1
vote
0answers
42 views

Adding new center in an RBF network without memorizing previous training examples

Suppose we train an RBF by minimizing the LSE on a couple of training points and we are doing it incrementally in an online fashion. So basically we update the QR factorization using e.g. Givens ...
1
vote
0answers
57 views

Why are Radial basis function networks not particularly suitable for extrapolation?

Assuming you have a regression problem where the test data is quite likely to be outside the range of the training data; hence, the model needs to extrapolate from the training set. Why are RBF ...
0
votes
1answer
666 views

How to interpret a SVM plot

Hi, so i'm using support vector machine for some statistical project and this is a plot of from a using a sigmoid kernel. There are 9 variables and 300 data points. The way i interpret this plot is ...
3
votes
2answers
5k views

Can someone explain the RBF Kernel to me?

I have read every explanation out there on this but nobody at all seems capable of explaining this very well (either that or I'm utterly stupid). For an SVM RBF Kernel we often say that: But what ...
1
vote
0answers
142 views

SVM: (Using the RBF as a Kernel) vs (Using the RBF to create a new set of features)

I apologize for the verbose description, but (after searching several places for an answer) maybe the best way to phrase it is to lay things out explicitly. Say we are trying to build an SVM model ...
1
vote
0answers
42 views

Coefficient in GLM, find the important factor

I am using the GLM to model my data. The response variable is binary and there are two predictors, namely, speed (cm/s) and position (cm). First of all I have used the Zernic basis functions to model ...
1
vote
0answers
691 views

How to choose bandwidth parameter for RBF

I am implementing a logistic regression with RBF (Gaussian) kernel. Here are the steps I tried: first finding centers with k-means perform the transformation using $e^{-(||x-c_i||)^2/2\sigma^2}$ ...
2
votes
1answer
2k views

How to build and use the kernel trick manually in python?

So... I have been trying to make a radial basis kernel for hours but I am not sure of what my final matrix should look like. I have 30 features and 200000 data points. Should my matrix K be 200000*...
1
vote
1answer
537 views

How to calculate decision boundary from nonlinear svm in R?

As a follow up to this question - How to obtain decision boundaries from linear SVM in R? Is it possible to do the same with non linear SVM? (Radial for example). What do the weights represent?
1
vote
1answer
5k views

RBF kernel algorithm Python

I have this algorithm to compute the RBF kernel and it seems to work just fine. But I would like to understand what kind of operations are involved, for example: What are the trnorms vectors? What ...
2
votes
2answers
1k views

100% training accuracy despite a low cv score

I am working on an assignment where we have to study the affect of gamma and C parameters on SVM with RBF kernel. I use python's sklearn library and grid search with 10 fold cross validation (with a ...
1
vote
1answer
168 views

Weighted Minkowski RBF kernel

The radial basis function (RBF) kernel is given by $$K_{\text{RBF}}(\mathbf{x}, \mathbf{y})=\exp[-\gamma\|\mathbf{x}-\mathbf{y}\|^2_2]$$ where $\|\mathbf{x}-\mathbf{y}\|^2_2$ is the squared ...
1
vote
1answer
258 views

RBF transformation on a Normally Distributed Random Variable

I have a random vector $\mathbf{X} \sim \mathcal{N}(\mathbf{m,\Sigma})$ which is transformed by a Gaussian Radial Basis Function into the random variable $\mathbf{Y} = K(\mathbf X) = \exp(-\lambda ||\...
1
vote
0answers
84 views

How does one extend radial basis function (RBF) networks formally from regularization but with vector valued outputs?

I was reading the following paper on hyper & radial basis function (HBFs & RBFs) networks and also this one that kind of summarizes the first one and was trying to understand how to extend ...
1
vote
0answers
92 views

How should one learn the centers for an hyper basis function network (HBF)?

I was reading the following paper on hyper basis function (HBF) (similar to radial basis function RBF network) and was trying to figure out how one learns the movable centers of the hyper basis ...
2
votes
1answer
153 views

Can one derive Radial Basis Functions (RBFs) with movable centers from Tikhonov regularization?

It is well know that the "usual" Radial Basis Function can be derived from Regularization that imposes small derivates. More precisely it is well known that the following: $$ f(x) = \sum^{N}_{n=1} ...
1
vote
0answers
130 views

Gaussian shape link function for glm binomial regression?

Link functions are typically sigmoid. The idea being that the underlying data is fitted to the curve with an increase in the predictor summation gives an increase in the response. However, could one ...
2
votes
0answers
166 views

Is it meaningful to compute a radial kernel density estimate from 2D data?

I am working with 2D spatial data, $(X_i, Y_i),\; i=1, \cdots, N$. My current research requires estimating the density of the distances between those data points in each of the two dimensions. So ...
1
vote
0answers
122 views

Are RSM and RBFN essentially GLM?

Is response surface methodology (RSM) the same as a generalized linear model (GLM) with quadratic terms and normal error distribution? Is radial basis function network (RBFN) also the same as a ...
2
votes
0answers
97 views

How to prove that Radial Basis Function can be derived by mapping function?

How to prove the radial basis function $k(u,v) = \int_{\mathbb{R}^d} \phi_t(u)\phi_t(v)dt $ can be integrated out by mapping function? $$\phi_{t}(u) = \frac{1}{(2\pi\Sigma)^{d/2}} \exp\left\{-\frac{\|...
2
votes
1answer
295 views

SVM RBF performance on “dissimilar” data

I've been studying the performance of machine learning algorithms on "dissimilar" data (that is, prediction on new data that are not that "similar" to the training set) and I came up with this ...
5
votes
1answer
3k views

libsvm on MATLAB with rbf kernel: Compute distance from hyperplane

I have a One-Versus-All classification task with 80 different labels. In order to parallelize the problem to take advantage of multiple nodes on a computer cluster, I first trained 80 binary SVM ...
0
votes
0answers
89 views

How to interpret basis function that yields vector in machine learning algorithm?

I'm struggling to understand what $\phi(x_{N+1})$ is in this excerpt of an algorithm (namely Linear Bayesian Regression embedded in other algorithm): $c_i = \gamma_i / \sum^L_{j} \gamma_j$ $V_i^{N+1}...
4
votes
3answers
2k views

SVM: non-linear versus linear models

In the context of classification on somewhat large datasets (say at least 50Kx50K), I am wondering in which cases non-linear models are superior to linear ones to warrant the added complexity. I often ...
2
votes
1answer
830 views

Binary classification using radial basis kernel SVM with a single feature

Is there any interpretation (graphical or otherwise) of a radial basis kernel SVM being trained with a single feature? I can visualize the effect in 2 dimensions (the result being a separation ...
1
vote
0answers
410 views

How to select a radial basis function?

Currently I am investigating interpolation of 3D data with radial basis functions (RBF) and I am wondering that there are quite a few families of such (see table1 here). However, I cannot find any ...
3
votes
1answer
495 views

Weights of radial basis function networks

If I use radial basis function networks (RBFNs) for probability estimation by plugging the output of the RBFNs into the Logistic function are weights between 0 and 1 sufficient?
3
votes
2answers
182 views

Optimal basis for regression problem

Consider the training set $\{(x_i; y_i)\}_{i=1}^N, x_i \in \mathbb{R}^n, y_i \in \mathbb{R}$. The goal is to find regression function, like, $f(x) = \sum_{i=1}^K a_i g_i(x) + a_0$. The least-squares ...