Questions tagged [duality]
The duality tag has no usage guidance.
23
questions
0
votes
0
answers
17
views
Excercise 6.1 and its solution in Bishop's PRML, Question 9
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
15
views
Excercise 6.1 and its solution in Bishop's PRML, Question 8
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
21
views
Exercise 6.1 and its solution in Bishop's PRML, Question 7
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
7
views
Excercise 6.1 and its solution in Bishop's PRML, Question 6
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
14
views
Excercise 6.1 and its solution in Bishop's PRML, Question 5
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
14
views
Excercise 6.1 and its solution in Bishop's PRML, Question 4
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
14
views
Excercise 6.1 and its solution in Bishop's PRML, Question 3
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
15
views
Excercise 6.1 and its solution in Bishop's PRML, Question 2
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
1
vote
1
answer
29
views
Excercise 6.1 and its solution in Bishop's PRML, Question 1
The problem comes from Exercise 6.1 of "Pattern Recognition and Machine Learning" by Christopher M. Bishop:
Consider the dual formulation of the least squares linear regression
problem ...
- 183
0
votes
0
answers
69
views
Finding the optimal dual variables in svm by hand
I need to find the optimal dual variables $\lambda$ for SVM using the quadratic kernel:
\begin{align}\max_{\overset{\rightarrow}{\lambda}}&\sum_{i=1}^N\lambda_i-\frac12\sum_{i=1}^N\sum_{j=1}^N\...
- 115
0
votes
0
answers
32
views
Recover Primal Linear Programming Solution from Dual with LAD Regression?
This link discusses different ways of writing a classic LAD regression with a linear program. The classic way of writing LAD regression ($y = X \beta + r$) as a linear program is
\begin{equation}
\...
2
votes
0
answers
86
views
LASSO and duality theorem
I am confused with Lagrange duality theorem. Let us consider the problem
$$
\hat{\beta} = \underset{\beta \in \mathbb{R}^{n}}{\arg \min} \left[\sum_{i=1}^{n}(y_{i} - \beta_{i})^{2} + \lambda \sum_{i=...
- 73
1
vote
1
answer
150
views
Demonstration and Interpretation between a Fisher matrix and its dual space which is covariance matrix
I have a simple (maybe not) issue about the interpretation of the link between Fisher information matrix and its inverse which is the covariance matrix.
How to formulate that a line of Covariance ...
0
votes
0
answers
80
views
Primal Problem of SVM
The primal problem of SVM is denoted as below.
$$min_{w,b}\left(\phi \:\left(w\right)\right)=min_{w,b}\left(\frac{1}{2}w^Tw\right)$$
Subject to
$$y_n\left(w^Tx_n+b\right)\ge 1,\:n=1,2,3,...,l$$
And If ...
0
votes
0
answers
50
views
What are the Karush–Kuhn–Tucker conditions for $\min_x \frac{1}{2} ||x-u||_2^2:$ subject to $||x||_1\le c$
What are the Karush–Kuhn–Tucker conditions for $\min_x \frac{1}{2} ||x-u||_2^2:$ subject to $||x||_1\le c$
Apparently these are the conditions
but it's not all that clear how this can be applied to ...
- 720
2
votes
0
answers
65
views
What is the intuition of a dual?
I have been hearing that the Ridge regression is the dual to the GP (Gaussian process regression). What does this mean? Can someone please give an intuition on what 'dual' is.
My impression of the '...
- 8,457
1
vote
1
answer
84
views
Why is the Dual Formulation a valid reparametrization of a regression model
In polynomial regression problems, in which an input vector $\underline{\phi}(\underline{x})$ is used to map a feature vector to a higher dimensional space (an example of this being $(x_{1}, x_{2}) \...
- 2,104
1
vote
0
answers
37
views
A PCA related problem [closed]
Consider the problem of shape averaging. In particular, suppose $X_i\ (i = 1,\dots, M$) are the input matrices, $X_i\in \mathbb R^{N\times2}$, with each sampled from corresponding 2D positions of ...
- 11
2
votes
2
answers
140
views
How to solve MNP (minimum norm) problem in SVM?
I'm reading an article, which says that MNP (minimum norm problem) can be solved as SVM.
In the minimum norm problem, we're given a set of points in $R^d$ and need to find a point in convex hull of ...
- 201
2
votes
1
answer
152
views
Quadratic programming and interpretation of dual solution (Lagrangian)
Note: this question is about a common data science problem, but I am solving it using a specific piece of software. I believe the problem is common enough that these principles will be common across ...
- 1,091
1
vote
0
answers
91
views
Primal solution exists but dual does not
I am working on the follwoing nonlinear model.
Min z=10(1-$\exp$(−3x)
)
subject to:
x $\leq$ 3
When I solve this problem on LINGO, I got the message "dual solution does not exist but primal ...
- 33
1
vote
1
answer
431
views
How to recover primal problem from its dual counterpart
I am asking this from context of optimization in machine learning. We often talk about a primal problem and how this primal problem can be solved by first converting it into a dual problem (Using ...
- 1,896
7
votes
1
answer
2k
views
Earth Movers Distance and Maximum Mean Discrepency
By Kantorovich-Rubinstein duality the Earth Movers Distance (EMD)/Wasserstein Metric is equivalent to Maximum Mean Discrepancy (MMD) correct? See here for a more thorough explanation. Why then does ...
- 641