Questions tagged [jacobian]

For statistical questions involving the Jacobian matrix (or determinant) of first partial derivatives. For purely mathematical questions about the Jacobian it is better to ask at math SE https://math.stackexchange.com/.

27 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
91 views

Maximum Likelihood - Normal Errors - When is the Jacobian needed?

I am considering the following non-linear model $$h(z) - \lambda_0 - \lambda_1 z - \lambda_2x = v$$ where $v \sim \mathcal N(0,\sigma^2)$ unobserved error and where $\lambda_j$ are unknown ...
2
votes
0answers
151 views

Express the density of a function of two random variables using the Gradient and the joint density

I would like to know if it is possible to express the density $f_Z(z)$ of a function $Z = g(X,Y)$ of two continuous "nice" random variables $X$ and $Y$ only using the joint density $f_{XY}(x,y)$ and ...
2
votes
0answers
2k views

Calculating the Jacobian of a neural network

I'm trying to calculate confidence intervals for a neural network (rather than prediction intervals). I'm following this paper, which treats them in the same framework as any parametric (parameter-...
2
votes
0answers
133 views

About deriving PDFs from CDFs

Suppose I have some continuous random variable $X$. Further, suppose I am interested about a transformed random variable $Y = g(X)$ where $g$ is some increasing function. If I know the CDF of $X$, I ...
1
vote
0answers
22 views

How do you solve for inverses when doing the Jacobian transformation method?

Hopefully a very basic question. This is from a textbook exercise I'm doing to prepare for a class. Suppose I have two independent random variables, X and Y, and I am trying to find the joint ...
1
vote
0answers
38 views

Showing a useful result for Wisharts and Multivariate Beta random matrices

Let $\mathbf{A} \sim \text{Wishart}_m\left(k_a,\mathbf{V} \right)$ and $\mathbf{B} \sim \text{Wishart}_m\left(k_b,\mathbf{V} \right)$ be two full rank Wishart random matrices. Define $$ \mathbf{S} = \...
1
vote
0answers
21 views

Change of variables: 4-dimensional PDF to 2-dimensional PDF

I have a 4-dimensional joint-PDF between variables $X_1,X_2,X_3,X_4$ which are all Gaussian. I want to transform this into a 2-dimensional joint-PDF between new variables $Y_1=Y_1(X_1,X_2,X_3,X_4)$ ...
1
vote
0answers
246 views

How to understand Jacobian Matrix from the geometric perspective?

I found a good lecture about Jacobian Matrix which was part of a statistics course. However, it was published 20 years ago and lack of explanation. As a beginner of statistics, I'm not able to find ...
1
vote
0answers
65 views

Wrong vector calculus in lecture note 5 of cs224n, Stanford

I am studying NLP via cs224n from Stanford. I am reading this lecture note now. When you refer to the 5th page, they want to derive the gradient with respect to W for RNN, to show the mathematical ...
1
vote
0answers
601 views

Meaning of Jacobian of the transformation for pdf of function of random vectors

I am studying multivariate statistics and I don't understand the meaning of Jacobian of the transformation for pdf of function of random vectors. If I have a random vector, let's say bivariate, (X,Y)...
1
vote
0answers
49 views

What are some interesting parameterizations of $4 \times 4$ correlation matrices, and also perhaps their associated jacobians?

I am studying (mainly using Mathematica) some constrained integration problems in which the six-dimensional convex set of $4 \times 4$ correlation matrices plays a central role. In light of this, I ...
1
vote
0answers
142 views

Normalization constant for many to one mapping (Laplace distribution)

Suppose $\alpha=U\beta$ where $U$ is $N\times K$ with $N > K$. What is the probability density function (PDF) of $\beta$, $p(\beta)$, given that we know that it is proportional to $q$, the PDF of $\...
1
vote
0answers
238 views

Delta method with mix of continuous and discrete variables

This is my first question on Cross Validated so please bear with me if my question is lagging in any dimension. My question regards how to evaluate a Jacobian matrix when one variable is binary. I ...
1
vote
0answers
733 views

Jacobian matrix in neural network

How do you calculate the Jacobian matrix using the results (weights and biases) of a neural network after training? I am working in MATLAB, if anyone has any code suggestions, that would be helpful as ...
0
votes
0answers
17 views

Vectorized backpropagation for Neural network?

I understand back-propagation for scalars, but vectorized examples are bit tricky. Here, the image above shows a specific computational graph example. We are calculating gradients with respect to ...
0
votes
0answers
12 views

Vector-Jacobian Product Computational Cost

The paper FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models presents a continuous-time flow as a generative model which uses Hutchinson's trace estimator to give an ...
0
votes
0answers
36 views

Jacobian term for Metropolis Hastings algorithm?

Suppose an acceptance ratio of the MH sampler without parameter transformation is like this: \begin{gather} r=\frac{f( \theta ',\gamma '|y,m) q( \theta ',\gamma '|\theta ,\gamma )}{f( \theta ,\gamma |...
0
votes
0answers
47 views

Rescaling multivariable normal pdf and normalizing constant

I am trying to understand change of variables for a random variable and how it changes the pdf and the normalizing constant. Let $\mathbf{x}$ be $N$-dimensional normal variable and let $\mathbf{\...
0
votes
0answers
11 views

Finding the log Jacobian of a transformation from lower to high dimensions, specifically in the case of normal cdf to Dirichlet?

I have random variables $\mu$ and $\sigma$ that I have transformed and I am interested in finding their joint distribution given the following information I have. Particularly, I need help finding the ...
0
votes
0answers
43 views

Expectation (x/y) using jacobian

Let $X$ and $Y$ be two independent random variables with the density functions: $f(x) = 3 x^2$, for $0<x<1$, $0$ elsewhere $g(y) = 4y^3$, for $0 <y<1$, $0$ elsewhere Give $\mathbb E(x/...
0
votes
0answers
24 views

Calculating a Weighted Standard Error of the Fit for Nonlinear Regression

I have a data set of $N$ points to which I have fit an equation of $n$ parameters $\theta_{1..n}$ such that $y_i \sim f(x_i; \theta_{1..n})$. These data $(x_{1..N},y_{1..N})$ have been provided with ...
0
votes
0answers
12 views

Autograd theory question

I have attached an image of the mathematical description of calculating the gradient for the cost function from Pytorch. 1.) Is $\vec{y}$ the output of the network? 2.) What is $v$ in terms of a ...
0
votes
0answers
105 views

Is Covariance Matrix analogous to Jacobian Matrix?

In probability theory covariance matrix denote how each variable relates to other in a pairwise manner. So 1 would mean they are identical and 0 would mean they are independent and are not related. Is ...
0
votes
1answer
33 views

Jacobian for function including cubic spline

I am trying to fit a measured spectrum with a linear combination of end-member spectra which are approximated by cubic spline functions ($f_1$ and $f_2$). I also need to incorporate terms that account ...
0
votes
0answers
203 views

Transformation of random variables and Jacobian

When transforming 2+ continuous random variables, you use a Jacobian matrix and compute the determinant. Do you also compute the Jacobian for discrete random variables?
0
votes
0answers
55 views

Projection of multivariate distribution to lower dimensional subspace

Say that $X \in \mathbb{R}^n$ is a vector of $n$ r.v.'s with pdf $p(x_1,\ldots,x_n)$. Let's consider now the linear map $Y = A X$ where $Y \in \mathbb{R}^m$ with $m < n$. I am seeking $p(y_1,\ldots,...
0
votes
0answers
27 views

Highest posterior interval and monotone changes of variables

Suppose $X$ is distributed with a unimodal pdf $f(x)$ and let $Y = g(X)$ for some strictly monotone function $g$. Hence $g$ is invertible. Is there an analytically tractable relationship between the ...