# Questions tagged [tensor]

In machine learning, tensor is a multidimensional (multi-index, or multi-way) array of numbers, i.e. a generalization of a matrix.

53 questions
Filter by
Sorted by
Tagged with
1 vote
15 views

### Presenting 2D smoother of GAM

I had a look around and couldn't find the answer to my problem, so hopefully this is a new question. I tried to fit a GAM with two continuous explanatory variables, one of them is Day of the year and ...
1 vote
19 views

### Comparing AIC of Tensor Product Smooths versus Thin Plate Splines

I'm comparing the AIC of these two models. Tensor Product Smooth vs. Thin Plate Spline both fit using REML ...
• 542
14 views

### Model predicts same number for any input on initialization of random weights

My PNAConv (pytorch) network has been having issues with predicting the same exact value for all inputs. Without getting into too many details, I have a broader neural netowrk question. When I ask my ...
6 views

### CP Tensor Decomposition and Correlating Sample Magnitudes with Variables of Interest

I am learning about tensor decomposition, specifically CP, and am trying to understand if I can use it for my research. To give a bit more detail, I have brain imaging data from 10 participants, with ...
• 295
215 views

### Mathematical representation of 1D convolution

How does one write the mathematical formula for conv1d used in PyTorch, including parameters like stride length and padding? For instance, I can write ...
• 73
11 views

• 5,291
1 vote
56 views

### How to find eigenvalues and eigenvectors of the cokurtosis matrix?

Kurtosis is the fourth statistical moment of a random variable's distribution. Unlike the variance-covariance matrix $\Sigma$, which had a shape of $p\times p$, the kurtosis-cokurtosis matrix is ...
• 3,089
37 views

### Tensor product between an ispline and a bspline for fitting data that should be monotonic in one dimension

I'm not very familiar with the process for solving tensor product basis fittings. I've done some work with fitting an ispline basis with a non-negative-least-squares solver to fit a monotonic spline ...
• 21
1 vote
58 views

### What is the actual use of GAN model? Is it only used to generate the data that closely resembles original dataset?

I am very new to tensor flow. I came across GANS. From what I understand in GANs there are 2 models, Generator and Discriminator. Generator job is to generate the data that will be able to fool the ...
• 113
22 views

### How to derive mathematically that derivative of |Ax-y|^2 with respect to A is 2|Ax-y| x^T [duplicate]

How to get transpose part when derive mathematically $$\frac {\partial|Ax-y|^2}{\partial A} = 2|Ax-y|x^T$$
92 views

### Understandable way of thinking about higher order tensors

I study deep learning and the one of the major problem I face is I can't imagine shape of higher order tensors in my head. for instance - A 2d tensor - (x,y) is a rectangle with x,y along its length ...
• 103
1 vote
330 views

### Compact/Vectorized Multiclass Logistic Regression Hessian

I know that the Hessian of the categorical cross entropy w.r.t the weights is given by $$\frac{\partial^2 L}{\partial w^2} = \sum_{i=1}^{m} (Diag(\hat{y}_i)-\hat{y}_i^T \hat{y}_i) \otimes x_i^T x_i$$ ...
• 33
291 views

### "row" and "column" are the names of axes of 2d array, is there a similar naming for a 3d array?

row and column are the names of axes of 2d array. this python array, array([[0, 1, 2], [3, 4, 5], [6, 7, 8]]) could be viewed as a matrix that ...
• 157
1 vote
57 views

### Why are some robust algorithms valid for Tucker decomposition, but not for CP decomposition?

I have been reading up about CP and Tucker decomposition. It makes sense that CP decomposition is a special case of Tucker decomposition, where the core tensor is super-diagonal. However, if this is ...
• 111
1 vote
138 views

### Diffusion tensor as a covariance matrix

TLDR: In nuclear magnetic resonance (NMR), to study molecular diffusion we assume that molecules displace in 3D space according to a trivariate gaussian distribution. The variables are then the ...
448 views

• 123
1 vote
265 views

### Is Tensorflow shape just for convenience? [closed]

It's pretty neat that Tensorflow allows you to define and do math on arbitrary tensors, but for supervised learning applications, is there any reason you would want to define your inputs and outputs ...
• 638
222 views

### Intuition behind using tensors ? [closed]

I am trying to build a recommendation model by using a tensor. In order to recommend an article to a user, I have built a model to predict users' preferable articles. I am labeling articles based on ...
• 1,117