Questions tagged [independent-component-analysis]

Independent Component Analysis separates the additive combination of multiple signals into their estimated components.

78 questions
Filter by
Sorted by
Tagged with
8 views

What is meant by the assumption of statistical independence among sources in Independent Component Analysis?

One of the underlying assumptions of independent component analysis (ICA) that I consistently see written is "statistical independence across the source signals". In the context of the ...
• 71
70 views

Differences Between Independent Components from ICA Directly on Samples vs. Mixing Matrix from ICA on Features After PCA Dimensionality Reduction

My understanding is that for Independent Component Analysis (ICA), it is recommended to have more samples than features to avoid underdetermination which might cause convergence or stability issues. ...
94 views

1 vote
15 views

Blind source seperation on space data [closed]

in a uni project we gathered spectrum data from the ISS (time x frequency). The challenge is now to analyse this data and especially try to seperate the signals. As far as I understood it the common ...
• 11
76 views

Making vectors independent of each other

Assume that I have three vectors $A, B, C$ containing information about a set of variables. There may be common information shared between these vectors, that is $A, B, C$ are not independent. What ...
101 views

Testing statistical independence before using ICA

First a little bit of background. I'm interested in exploring the performance of Independent Component Analysis (ICA) in the context of disentangling intracranial EEG signals. These signals are ...
• 31
2k views

What does ICA return?

I am confused with ICA. With PCA I understood that it always gives the components with maximum variance. What does ICA return? Does it return components with maximum independence? How to find best ...
• 159
1 vote
67 views

FastICA of orthonormal inputs

In Wikipedia page of FastICA it says FastICA seeks an orthogonal rotation of prewhitened data Which means if the input is orthonormal, so would be the output. This can be examined numerically but ...
• 109
289 views

ICA for noise reduction of covariance matrix

Trying to understand ICA in the context of noise reduction of covariance matrices (of dimensionality M). I understand in PCA, you can reconstruct the covariance matrix by squaring the first N ...
• 2,461
868 views

Doesn't the non-Gaussian source assumption of ICA render it practically useless?

Gaussian distributions appear everywhere in nature, indeed this was largely the justification for most classical methods' reliance on assumption of normality. ICA assumes non-Gaussian sources, indeed ...
• 333
123 views

The lack of correlation determines the second-degree cross-moments (covariances) of a multivariate distribution?

It is given in the following image that lack of correlation determines the second-degree cross-moments (covariances) of a multivariate distribution,while in general statistical independence ...
• 692
1 vote
1k views

Why does the Independent Component Analysis require non-gaussian?

This I found on google while I was going through the Independent Component Analysis in unsupervised learning. Let x = As where A is the Mixing Matrix. So, Lets assume that s here is Gaussian ...
• 692
4k views

What is meant by the non-gaussianity in the independent component analysis (ICA)?

What is meant by non-gaussianity in ICA? Why do we use in ICA? How is Non-Gaussianity is an important and essential principle in ICA estimation? Following is the statement I found in a research paper....
• 692
2k views

Numerical Example of Independent Component Analysis

Can somebody explain ICA(Independently Component Analysis) with a small practical example over here. I have seen lot of programs and libraries written and you can just apply that to your data to find ...
• 425
1 vote
76 views

Connecting PCA singular values to generating parameters

I have a non-linear function of the following form $y_i = f(x_i,\theta)$ where $x_i$ is known and $\theta$ is a vector of parameters. I have generated $n$ realizations of $y_i$ by sampling from a ...
• 31
1k views

Why are Gaussian distributions the only "forbidden" source distribution for ICA?

I know it's commonly asked why Gaussians are forbidden from use in independent components analysis. This is because a gaussian source distribution will result in the same observed distribution no ...
• 293
85 views

Why is infinite data required to verify statistical independence

I've been reading about Independent Component Analysis and the FastICA algorithm. The wiki page for FastICA states: FastICA is an efficient and popular algorithm for independent component ...
• 753
1 vote
69 views

Understanding Natural gradient learning Independent component analysis

I am quite a novice to statistics and am currently fighting my way through the "Neural Networks and Machine Learning" Book by Haykin. (p.516-518) In the discussion about independent ...
• 55
770 views

ICA, how to check for Gaussian components?

Independent Component Analysis (ICA) requires that at most one of the additive subcomponents of a multivariate signal is Gaussian. If I do not know the distributions of the subcomponents, how do I ...
• 350
3k views

PCA is to CCA as ICA is to?

PCA looks for factors in data that maximize explained variance. Canonical correlation analysis (CCA), as far as I understand, is like an PCA but looks for a factors that maximize cross covariance ...
• 7,639
1 vote
474 views

ICA - independence of coefficients and maximizing independence

Hopefully this isn't too silly a question but I'm wondering how in independent component analysis when we've got independent coefficients then we identify parts of a face such as eyes, mouth, nose, ...
2k views

Using only one mic in Cocktail Party Algorithm

So I came across this piece of code that separates 2 audio sources from 2 mixed audio sources has shown here: ...
• 123
487 views

Why are gradient-based methods better for nonstationary environments?

In the book Independent Component Analysis (Hyvärinen et al. 2001), it is mentioned on page 178: The advantage of such gradient methods, closely connected to learning in neural networks, is that ...
• 327
2k views

What is the advantage of FastICA over other ICA algorithms?

I have seen that FastICA is the only ICA algorithm implemented in many packages. What are the advantages of FastICA compared to other algorithms? What are its disadvantages?
• 327
I have $N$ mixtures consisting of one non-Gaussian source (I know the distribution) and many (more than $N$) Gaussian sources. I also know how my non-Gaussian source is mixed into the signal (I know ...