5
$\begingroup$

The graph diffusion kernel of a Graph is the exponential of its Laplacian $\exp(-\beta L)$ (or a similar expression depending on how you define the kernel). If you have labels on some vertices, you can get labels on the rest of the vertices by a majority vote of adding the kernel contribution. In spectral clustering, the sign of the eigenvector components of the largest eigenvalue of the Laplacian determines the class assignment of the vertices. Since these techniques seem to be doing similar things based on the graph Laplacian, is there a link between spectral clustering and the diffusion or heat kernel? Is one the generalization of the other under some assumptions?

Updates:

  1. So the paper "The Principal Components Analysis of a Graph, and Its Relationships to Spectral Clustering" by Saerens et al. seems to say something about this. They say that one flavor of the diffusion kernel (the Euclidean Commute Time Distance) is the same as one type of spectral clustering.

  2. The paper "Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker-Planck Operators" by Nadler et al. also has a result that I am yet to parse.

  3. Following "Graph spectral image smoothing using the heat kernel" by Zhan and Hancock, we can observe that if $L = USU^T$, (with $U$ as the eigenvectors and $S$ the diagonal matrix of eigenvalues) and $H=\exp(-\beta L)$, then $H = Uexp(-\beta S)U^T$. So for some $\beta$ we just have to take the smallest eigenvalue to get the approximate $H$.

Note: Cross-posted on Math.SE.

$\endgroup$
  • $\begingroup$ Great question. (+1) In your third sentence, do you mean "the sign of the eigenvector components of the largest eigenvalue of the laplacian determines the class assignment of the vertices"? As an aside, I would be interested in a citation for your second and third sentences for my own education. $\endgroup$ – Sycorax Nov 23 '15 at 17:16
  • $\begingroup$ yes, I meant eigenvalue. I'll add a citation if I see one or if it comes to mind. Basically, the math of the diffusion kernel is also related to spin glasses, and can lead to clusters of magnetism. See arxiv.org/abs/0811.2329 and link.springer.com/article/10.1007/s100510051038. Sorry for all the hand-waving, my math isn't that great. $\endgroup$ – highBandWidth Nov 23 '15 at 17:28
  • $\begingroup$ @user777, I've added a couple of references. I am hoping someone will be interested in groking it and explaining the relation. $\endgroup$ – highBandWidth Nov 23 '15 at 17:59
  • $\begingroup$ I'd take a look, except that I'm studying for my midterms right now! This is a cool area of research, though, so I'll probably spend some time on it when I have a moment this weekend. $\endgroup$ – Sycorax Nov 23 '15 at 18:01

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.