Does that mean that Bayesian analysis is involved in the directed ones, and not in those undirected?
- Anybody can ask a question
- Anybody can answer
- The best answers are voted up and rise to the top
Bayes networks can be represented graphically by directed acyclic graphs, but not all such graphs are Bayesian. The representation is useful for Bayesian analysis because it illustrates the states of a system as well as each associated transition probabilities. Undirected graphs cannot assign a specific transition probability because the transition direction is ambiguous. A more general case is Markov networks which can handle cyclic and undirected networks, provided the nodes have Markov properties.
The point about DAGs is that they reflect the factorization of the density of probability. It does not necessarily have something to do with transitions. Maybe more interestingly (and used in many applications in that sense) has to do with causality. That is, observing some events can have several causes. How can I infer which cause is the most likely?
The fact that DAG reflects how the density of probability factorizes, means that it captures the independence relationships, that is, it allows to reason about the data. Based on the graph structure, is possible to derive efficient algorithms for inference.
But going back to your original question, undirected models are also Bayesian. A typical case are Markov Random Fields (MRF) in image processing. See for example "Bayesian Methods and Markov Random Fields" by Mario A. T. Figueiredo. The idea is that the pixel values (the observations) are the consequences of a cause (which is defined by the application: segmentation, object detection, and so on).
In this indirected models you do not reason in terms of causality, but make inference from relationships among observations and local observations. In undirected models one defines the way the observations interact with each other, and that allows you to solve big combinatorial problems in an efficient manner. You may take a look at the paper: "Markov Random Field modeling, inference & learning in computer vision & image understanding: A survey", by Wang et al. or the wikipedia site on MRFs.
You can (and should) take a Bayesian probabilistic approach with either in the sense of putting prior probabilities on node values. It is not a good name because they are not more Bayesian than undirected models. I think the name just comes from the fact that DAGs were used in expert systems and people applied Bayesian techniques to them and called them Bayesian networks and the name stuck. They should really be called directed and undirected graphical models. Most machine learning techniques are based on probability theory. I don't know of any of those that could be called non-Bayesian.