Approximating Discrete Probability Distributions with Causal Dependence Trees

Chow and Liu considered the problem of approximating discrete joint distributions with dependence tree distributions where the goodness of the approximations was measured in terms of KL distance. They demonstrated that the minimum divergence approximation was the tree with maximum sum of mutual informations, and specified a low-complexity minimum-weight spanning tree algorithm to find the optimal tree. In this paper, the authors consider an analogous problem of approximating the joint distribution on discrete random processes with causal, directed, dependence trees, where the approximation is again measured in terms of KL distance.

Provided by: University of Idaho Topic: Networking Date Added: Jul 2010 Format: PDF

Download Now

Find By Topic