Thursday, February 9, 2006
4:15 P.M. to 5:15 P.M.
Packard 101
Message-Passing Algorithms for Constraint Satisfaction Problems
Elitza Maneva
UC Berkeley
Abstract:
Over the last decade message-passing algorithms and graphical models
have found an increasing number of new applications. I will discuss such
algorithms in the context of constraint satisfaction problems (CSPs).
Belief propagation is a classical message-passing algorithm for
computing marginal distributions of a Markov random field. It is exact
only on tree graphs, but in many settings it is a good heuristic for
general graphs. I will introduce belief propagation with an example
application to the decoding of Fountain Codes. In the case of the
erasure channel, I will show an efficient procedure for computing the
success probability of the algorithm for finite-length codes.
Another message-passing algorithm that has recently attracted attention
with its ground-breaking performance is survey propagation. It is
designed for random CSPs, and in that setting it outperforms all other
algorithms known. It is motivated by modern approximation methods in
statistical physics, which are associated with the structure of the
solution space of typical problems. In my talk, I will demonstrate a
novel family of Markov random fields such that computing the marginal
distributions via belief propagation leads to a family of algorithms
generalizing survey propagation. This result highlights a general
combinatorial path towards designing message-passing algorithms that are
potentially more powerful than a naive application of belief
propagation.
Finally, I will describe some recent progress in our understanding of
the combinatorial properties of the solution space of constraint
satisfaction problems, as well as directions for future research.
Short Biography:
Elitza Maneva is a PhD candidate in the Electrical Engineering and
Computer Science Department at UC Berkeley with a designated emphasis on
Communication, Computation, and Statistics. She expects to graduate in
May 2006. She obtained her Bachelor's degree in Engineering and Applied
Science from the California Institute of Technology. During her studies
she has also done research at IBM Almaden, EPFL, and IBM T.J.Watson. Her
research interests are in the design and analysis of practical
algorithms for problems modeled by random structures. Her thesis work is
on belief propagation algorithms for random constraint satisfaction and
optimization problems, including random SAT and error-correcting
codes. She has also done research on sensor networks, game theory, and
quantum communication.