Caltech Logo

Control Meets Learning Seminar

Wednesday, October 28, 2020
9:00am to 10:00am
Add to Cal
Online Event
The long and short of stochastic stability in multi-agent systems
Jeff Shamma, Professor, Electrical and Computer Engineering, King Abdullah University of Science and Technology,

System models often include the presence of relatively infrequent random events, such as exploration, mutations, or errors. The concept of stochastic stability concerns how such random effects can impact long run behavior, even as they become progressively infrequent. This talk presents an overview of stochastic stability as applied to finite state Markov chain models. The talk begins with a tutorial introduction to stochastic stability and its application in a variety of settings, with a particular emphasis on multi-agent systems, namely: (1) large population signaling games, (2) coordination games, and (3) programmable self-assembly. The talk continues with a comparison and contrast of stochastic stability with the concept of an evolutionarily stable strategy (ESS), a related notion that also examines the effect of random perturbations in multi-agent population dynamics. The comparison is through the introduction of a so-called transitive-stability graph, or TS-graph, that leverages the definition of an ESS to reach stochastic stability conclusions. The talk concludes with a discussion of how short and medium run behavior can distinguish dynamics that exhibit identical long run stochastic stability properties.

For more information, please contact Jolene Brink by phone at 6263952813 or by email at or visit Control Meets Learning Website.