This paper considers consensus problems with Markovian switching networks and noisy measurements, and stochastic approximation is used to achieve mean square consensus. The main contribution of this paper is to obtain ergodicity results for backward products of degenerating stochastic matrices with Markovian switches, and subsequently prove mean square consensus for the stochastic approximation algorithm. Our ergodicity proof is to build a higher dimensional dynamical system and exploit its two-scale feature.

Additional Metadata
Persistent URL dx.doi.org/10.1109/CDC.2014.7039727
Conference 2014 53rd IEEE Annual Conference on Decision and Control, CDC 2014
Citation
Huang, M, Li, T. (Tao), & Zhang, J.-F. (Ji-Feng). (2014). Stochastic approximation for consensus over general digraphs with Markovian switches. In Proceedings of the IEEE Conference on Decision and Control (pp. 2216–2221). doi:10.1109/CDC.2014.7039727