Conference Proceeding

Consensus formation in a switched Markovian dynamical system

Proceedings of the IEEE Conference on Decision and Control 01/2009; DOI:10.1109/CDC.2008.4739488 pp.3547 - 3552 In proceeding of: Decision and Control, 2008. CDC 2008. 47th IEEE Conference on
Source: IEEE Xplore

ABSTRACT We address the problem of distributively obtaining average-consensus among a connected network of sensors that each respectively track, by linear stochastic approximation, the stationary distribution of an ergodic Markov chain with slowly switching regimes. A hyper-parameter modeled as a Markov process on a slow time-scale modulates the regime of each observed Markov chain, thus at any given time the hyper-parameter determines what stationary distribution will be estimated by each sensor. If the Markov chains share a common stationary distribution conditional on the regime, it is shown the sequence of sensor state-values weakly-converge to an average-consensus under the distributed linear consensus-filter for all network communication graphs. Conversely, if the Markov chains have unique stationary distributions in each regime, then the average-consensus can be achieved only when sensors communicate state-values at a frequency that is on the same time-scale as the frequency at which they observe the fast Markov chain. In this scenario, unlike a static consensus filter, the state-value communication graph need not be connected for an average-consensus to be reached, however this is true only when the communication graph of observation data satisfies a specific connectivity condition. Simulations illustrate our conclusions and observation model.

0 0
 · 
0 Bookmarks
 · 
27 Views
  • Source
    Article: Agreement over random networks
    [show abstract] [hide abstract]
    ABSTRACT: We consider the agreement problem over random information networks. In a random network, the existence of an information channel between a pair of units at each time instance is probabilistic and independent of other channels; hence, the topology of the network varies over time. In such a framework, we address the asymptotic agreement for the networked units via notions from stochastic stability. Furthermore, we delineate on the rate of convergence as it relates to the algebraic connectivity of random graphs.
    IEEE Transactions on Automatic Control 12/2005; · 2.11 Impact Factor
  • Source
    Article: Stability of multiagent systems with time-dependent communication links
    [show abstract] [hide abstract]
    ABSTRACT: We study a simple but compelling model of network of agents interacting via time-dependent communication links. The model finds application in a variety of fields including synchronization, swarming and distributed decision making. In the model, each agent updates his current state based upon the current information received from neighboring agents. Necessary and/or sufficient conditions for the convergence of the individual agents' states to a common value are presented, thereby extending recent results reported in the literature. The stability analysis is based upon a blend of graph-theoretic and system-theoretic tools with the notion of convexity playing a central role. The analysis is integrated within a formal framework of set-valued Lyapunov theory, which may be of independent interest. Among others, it is observed that more communication does not necessarily lead to faster convergence and may eventually even lead to a loss of convergence, even for the simple models discussed in the present paper.
    IEEE Transactions on Automatic Control 03/2005; · 2.11 Impact Factor
  • Source
    Article: Consensus problems in networks of agents with switching topology and time-delays
    [show abstract] [hide abstract]
    ABSTRACT: In this paper, we discuss consensus problems for networks of dynamic agents with fixed and switching topologies. We analyze three cases: 1) directed networks with fixed topology; 2) directed networks with switching topology; and 3) undirected networks with communication time-delays and fixed topology. We introduce two consensus protocols for networks with and without time-delays and provide a convergence analysis in all three cases. We establish a direct connection between the algebraic connectivity (or Fiedler eigenvalue) of the network and the performance (or negotiation speed) of a linear consensus protocol. This required the generalization of the notion of algebraic connectivity of undirected graphs to digraphs. It turns out that balanced digraphs play a key role in addressing average-consensus problems. We introduce disagreement functions for convergence analysis of consensus protocols. A disagreement function is a Lyapunov function for the disagreement network dynamics. We proposed a simple disa
    Automatic Control, IEEE Transactions on. 49(9):1520-1533.

Full-text

View
0 Downloads
Available from

Keywords

common stationary distribution conditional
 
communication graph
 
distributed linear consensus-filter
 
ergodic Markov chain
 
fast Markov chain
 
hyper-parameter modeled
 
linear stochastic approximation
 
Markov chains
 
Markov chains share
 
Markov process
 
network communication graphs
 
observation data
 
observation model
 
observed Markov chain
 
sensor state-values weakly-converge
 
slow time-scale modulates
 
specific connectivity condition
 
state-value communication graph
 
static consensus filter
 
stationary distribution
 

K. Topley