View source for On the Control of Jump Linear Markov Systems with Markov State Estimation

{{HTDB paper
| authors = Vijay Gupta, Richard M. Murray, Babak Hassibi
| title = On the Control of Jump Linear Markov Systems with Markov State Estimation
| source = 2003 American Control Conference
| year = 2002
| type =  Conference 
  Paper
| funding = AFOSR/info
| url = http://www.cds.caltech.edu/~murray/preprints/gmh03-acc.pdf
| abstract = 
We analyze a jump linear Markov system being stabilized using a zero-order hold controller. We consider the case when the Markov state is associated with the probability distribution of a measured variable. We assume that the Markov state is not known, but rather is being estimated based on the observations of the variable. We present conditions for the stability of such a system and also solve the optimal LQR control problem for the case when the state estimate update uses only the last observation value. In particular we consider a suboptimal causal version of the Viterbi estimation algorithm and show that a separtion property does not hold between the optimal control and the Markov state estimate. Some simple examples are also presented.

| flags = 
| tag = gmh03-acc
| id = 2002i
}}