On Optimal Control of Stochastic Linear Hybrid Systems
Susmit Jha and Vasumathi Raman. On Optimal Control of Stochastic Linear Hybrid Systems Controllers. 14th International Conference on Formal Modelling and Analysis of Timed Systems (FORMATS), 2016
Download
Abstract
Cyber-physical systems are often hybrid consisting of both discrete and continuous subsystems. The continuous dynamics in cyber-physical systems could be noisy and the environment in which these stochastic hybrid systems operate can also be uncertain. We focus on multimodal hybrid systems in which the switching from one mode to another is determined by a schedule and the optimal finite horizon control problem is to discover the switching schedule as well as the control inputs to be applied in each mode such that some cost metric is minimized over the given horizon. We consider discrete-time control in this paper. We present a two step approach to solve this problem with respect to convex cost objectives and probabilistic safety properties. Our approach uses a combination of sample average approximation and convex programming. We demonstrate the effectiveness of our approach on case studies from temperature-control in buildings and motion planning.
BibTeX
@Inbook{Jha2016,
author="Jha, Susmit
and Raman, Vasumathi",
editor="Fr{\"a}nzle, Martin
and Markey, Nicolas",
title="On Optimal Control of Stochastic Linear Hybrid Systems",
bookTitle="Formal Modeling and Analysis of Timed Systems: 14th International Conference, FORMATS 2016, Quebec, QC, Canada, August 24-26, 2016, Proceedings",
year="2016",
publisher="Springer International Publishing",
address="Cham",
pages="69--84",
isbn="978-3-319-44878-7",
doi="10.1007/978-3-319-44878-7_5",
url="http://dx.doi.org/10.1007/978-3-319-44878-7_5"
}