PROCESS CONTROL USING CONTROLLED FINITE MARKOV CHAINS WITH AN APPLICATION TO A MULTIVARIABLE HYBRID PLANT

Enso Ikonen

2007

Abstract

Predictive and optimal process control using finite Markov chains is considered. A basic procedure is outlined, consisting of discretization of plant input and state spaces; conversion of a (a priori) plant model into a set of finite state probability transition maps; specification of immediate costs for state-action pairs; computation of an optimal or a predictive control policy; and, analysis of the closed-loop system behavior. An application, using a MATLAB toolbox developed for MDP-based process control design, illustrates the approach in the control of a multivariable plant with both discrete and continuous action variables. For problems of size of practical significance (thousands of states), computations can be performed on a standard office PC. The aim of the work is to provide a basic framework for examination of nonlinear control, emphasizing in on-line learning from uncertain data.

Paper Citation

in Harvard Style

Ikonen E. (2007). PROCESS CONTROL USING CONTROLLED FINITE MARKOV CHAINS WITH AN APPLICATION TO A MULTIVARIABLE HYBRID PLANT . In Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO, ISBN 978-972-8865-84-9, pages 78-85. DOI: 10.5220/0001615300780085

in Bibtex Style

@conference{icinco07,
author={Enso Ikonen},
title={PROCESS CONTROL USING CONTROLLED FINITE MARKOV CHAINS WITH AN APPLICATION TO A MULTIVARIABLE HYBRID PLANT},
booktitle={Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO,},
year={2007},
pages={78-85},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001615300780085},
isbn={978-972-8865-84-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO,
TI - PROCESS CONTROL USING CONTROLLED FINITE MARKOV CHAINS WITH AN APPLICATION TO A MULTIVARIABLE HYBRID PLANT
SN - 978-972-8865-84-9
AU - Ikonen E.
PY - 2007
SP - 78
EP - 85
DO - 10.5220/0001615300780085