Risk-Sensitive and Risk-Neutral Optimality in Markov Decision Chains; a Unified Approach

0377685 - ÚTIA 2013 RIV SK eng C - Konferenční příspěvek (zahraniční konf.)
Sladký, Karel
Risk-Sensitive and Risk-Neutral Optimality in Markov Decision Chains; a Unified Approach.
Quantitative Methods in Economics (Multiple Criteria Decision Making XVI). Bratislava: Vydavatelstvo EKONÓM, 2012 - (Reiff, M.), s. 201-205. ISBN 978-80-225-3426-0.
[Quantitative Methods in Economics (Multiple Criteria Decision Making XVI). Bratislava (SK), 30.05.2012-01.06.2012]
Grant CEP: GA ČR GAP402/11/0150; GA ČR GAP402/10/0956
Institucionální podpora: RVO:67985556
Klíčová slova: discrete-time Markov decision chains * exponential utility functions * risk-sensitive coefficient * connections between risk-sensitive and risk-neutral models
Kód oboru RIV: BB - Aplikovaná statistika, operační výzkum
http://library.utia.cas.cz/separaty/2012/E/sladky-risk-sensitive and risk-neutral optimality in markov decision chains a unified approach.pdf

In this note we consider Markov decision chains with finite state space and compact actions spaces where the stream of rewards generated by the Markov processes is evaluated by an exponential utility function (so-called risk-sensitive model) with a given risk sensitivity coefficient. If the risk sensitivity coefficient equals zero (risk-neutral case) we arrive at a standard Markov decision chain. Necessary and sufficient optimality conditions along with equations for average optimal policies both for risk-neutral and risk-sensitive models will be presented and connections and similarity between these approaches will be discussed.
Trvalý link: http://hdl.handle.net/11104/0209781