A new risk-sensitive maximum principle

Journal article

In this paper, a new maximum principle for the risk-sensitive control problem is established. One important feature of this result is that it applies to systems in which the diffusion term may depend on the control. Such control dependence gives rise to interesting phenomena not observed in the usual setting where control independence of the diffusion term is assumed. In particular, there is an additional second order adjoint equation and additional terms in the maximum condition that involve this second order process as well as the risk-sensitive parameter. Moreover, contrary to a conventional maximum principle, the first-order adjoint equation involved in our maximum principle is a nonlinear equation. An advantage of considering this new type of adjoint equation is that the risk-sensitive maximum principle derived is similar in form to its risk-neutral counterpart. The approach is based on the logarithmic transformation and the relationship between the adjoint variables and the value function. As an example, a linear-quadratic risk-sensitive problem is solved using the maximum principle derived. © 2005 IEEE.

Authors: Lim, A; Zhou, X

• Journal: IEEE Transactions on Automatic Control
• Volume: 50
• Issue: 7
• Pages: 958-966
• Publication date: 2005-07-01
• DOI: 10.1109/TAC.2005.851441
• ISSN: 0018-9286
• Language: English
• Keywords: Backward stochastic differential equations; Risk-sensitive control; Logarithmic transformation; Adjoint equatious; Maximum principle