Abstract:

Infinite horizon optimization problems arise in many contexts where a terminal expiration date is not obvious or explicitly given. Examples include long-term investment, natural resource management, and government planning. Traditional approaches from dynamic programming and Markov decision processes only apply in low dimensions. We will present discuss various approximations for higher dimensions including an iterative linearization method that exploits convexity of the value function. We will illustrate the method with examples from finance and control.