z-logo
open-access-imgOpen Access
UTILITY-OPTIMAL STOPPING IN A DENUMERABLE MARKOV CHAIN
Author(s) -
Yoshinobu Kadota,
Masami Kurano,
Masami Yasuda
Publication year - 1996
Publication title -
bulletin of informatics and cybernetics
Language(s) - English
Resource type - Journals
eISSN - 2435-743X
pISSN - 0286-522X
DOI - 10.5109/13451
Subject(s) - markov chain , optimal stopping , mathematics , countable set , markov chain mixing time , statistics , combinatorics , markov model , mathematical optimization , computer science , markov property
This paper is concerned with a general utility of the optimal stopping problem for denumerable Markov chains. The validity of the one-step look ahead (OLA) stopping time is shown under a general utility criteria. It is developed from the view points of the optimality and a "riskaverse" or "riskseeking" characterization. The results are applied to the case of a exponential utility function and illustrated by a simple example.

The content you want is available to Zendy users.

Already have an account? Click here to sign in.
Having issues? You can contact us here
Accelerating Research

Address

John Eccles House
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom