A framework for modeling non-stationary Markov decision processes and the key decision making problems in these environments
