Monotonicity in a Markov Decision Process

Concavity of optimal costs and monotonicity of optimal actions are established for a Markov decision problem in which state space and action space are ordered, but in which the cost functions do not possess properties commonly used to establish monotonicity. The proof is elementary, but depends heavily on the binomial character of the transition probabilities.