Stochastic Games on a Product State Space

We examine so-called product-games with an aperiodic transition structure, with respect to the average reward, for which we present an approach based on communicating states. For the general n-player case, we establish the existence of 0-equilibria. In addition, for the special case of two-player zero-sum games of this type, we show that both players have stationary 0-optimal strategies.