Text this: Empirical approximation of Nash equilibria in finite Markov games with discounted payoffs.