Technical Note—Characterizing and Computing the Set of Nash Equilibria via Vector Optimization

Published Online:https://doi.org/10.1287/opre.2023.2457

Abstract

Nash equilibria and Pareto optimality are two distinct concepts when dealing with multiple criteria. It is well known that the two concepts do not coincide. However, in this work, we show that it is possible to characterize the set of all Nash equilibria for any noncooperative game as the Pareto-optimal solutions of a certain vector optimization problem. To accomplish this task, we increase the dimensionality of the objective function and formulate a nonconvex ordering cone under which Nash equilibria are Pareto efficient. We demonstrate these results, first, for shared-constraint games in which a joint constraint is applied to all players in a noncooperative game. In doing so, we directly relate our proposed Pareto-optimal solutions to the best response functions of each player. These results are then extended to generalized Nash games, where, in addition to providing an extension of the above characterization, we deduce two vector optimization problems providing necessary and sufficient conditions, respectively, for generalized Nash equilibria. Finally, we show that all prior results hold for vector-valued games as well. Multiple numerical examples are given and demonstrate that our proposed vector optimization formulation readily finds the set of all Nash equilibria.

1. Introduction

The Nash equilibrium is a fundamental concept in game theory. Proposed by John Nash in his seminal papers (Nash 1950, 1951), the Nash equilibrium notion provides a stable strategy set in a noncooperative game setting. Specifically, these solutions are such that no player can unilaterally reduce her costs when all other players fix their own strategies. Though an equilibrium of a noncooperative game was first introduced as the solution to a special linear program by von Neumann (1928) in a two-player zero-sum setting, a general N-player game is solved via fixed-point arguments. Even for games with convex costs and constraints, fixed-point arguments are required, as demonstrated in Rosen (1965); there always exists a Nash equilibrium for a convex game, but stronger convexity conditions are required to guarantee uniqueness. In this work, we are not concerned with the existence or uniqueness of Nash equilibria. Instead, our aim is to fully characterize, and thus enable the computation of, the set of all Nash equilibria. As such, these results are independent of the set of equilibria being a singleton, containing several or even infinitely many elements, or being an empty set.

A Nash game is defined by a collection of optimization problems. Mathematically, this is encoded by cost functions and constraint sets for each player. Though it is tempting to consider the vector optimization problem constructed from the N-player noncooperative game in which all players simultaneously attempt to minimize their costs, the set of minimizers of this vector optimization problem generally does not coincide with the set of the Nash equilibria for the game. Our primary motivation within this work is to construct a particular vector optimization problem that provides exactly the set of Nash equilibria as its minimizers. This allows us to think about Nash equilibria as just a special type of Pareto efficiency.

Importantly, where the appropriate vector optimization algorithms exist, this new optimization construction of the set of Nash equilibria allows for a novel computational technique that provides all Nash equilibria. This proposed technique does not require any fixed-point iterations. For example, algorithms—like those proposed in Armand (1993), Van Tu (2017), and Tohidi and Hassasi (2018)—can be used to solve the corresponding linear vector optimization problems appearing in the Pareto characterization of the set of Nash equilibria for games with linear objectives and constraints. For convex and nonconvex games, the corresponding vector optimization problems can in practice only be solved approximately. The corresponding relation between epsilon Pareto-optimal solutions and epsilon Nash equilibria and the development of numerical algorithms is ongoing work; for the convex case, see Feinstein et al. (2023). The present paper will therefore focus on the equivalent characterization holding for all noncoorporative games and illustrate the theoretical results both on games that can be solved analytically and on linear games, where existing vector optimization algorithms can be applied to compute the set of Nash equilibria.

The problem of finding a single Nash equilibrium has been well studied for (nearly) all classes of games. For instance, Rosen (1965) provides an efficient algorithm to compute the unique equilibrium for a class of convex games. However, for games with multiple equilibria, understanding the entire set of Nash equilibria is vitally important to fully characterize the possible (jointly) rational behaviors of the players in the game. Despite the importance of finding all Nash equilibria in practice, this problem has received less attention, and results are so far limited to specific classes of games. There have been numerous studies on computing all Nash equilibria for finite games; we refer the interested reader to, for example, McKelvey and McLennan (1996), Parsopoulos and Vrahatis (2004), Herings and Peeters (2005), Wu et al. (2015), references therein, and citations thereof. We also wish to highlight Judd et al. (2012), which utilizes algebraic geometry to find (a superset of) all Nash equilibria in continuous games without binding constraints, that is, where the equilibria lie within the interior of the feasible region. Generalized Nash games have additionally been approached as quasi-variational inequalities (Harker 1991). Such an approach allows for the computation of (a superset of) all Nash equilibria by considering an infinite number of variational inequalities in a shared-constraint setting (Nabetani et al. 2011). In contrast to these aforementioned approaches, our methodology merely relies on the appropriate vector optimization algorithms to compute all Nash equilibria. In fact, our approach can be readily extended to vector games (Corley 1985, Bade 2005) in which the computation of Nash equilibria is often considered a challenge because of the large number of solutions and for which, as far as the authors are aware, there do no exist any algorithms to compute all equilibria for general classes of problems. To highlight the novelty of our approach, we provide numerical examples in which we compute all Nash equilibria in settings where these prior cited approaches cannot be applied.

The primary contribution of this work is threefold. First, we provide an equivalent characterization of the set of all Nash equilibria of a game as Pareto-optimal points of a certain vector optimization problem. This holds for all noncooperative games without any further assumptions. We highlight in Remark 2.9 a relation between the solutions of the specified vector optimization problem and the best response functions of all players; this connects our results to the well-known simple characterization of the set of Nash equilibria as the intersection of the graphs of the best response functions for all players (see, e.g., the introduction section in Beck and Stein 2023). We will illustrate this characterization on a simple game with nonconvex cost functions. Second, for generalized Nash games, we construct two bounding vector optimization problems that provide, respectively, necessary and sufficient conditions for the Nash equilibria and correspond to specific shared-constraint games considering the union or intersection of the players’ constraints, respectively. Furthermore, and as a third contribution, this vector optimization reformulation of the Nash game permits us to consider optimization-based methods for finding all Nash equilibria. This is in contrast to the typical approaches that construct just a single Nash equilibrium as well as the aforementioned works on the computation of all Nash equilibria for specific classes of games. This extends well beyond finite games to provide the theoretical foundation for a numerical technique to find all Nash equilibria for, for example, convex games or even for vector-valued games.

The organization of this paper is as follows. In Section 2, the set of Nash equilibria for a Nash game with a shared constraint are completely characterized as the Pareto solutions to an appropriate vector optimization problem with a nonconvex ordering cone. Because of the special structure of this cone, we present a decomposition that allows for its tractable use. We extend this result in Section 3 to study the use of the proposed vector optimization problems for generalized Nash games. In such a setting, we first construct a characterization of the set of Nash equilibria. Second, we use our vector optimization framework to construct bounds around the set of Nash equilibria. Specifically, we find that one proposed vector optimization problem leads to a necessary condition, and a different one to a sufficient condition for the Nash equilibria. We further extend these results in Section 4 to study vector-valued games. Importantly, all of the prior results hold under only minimal modifications to the ordering cone. We present a number of illustrative examples throughout this work to demonstrate the application of the proposed results for the computation of the set of Nash equilibria.

2. Shared-Constraint Nash Games as Vector Optimization

In this section, we will construct a particular vector optimization problem whose Pareto-optimal points coincide with, and thus equivalently characterize, the set of equilibria of shared-constraint Nash games. Section 2.1 will introduce the basic notation and definitions of Nash equilibria, vector optimization, and Pareto-optimal points. Section 2.2 will contain the main results of this section on the characterization of the set of equilibria of shared-constraint Nash games as Pareto-optimal points of a certain vector optimization problem. In Section 2.3, we will illustrate these results with examples.

2.1. Background and Notation

Let us now introduce the two disparate frameworks for studying competing interests in optimization: Pareto optimality and Nash equilibria. In doing so, we will provide basic definitions and notation which will be utilized for the remainder of this work.

Throughout this work, we will study N2-player noncooperative games. We will occasionally refer to these as Nash games as the relevant solution concept is that of a Nash equilibrium (see Definition 2.2). Player i (for i=1,,N) of this game considers strategies in the linear space Xi; we do not impose any condition that Xi and Xj are equal. In addition, each player i has a cost function fi:j=1NXjR she seeks to minimize. This cost function fi(x) for xj=1NXj may depend on player i’s strategy xiXi as well as the strategy chosen by all other players, xijiXj. Finally, in order to complete the setup of the N-player noncooperative game, we wish to introduce the notion of a shared constraint Xj=1NXj, which must be satisfied by the joint strategy xj=1NXj of all players. This shared-constraint condition is common in the literature (see, e.g., Rosen 1965, Facchinei et al. 2007).

Remark 2.1.

By utilizing the constraint set Xj=1NXj in the product of the linear spaces Xi, we allow for either pure or mixed strategy Nash equilibria. Furthermore, the use of the general constraint set X permits us to study, for example, both discrete or continuous games. For example, in a two-player game in which both players can only select in the strategy set {0, 1}, X1=X2=R with X={0,1}2. If one allows mixed strategies in this game, which are encoded by the probability xi[0,1] as the probability of selecting strategy 1, one would set X=[0,1]2.

Given all other players fix their strategies xi*jiXj, player i seeks to optimize

minxiXi{fi(xi,xi*)|(xi,xi*)X}.(1)

If this is the aim of all players i=1,,N, this leads to the definition of a Nash equilibrium.

Definition 2.2.

Consider the shared-constraint Nash game with N players described by (1). That is, player i has strategies in the space Xi, cost function fi:j=1NXjR, and the joint strategies must satisfy a shared feasibility condition xXj=1NXj. A joint strategy x*X is called a Nash equilibrium if, for any player i, fi(xi,xi*)fi(x*) for any strategy xiXi such that (xi,xi*)X. The set of all Nash equilibria will be denoted by NE(f,X).

Later in this work, we will relax the assumption of the shared constraint to study generalized Nash games (see Section 3). We will, additionally, relax the assumption that the cost functions are real valued to study vector-valued games in Section 4.

The main focus of this work is the relation between the set of Nash equilibria and the Pareto-optimal points of a certain vector optimization problem. Let us now introduce the basic notations needed for that. Consider a linear space Z. A set CZ is called a cone if αCC for all α0. A cone CZ introduces a binary relation C on Z via

xCyyxC,
for x,yZ. This relation is reflexive. If the cone C is additionally convex, that is, if it holds C+CC, then the relation C is reflexive and transitive, and thus defines a preorder relation on Z. If C is not convex, then the relation C is not transitive, and so it is not a preorder relation and is sometimes called a “nonconvex preference” (for a discussion of nonconvex preferences, see Anderson 1985). We will also, in that case, refer to the cone C as the ordering cone of Z. From now on, we consider a linear space Z endowed with an ordering cone C. When Z=R and C=R+, we will leave off the explicit notation for the cone C, that is, xy if and only if yxR+ for x,yR.

A vector optimization problem is an optimization problem of the form

C-min{g(x)|xX}(2)
for some feasible region XX for a linear space X, a function g:XZ, and an ordering cone CZ. Note that we do not necessarily assume the cone C to be convex. The notation C-min used in (2) means that one is minimizing the vector-valued function g, where the usage of C in this notation emphasizes that one minimizes with respect to (w.r.t.) the binary relation introduced by the ordering cone C. To minimize this vector-valued function, and thus to solve the vector optimization problem (2), means to compute the set of minimizers, also called Pareto-optimal points, or efficient points, which are defined as follows. We use the notation g[X]{g(x)|xX}Z for the image of the feasible set X.

Definition 2.3.

The set of minimizers or Pareto-optimal points of problem (2) is defined as

C-argmin{g(x)|xX}={x*X|g(x*)Cg(x)xXwithg(x)Cg(x*)}.

This is the set of feasible points x* that map to minimal elements of g[X], that is, the set of points x*X such that if g(x)Cg(x*) for some xX, then g(x*)Cg(x) holds.

The above definitions can be found in (Jahn 2011, definitions 3.1(c), 4.1(a), and 7.1(a)) for the case of a convex cone C and partially ordered normed space Z (but can also be stated on the general level provided here, i.e., for a cone C and linear space Z). They also coincide with the more general definitions given in (Tammer and Weidner 2020, chapter 6) by setting the reference set there to be D=C\(C).

2.2. Nash Equilibria as Pareto-Optimal Points

In this section, we want to deduce a relation between the set of Nash equilibria and the Pareto-optimal points of a certain vector optimization problem. Note that the Definition 2.2 of a Nash equilibrium can equivalently be written as follows: the joint strategy x*X is called a Nash equilibrium if, for any player i,

xi*argminxiXi{fi(xi,xi*)|(xi,xi*)X}.(3)

Naively, one may attempt to construct the vector optimization problem

R+N-min{f(x)|xX}(4)
with f(x)(f1(x),f2(x),,fN(x)) from the N-player noncooperative game. However, it is well known that the minimizers of this vector optimization problem generally do not coincide with any of the Nash equilibria for the game (see, e.g., Tadelis 2013, chapter 3.3). This is because, in the underlying optimization problem for each player i in (3), the strategy xi* of all other players is fixed. We will now construct a vector optimization problem that will exactly take these considerations into account.

In order to facilitate this, we will need two modifications to (4). First, we need to put the strategy in the objective as well such that one can consider, for each player, xi and fi(x) at the same time. That is, we will set g(x)=(x,f(x)) as the objective function in (2) instead of g(x)=f(x), as was done in (4). Thus, the linear space Z in (2) is chosen to be i=1NXi×RN. Second, we will define a particular ordering cone that can “fix” the component xi of the vector x for player i. That is, we will consider the following vector optimization problem

C-min{(x,f(x))|xX}(5)
with ordering cone
C{(x,y)i=1NXi×RN|i{1,,N}:xi=0,yi0},(6)
where the zero in xi=0 is the zero in the space jiXj. Though the ordering cone C is not convex, it is of the form C=i=1NCi for convex cones Ci defined as
Ci(j=1i1{0Xj})×Xi×(j=i+1N{0Xj})×Ri1×R+×RNi,(7)
where 0Xj denotes the zero in the space Xj. Whenever the space is clear from the context, we will, for the remainder of this work, drop the subscript notation and just use 0 for the zero in the corresponding space. The decomposition of C into the cones Ci will be utilized in the following and plays a particular role in the examples via Corollary 2.8. The following remarks motivate and illustrate the choice of the vector optimization problem (5) and its cone (6).

Example 2.4.

Let us, for illustration purposes, consider the cone C in the easiest setup of a two-player game (N = 2) with X1=X2=R. Then, CR4 is given by

C={(x,y)R2×R2|i{1,2}:xi=0,yi0}=(R×{0}×R+×R)({0}×R×R×R+)=C1C2.(8)

For a two-player game (N = 2) with X1=X2=R2, the cone CR6 is given by

C=(R2×{(0,0)}×R+×R)({(0,0)}×R2×R×R+)=C1C2.(9)

Remark 2.5.

Note the roles the different components in the cones C (respectively, Ci) play. Consider the following three ordering cones in R:

  • The component R+ is the natural ordering cone and characterizes the usual order relation xyxR+yyxR+ that is, for example, considered in player i’s optimization problem (1) (see also (3), when player i minimizes her objective function fi).

  • The component {0} is an ordering cone that allows us to “fix” the corresponding component in the sense that x{0}yyx{0}x=y; that is, the only element that can be compared with x is x itself. This becomes important because we need, in player i’s optimization problem (1), to fix the other players strategies to be xi*.

  • The component R is an ordering cone that allows us to ignore the corresponding component in the sense that xRyyxRxRy is true for all x,yR. That is, with respect to this ordering cone, every point would be minimal. Thus, with respect to the corresponding component, where this ordering cone is considered, nothing needs be optimized, so this component is ignored. This becomes important as player i does not care about the cost functions of his opponents in his optimization problem (1). Additionally, the full space also appears as the ordering cone in the component concerned with the strategy xi of player i. In such a capacity, this ordering cone models the idea that there are no further restrictions player i imposes on his own strategy (besides the constraint set X that is incorporated already in Problem (5)).

The interpretations of the last two cones above hold analogously if one considers the cones {(0,0)} or R2 if Xi=R2, or, for more general Xi, the cones {0Xi} or Xi.

Consider now the specific structure of the preferences induced by the ordering cone C and its decomposition C=i=1NCi. These structures are central to relating the set of Nash equilibria to the Pareto-optimal points of (5) as is provided in Theorem 2.6 below. Let us first study the cone Ci: Consider x,x¯i=1NXi; then (x,f(x))Ci(x¯,f(x¯)) for some player i if and only if xi=x¯i and fi(x)fi(x¯). That is, for a “fixed” strategy of all other players, the cost of player i is greater under x than x¯. For the full cone C, the relation (x,f(x))C(x¯,f(x¯)) holds if and only if there exists some player i such that (x,f(x))Ci(x¯,f(x¯)). From this, the correspondence to the Nash equilibrium becomes clear, as both the Nash and the Pareto solutions with ordering cone C focus on a comparison in which the strategies of all other players have been “fixed.”

We can now present the main result of this work—the equivalence between the set of all Nash equilibria for the N-player game (1) and the Pareto minimizers of the vector optimization problem (5).

Theorem 2.6.

Consider the shared-constraint noncooperative game (1). The strategy x* is a Nash equilibrium if and only if it is a minimizer of (5), that is,

NE(f,X)=C-argmin{(x,f(x))|xX},
where the ordering cone C is defined in (6).

To prove the theorem, we will need the following lemma. Recall from Definition 2.3 that x*C-argmin{(x,f(x))|xX} if and only if (x,f(x))C(x*,f(x*)) for any xX such that (x,f(x))C(x*,f(x*)).

Lemma 2.7.

It holds that C-argmin{(x,f(x))|xX}=i=1NCi-argmin{(x,f(x))|xX}, where C and Ci are as defined in (6) and (7).

Proof.

Let x*C-argmin{(x,f(x))|xX} and assume x*Ci-argmin{(x,f(x))|xX} for some player i. Therefore, by the construction of the Ci minimizers, there exists some xX such that xi=xi* with fi(x)<fi(x*). By construction of the cone C, this implies (x,f(x))C(x*,f(x*)) as well. However, as x* is a C minimizer, it must follow that (x,f(x))C(x*,f(x*)), that is, there exists some player j such that xj=xj* and fj(x)fj(x*). If ji, then x=x* (i.e., fi(x)=fi(x*)); if j = i, then fi(x)fi(x*). In either case, we recover a contradiction.

Now consider x*i=1NCi-argmin{(x,f(x))|xX} and assume that x*C-argmin{(x,f(x))|xX}, that is, there is an xX with (x,f(x))Ci(x*,f(x*)) for some i such that there is no j=1,,N with (x,f(x))Cj(x*,f(x*)). In particular, (x,f(x))Ci(x*,f(x*)) does not hold, which contradicts x*Ci-argmin{(x,f(x))|xX}. □

Proof of Theorem 2.6.

Consider x* to be a Nash equilibrium of the game. By definition of the Nash equilibrium, for any player i, if xX with xi=xi*, then fi(x)fi(x*). Therefore, if (x,f(x))C(x*,f(x*)), then xi=xi* for some i, and, from being a Nash equilibrium, we know fi(x)fi(x*), that is, (x,f(x))C(x*,f(x*)).

Now consider x* to be a minimizer of the vector optimization problem, that is, x*C-argmin{(x,f(x))|xX}. For each player i, consider xi=xi* with xX. Then, if fi(x)fi(x*), the minimality of x* and Lemma 2.7 imply fi(x)fi(x*). This is the definition of the Nash equilibrium; that is, for every player i, (xi,xi*)X implies fi(xi,xi*)fi(x*). □

The following corollary is immediate and shows that x* is a Nash equilibrium if and only if it is a minimizer with respect to Ci for each player i. We wish to highlight this result, as it can be directly expanded to generalized games; see Section 3.1. Additionally, this construction is useful in the subsequent examples, as each of these cones Ci is convex in contrast to the full ordering cone C that is nonconvex. This allows for the application of traditional vector optimization algorithms as used, for example, in Examples 3.3 and 4.6 in the more general settings.

Corollary 2.8.

The strategy x* is a Nash equilibrium if and only if x*Ci-argmin{(x,f(x))|xX} for every i=1,,N, that is,

NE(f,X)=i=1NCi-argmin{(x,f(x))|xX}.

Proof.

This follows immediately by Theorem 2.6 and Lemma 2.7. □

Remark 2.9.

As will be made explicit in Examples 2.10 and 2.11, the minimizers Ci-argmin{(x,f(x))|xX} with respect to player i’s ordering cone Ci exactly coincide with the graph of player i’s best response function Bi:jiXj2Xi:

graphBi{x*X|xi*argminxiXi{fi(xi,xi*)|(xi,xi*)X}}.

As such, the result presented in Corollary 2.8 can be reformulated as the well-known characterization (see, e.g., Beck and Stein 2023)

NE(f,X)=i=1NgraphBi,
but it now also allows one to compute graphBi via vector optimization techniques. In this way, Corollary 2.8 can also be seen through the lens of finding a fixed point of the best response functions x*B(x*)(B1(x1*),,BN(xN*)).

Furthermore, for a differentiable and convex game (i.e., fi is differentiable and convex for every player i and X is convex), the first-order sufficient condition of the vector optimization problem Ci-min{(x,f(x))|xX} is equivalent to the first-order sufficient condition for the best response function for player i. That is, by modification of theorem 12.3.1 of Khan et al. (2015) (to account for the possibility that Ci(Ci){0}) and setting g(x)(x,f(x)),

D(g+Ci)(x*,g(x*))(xx*)CiCixX,
where D(g+Ci)(x*,g(x*))(x¯){yYi|tn0,(xn,yn)(x¯,y):g(x*)+tnyng(x*+tnxn)+Ci} is the contingent derivative of the upper image of g at (x*,g(x*)), that is, the mapping whose graph is the cone tangent to the graph of the upper image of g at (x*,g(x*)). This first-order condition is satisfied if and only if xifi(x*)(xixi*)0 for every xiXi such that (xi,xi*)X. This follows from the particular structure of the cone Ci and properties of the contingent derivative. We note that such results can be compared with, for example, the (quasi-)variational inequality sufficient condition for Nash games presented in, for example, Harker (1991) and Facchinei et al. (2007).

2.3. Examples

We will now illustrate the characterization of the set of Nash equilibria as the intersection of minimizers of N vector optimization problems given in Corollary 2.8 on two examples. We chose two simple examples in which the set of Nash equilibria can easily be deduced and the set of minimizers of the vector optimization problems can be easily depicted. More complex examples, where the characterization of the set of Nash equilibria as the intersection of minimizers of N vector optimization problems is computationally exploited, will be presented in the more general settings of Sections 3 and 4.

Example 2.10.

Consider the zero-sum two-player game of odds and evens. In this game, both players must choose to say zero or one simultaneously. If the sum is even, then player 1 receives a payout of one from player 2, and vice versa if the sum is odd. For this game, we will consider the mixed strategies so that player 1 says one with probability x1[0,1], and similarly for player 2 with probability x2[0,1]. The cost functions f1:R2R and f2:R2R, providing the expected losses of each player, are given by

f1(x)=x1x2(1x1)(1x2)+x1(1x2)+(1x1)x2=1+2x1+2x24x1x2,f2(x)=x1x2+(1x1)(1x2)x1(1x2)(1x1)x2=12x12x2+4x1x2.

As the strategies consist of choosing the probabilities xi, the shared constraint set is X[0,1]2 with real-valued strategies X1=X2=R. The cones C and Ci are given as in (8) with Z=R4. Note that because the objective functions are not convex, the subproblems Ci-argmin{(x,f(x))|xX}, despite having a convex ordering cone Ci for i = 1, 2, are not convex vector optimization problems. However, as they are easy to solve, one obtains that the set of Pareto-optimal points of problem C1-argmin{(x,f(x))|xX}R2, also depicted in Figure 1(a), is given by

C1-argmin{(x,f(x))|xX}={(0,x2)|x2[0,0.5)}{(x1,0.5)|x1[0,1]}{(1,x2)|x2(0.5,1]}.

Similarly, the set of Pareto-optimal points of problem C2-argmin{(x,f(x))|xX}, which is depicted in Figure 1(b), is given by

C2-argmin{(x,f(x))|xX}={(x1,1)|x1[0,0.5)}{(0.5,x2)|x2[0,1]}{(x1,0)|x1(0.5,1]}.

From this we find that the intersection of these two sets of Pareto-optimal points, and thus, by Corollary 2.8, the set of Nash equilibria as well as the set of Pareto-optimal points of C-argmin{(x,f(x))|xX}, is given by

NE(f,X)=i=12Ci-argmin{(x,f(x))|xX}={(0.5,0.5)}.

Thus, in this example, there is a unique Nash equilibrium, and this equilibrium consists of the optimal strategy for both players to say zero or one randomly with probability 0.5. This solution can be verified against the minimax approach pioneered from von Neumann (1928), as this is a two-player zero-sum finite game.

Recall from Remark 2.9 that the Pareto-optimal points Ci-argmin{(x,f(x))|xX} provide the graph of the best response function for player i. This can be seen directly in Figure 1(a) and (b).

Figure 1. (Color online) Minimizers for the Decomposed Vector Optimization Problem Associated with the Ordering Cone Ci for Player i in Example 2.10
Example 2.11.

We now consider a modification to the zero-sum game presented in Example 2.10 to make it a general-sum game and such that the set of Nash equilibria will no longer be a singleton. Specifically, player 1 is exactly as in Example 2.10, whereas player 2 has the new cost function so that she is penalized for diverging in her strategy from player 1. Mathematically, this is encoded in the game with cost functions

f1(x)=1+2x1+2x24x1x2,f2(x)=|x1x2|
and constraint set X=[0,1]2 with real-valued strategies X1=X2=R. The cones C,Ci, and space Z are as in Example 2.10 above. The set C1-argmin{(x,f(x))|xX} of the (nonconvex) first problem is exactly as in Example 2.10. The set of minimizers of the (C2-convex) second problem is
C2-argmin{(x,f(x))|xX}={(x,x)|x[0,1]}.

Both are depicted in Figure 2. Their intersection is, by Corollary 2.8, the set of Nash equilibria

NE(f,X)=i=12Ci-argmin{(x,f(x))|xX}={(0,0),(0.5,0.5),(1,1)}.

By Theorem 2.6 or Lemma 2.7, this also coincides with the set of Pareto-optimal points of the vector optimization problem C-argmin{(x,f(x))|xX}. Thus, this Nash game has three equilibria, which can also be seen as the three intersection points marked in black in Figure 2.

Figure 2. (Color online) Minimizers for the Vector Optimization Problem Associated with Ordering Cone Ci for Player i in Example 2.11
Note. The intersections, and thus the Nash equilibria, are highlighted as solid black points.

3. Generalized Nash Games as Vector Optimization

In this section, we consider generalized Nash games, that is, where we do not assume shared constraints as in Section 2. In Section 3.1, the set of generalized Nash equilibria is shown to coincide with the intersection of Pareto-optimal points of N vector optimization problems. In Section 3.2, a relationship between generalized and shared-constraint games constructed from the individual constraints is deduced. In particular, in Theorem 3.6 and Corollary 3.8, a superset and a subset of the set of generalized Nash equilibria are derived based on Pareto-optimal points of certain vector optimization problems corresponding to these shared-constraint games. We illustrate these results with two examples that we study in both sections.

3.1. Characterization of Generalized Nash Equilibria

Within this section, we study generalized Nash games, that is, N-player noncooperative games without the requirement that the constraint sets for all players coincide. That is, each player i has a constraint set Xij=1NXj on the joint strategy of all players. With this modification, a generalized Nash game is one in which, given all other players fix their strategies xi*jiXj, player i seeks to optimize

minxiXi{fi(xi,xi*)|(xi,xi*)Xi}i=1,,N.(10)

This construction leads to an updated definition of a Nash equilibrium.

Definition 3.1.

Consider the generalized game with N players described by (10); that is, player i has strategies in the linear space Xi, cost function fi:j=1NXjR, and the joint strategies must satisfy the feasibility condition xXij=1NXj. The joint strategy x*i=1NXi is called a (generalized) Nash equilibrium if, for any player i, fi(xi,xi*)fi(x*) for any strategy xiXi such that (xi,xi*)Xi. The set of all Nash equilibria will be denoted by NE(f,(Xi)i=1N).

Note again, that the joint strategy x*i=1NXi is called a Nash equilibrium if, for any player i,

xi*argminxiXi{fi(xi,xi*)|(xi,xi*)Xi}.(11)

Immediately, we are able to provide the second main result of this paper, which characterizes the set of generalized Nash equilibria as the intersection of N vector optimization problems. The result of Corollary 3.2 can be readily compared with Corollary 2.8 for shared-constraint games.

Corollary 3.2.

Consider the generalized noncooperative game (10). The strategy x* is a Nash equilibrium if and only if x*Ci-argmin{(x,f(x))|xXi} for every i=1,,N, that is,

NE(f,(Xi)i=1N)=i=1NCi-argmin{(x,f(x))|xXi}.

As the proof of Corollary 3.2 follows comparably to that of Theorem 2.6, we omit its proof. Intuitively, this result follows because the set of Nash equilibria are all of the fixed points of the best response functions and, as discussed in Remark 2.9, Ci-argmin{(x,f(x))|xXi} coincides with the graph of player i’s best response function.

The following two examples will illustrate Corollary 3.2. Both examples are two-player games with linear objectives and constraints. This allows us to utilize methods for linear vector optimization to construct the set of optimizers. Details on this are given in Remark 3.5 below. As far as the authors are aware, no prior methods exist that are able to compute the set of all Nash equilibria in these examples.

Example 3.3.

Consider the N = 2-player generalized game with linear objectives and constraints

x1*argmaxx1R2{2x11+x12|(x1,x2*)X1},x2*argmaxx2R2{2x21+3x22|(x1*,x2)X2},
X1={xR4|(41163131200)(x1x2)(05),x1[0,5]×[0,2.5],x2[0,1.5]×[0,6]},(12)
X2={xR4|(0041151012)(x1x2)(60),x1[0,5]×[0,2.5],x2[0,1.5]×[0,6]},(13)
in which player 1 plays strategy x1=(x11,x12)X1=R2 and player 2 plays strategy x2=(x21,x22)X2=R2. Thus, we consider a generalized game (10) with f1(x)=(2x11+x12),f2(x)=(2x21+3x22), and where the constraint sets are given by (12) and (13).

In order to solve for the set of Nash equilibria, we solve (by Corollary 3.2) the corresponding two linear vector optimization problems Ci-argmin{(x,f(x))|xXi} with polyhedral convex cones Ci for i = 1, 2. The intersection of these two sets of Pareto-optimal points, and thus the set of Nash equilibria, is given by

NE(f,(Xi)i=12)={x1,,x4}
with equilibrium points x1=((0,0),(0,0)), x2=((0,2),(0,6)), x3=((1,2),(1,2)), and x4((1.1876,1.9062),(1.2481,0)).

The following example shows that the proposed method can also find a set of Nash equilibria consisting of infinitely many equilibria.

Example 3.4.

Consider now the following modification of the N = 2-player game given in Example 3.3:

x1*argmaxx1R2{2x11+x12|(x1,x2*)X^1},x2*argmaxx2R2{2x21+3x22|(x1*,x2)X^2},
with X^1=X1{xR4|4x21+x226} and X^2=X2{xR4|4x11+x12163x21+13x22}, where X1 and X2 are defined as in (12) and (13). As in Example 3.3, player 1 plays strategy x1R2, and player 2 plays strategy x2R2. The objectives f1, f2 and the cones C,C1,C2 are as in Example 3.3; only the constraint sets X^i are different from Example 3.3.

As with Example 3.3, in order to solve for the set of Nash equilibria, we solve (by Corollary 3.2) the corresponding two linear vector optimization problems Ci-argmin{(x,f(x))|xX^i} with polyhedral convex cones Ci for i = 1, 2. The intersection of these two sets of Pareto-optimal points, and thus the set of Nash equilibria, is given by

NE(f,(X^i)i=12)={x1}P2P3{x4},
where P2=co{x2,x5} and P3=co{x3,x5} for extremal points x1,,x4 as in Example 3.3, and x5=((0,2.5),(0.125,5.5)). Here, we denote by coA the convex hull of a set A.

Remark 3.5.

Both Examples 3.3 and 3.4 considered in this section are Nash games with linear objectives and linear constraints with Xi=R2. This implies that for each i, all of the considered vector optimization problems Ci-argmin{(x,f(x))|xXi} are linear vector optimization problems. However, the cones Ci are unusual in the sense that they contain lines and have an empty interior. Because of this, standard solvers might not be applied directly. However, these linear vector optimization problems can be transformed into multiobjective linear programs (i.e., into linear vector optimization problems with a natural ordering cone) by multiplying the objective function with the matrix Zi containing the mi generating vectors of the positive dual cone of Ci. The particular structure of Ci will always lead to Zi(x,f(x))=(xi,xi,fi(x)). That is,

R+mi-argmin{(xi,xi,fi(x))|xXi}=Ci-argmin{(x,f(x))|xXi}.
(See Sawaragi et al. (1985, lemma 2.3.4) for pointed polyhedral convex cones, though this can be extended to any polyhedral convex cone (by noting that Ci={x|Zix0} and therefore y^yCi if and only if Zi(y^y)0).) Note that both of the cones Ci in Examples 3.3 and 3.4 have positive dual cones with mi = 5 generating vectors. Hence, in this case, this transformation turns a linear vector optimization problem with a six-dimensional image space into a standard multiobjective linear program with a five-dimensional image space (further dimension reduction is discussed in Feinstein et al. 2023), which can be solved, for example, with Armand (1993), Van Tu (2017), and Tohidi and Hassasi (2018). Note that for the results of this paper, the whole set of minimizers, that is, the set of all Pareto-optimal points of the corresponding vector optimization problems/multiobjective linear programs, is needed. This can be seen clearly in Example 3.4, as there are entire line segments that are Nash equilibria. Algorithms such as those in Evans and Steuer (1973), Hamel et al. (2014), and Rudloff et al. (2017) provide only the set of all efficient extreme points of the problems considered here (though this is true only for Hamel et al. (2014) and Rudloff et al. (2017) because of the particular structure of the objective function used here). In contrast, the algorithms of Armand (1993), Van Tu (2017), and Tohidi and Hassasi (2018) provide the set of all Pareto-optimal points, that is, also the efficient faces.

3.2. Relation to Shared-Constraint Games

We continue our study of generalized Nash games (see Definition 3.1) by finding meaningful shared-constraint games that produce a sandwich principle on the set of Nash equilibria. This is in contrast to the characterization of the set of Nash equilibria from Corollary 3.2 in which a set of N vector optimization problems are considered. Though it may seem counterintuitive to consider such a game when Corollary 3.2 already provides a procedure for determining the set of Nash equilibria for the generalized game, we refer the interested reader to Braouezec and Kiani (2023). For instance, consider section 3.1 in Braouezec and Kiani (2023), in which nations participate in a game to determine their pollution levels (e.g., carbon emissions) subject to individual constraints on desired industrial production. Assuming linear objectives, this generalized game can be written as a linear game and thus solved directly using the methodology proposed in Remark 3.5. However, as proved in Braouezec and Kiani (2023, proposition 2), this generalized game may fail to admit any Nash equilibria at all. But enforcing a shared constraint for all nations (e.g., through treaty obligations) can guarantee the existence of a Nash equilibrium and, as proved below in Theorem 3.6 and, independently, in proposition 1 of Braouezec and Kiani (2023), will always admit any generalized equilibrium as a solution as well.

Motivated thusly, we wish to consider shared-constraint games associated with the generalized Nash game (f,(Xi)i=1N). As expected from the pollution game of (Braouezec and Kiani 2023, section 3.1), the lack of a shared feasibility constraint in (11) makes it impossible to find an appropriate (meaningful) set X that would provide an equivalence between the solutions of the generalized Nash game (11) and the single vector optimization problem (5). Instead, for generalized games, we find that particular constructions of the constraint set X can lead to necessary or sufficient conditions for a Pareto solution to be a generalized Nash equilibrium. This is proved in Theorem 3.6 below. Thus, by solving an appropriate vector optimization problem, one can obtain a superset of the set of all generalized Nash equilibria, whereas by solving a different appropriate vector optimization problem, one can obtain a subset of the set of all generalized Nash equilibria. This will be made precise in the following theorem, which is our third main result of this paper.

Theorem 3.6.

Consider the generalized noncooperative game (10):

  1. Let X¯i=1NXi. The strategy x*X¯ is a Nash equilibrium only if it is a minimizer of (5) with constraint set X¯, that is,

    NE(f,(Xi)i=1N){X¯}C-argmin{(x,f(x))|xX¯},(14)
    with ordering cone C defined as in (6). In particular, if we set X¯=i=1NXi, then every Nash equilibrium is a minimizer of (5) with constraint set X¯, that is,
    NE(f,(Xi)i=1N)C-argmin{(x,f(x))|xi=1NXi}.(15)

  2. Let X¯i=1NXi. The strategy x* is a Nash equilibrium if it is feasible for the generalized game and a minimizer of (5) with constraint set X¯ and ordering cone C as defined in (6), that is,

    NE(f,(Xi)i=1N){C-argmin{(x,f(x))|xX¯}}{i=1NXi}.(16)

Proof.

Recall from Definition 2.3 that x*C-argmin{(x,f(x))|xX} if and only if (x,f(x))C(x*,f(x*)), for any xX satisfying (x,f(x))C(x*,f(x*)).

For part 1 of the theorem, consider x*X¯ to be a Nash equilibrium of the game. By definition of the Nash equilibrium, for any player i, if xXi with xi=xi*, then fi(x)fi(x*). In particular, this is true for xX¯Xi as well. Therefore, if (x,f(x))C(x*,f(x*)), then xi=xi* for some i for which, from a Nash equilibrium, we know fi(x)fi(x*), that is, (x,f(x))C(x*,f(x*)). Therefore (15) trivially follows as NE(f,(Xi)i=1N)i=1NXi.

For part 2, consider x* to be a minimizer of the vector optimization problem with constraints X¯ that is feasible for the original game (i.e., x*i=1NXi). By definition of the Pareto minimizers and Lemma 2.7, for any player i, if xX¯ with xi=xi*, then fi(x)fi(x*). In particular, this is true for xXiX¯ as well. This immediately implies x* is a Nash equilibrium of the game. □

Remark 3.7.

Within the context of Theorem 3.6, the most useful sets to consider are X¯=i=1NXi and X¯=clcoi=1NXi (i.e., the closed and convex hull of i=1NXi). In particular, if we additionally assume that Xi is closed and convex for every i, then the choice of X¯=i=1NXi in (14) leads on the one hand to the largest possible set of Nash equilibria in (14) (as NE(f,(Xi)i=1N)i=1NXi ensures NE(f,(Xi)i=1N){X¯}=NE(f,(Xi)i=1N) for this choice of X¯), and on the other hand to the smallest possible superset in (14) among all closed and convex constraint sets. Similarly, and again assuming that Xi is closed and convex for every i, the choice of X¯=clcoi=1NXi in (16) leads to the largest possible subset in (16) among all closed and convex constraint sets.

We will occasionally refer to C-argmin{(x,f(x))|xi=1NXi} appearing in (15) as the “intersection game,” and to C-argmin{(x,f(x))|xclcoi=1NXi} appearing in (16) when setting X¯=clcoi=1NXi as the “union game,” of the generalized Nash game (10). The names are justified, as the intersection game and the union game are both shared-constraint Nash games by Theorem 2.6. The intersection game as a necessary condition for the generalized Nash equilibrium encoded in (15) is independently presented in a purely game theoretic setting (i.e., without the connection to vector optimization) in Braouezec and Kiani (2023, proposition 1).

By Lemma 2.7, the following corollary is immediate.

Corollary 3.8.

It holds that

NE(f,(Xi)i=1N)i=1NCi-argmin{(x,f(x))|xi=1NXi}.(17)

Furthermore, for any choice of X¯i=1NXi, it holds that

NE(f,(Xi)i=1N){i=1NCi-argmin{(x,f(x))|xX¯}}{i=1NXi}.

Let us now return to the superset relation (15) in Theorem 3.6 (respectively, relation (17) in Corollary 3.8). We now want to characterize those Pareto points in the superset that are not generalized Nash equilibria. This will provide an economic interpretation for the discrepancy between the set of generalized Nash equilibria and the set of Pareto-optimal points.

Note that, in the generalized Nash game, player i seeks to minimize her cost function fi, given the strategy xi*jiXj of the other players in (10). Player i takes, however, only her own constraint set Xi into account. So her set of feasible strategies can produce joint strategies (xi,xi*)Xj for some ji. Thus, it can very well happen that

minxiXi{fi(xi,xi*)|(xi,xi*)Xi}<minxiXi{fi(xi,xi*)|(xi,xi*)i=1NXi}.(18)

So the setup of a generalized Nash game takes on an egocentric point of view. Player i does not care about the consequences of changing her strategy with respect to feasibility of the others. She cares only about her own feasibility and minimizing her own cost. So the setup of a generalized Nash game excludes possible equilibria, where a player could decrease her cost only by strategies that are not feasible for other players. These excluded points are indeed equilibria, but of a shared-constraint Nash game that coincides with the generalized Nash game but considers in the player’s best response problem only the set of strategies that lead to joint strategies that stay feasible for all. Recall from Theorem 2.6 that the Nash equilibria NE(f,i=1NXi) of this shared-constraint game coincide with the set of Pareto-optimal points of the vector optimization problem (5) with constraint set X=i=1NXi considered in (15), that is,

NE(f,i=1NXi)=C-argmin{(x,f(x))|xi=1NXi}.

This explains why the set of Pareto-optimal points in (15) can be larger than the set of generalized Nash equilibria, and it provides an economic interpretation for when this happens.

We wish to conclude this section by illustrating the results relating generalized Nash games to shared-constraint games. In Example 3.9, we will revisit Example 3.3 to show that the superset relation (15) in Theorem 3.6 (respectively, relation (17) in Corollary 3.8) can be strict.

Examples 3.9 and 3.10 also show that the subset relation (16) in Theorem 3.6 (respectively, in Corollary 3.8) can be strict. It can even lead to an empty set on the right-hand side of (16) as demonstrated in Example 3.9. Example 3.10 revisits Example 3.4 and is a modification of Example 3.9, where the subset relation (16) is strict, but does not lead to an empty set.

Example 3.9.

Recall the generalized game from Example 3.3. Let us now consider the intersection game, that is, the vector optimization problem C-argmin{(x,f(x))|xi=12Xi} appearing in (15) in Theorem 3.6, where the cone CR6 is given as in (9). The Pareto optimizers of this intersection game provide a superset of the Nash equilibria of the generalized game by Theorem 3.6. In order to solve the vector optimization problem with nonconvex ordering cone C, we solve (by Lemma 2.7) the corresponding two linear vector optimization problems with convex ordering cones Ci and take an intersection of their Pareto-optimal points leading to P={x1}k=25Pk, where P2, P3 are as in Example 3.4; P4=co{x3,x6},P5=co{x4,x6} for extremal points x1,,x4 are as in Example 3.3; x5 is as in Example 3.4; and x6=((1.175,1.9125),(1.5,0)). Condition (18) characterizes exactly those points in the superset P that are not generalized Nash equilibria. Removing those points from P leads to the set of generalized Nash equilibria of this game as already computed in Example 3.3.

For completeness, let us now also consider the union game, that is, the vector optimization problem C-argmin{(x,f(x))|xX¯} appearing in the subset relation (16) in Theorem 3.6 for X¯=clcoi=12Xi. Although the union game has Pareto-optimal points consisting of two efficient faces (a plane and a line) including four extremal points, the intersection with the feasibility condition i=12Xi in (16) leads to an empty set on the right-hand side of (16) in this example. We wish to highlight that although the union game is a convex, shared-constraint game (and thus existence of a Nash equilibrium is guaranteed as found computationally here; see also theorem 1 of Rosen 1965), the feasibility condition can lead to an empty set of equilibria in the sufficient condition (16).

Example 3.10.

Consider again the modified N = 2-player game given in Example 3.4. Consider first its related union game, that is, problem C-argmin{(x,f(x))|xX¯} appearing in the subset relation (16) in Theorem 3.6 for X¯=clcoi=12X^i. This union game has a single line segment minimizer that is also feasible for the generalized game (i.e., an element of i=12X^i) and is given by P=P2, where P2 is as in Example 3.4, that is, P2=co{x2,x5} for x2=((0,2),(0,6)) and x5=((0,2.5),(0.125,5.5)). Thus, in contrast to Example 3.9, one obtains already a set of Nash equilibria from the union game by applying relation (16) in Theorem 3.6. Thus, P2NE(f,(X^i)i=1N).

Note that, as by construction, X^1X^2=X1X2, the corresponding intersection game is identical to that of Example 3.9. Therefore, it has the same set of Pareto-optimal points P providing a superset of the generalized Nash equilibria of this game by (17) in Corollary 3.8.

4. Vector-Valued Nash Games as Vector Optimization

In this section, we consider (generalized) noncooperative games in which the N players have vector-valued payoffs. This extends the settings of Sections 2 and 3 by allowing for the space of costs to be partially ordered. As formalized below, and as stated in, for example, Shapley and Rigby (1959) and Bade (2005), the Nash equilibria in such a setting are w.r.t. Pareto-efficient costs. The problem of finding any of these Nash equilibria is typically extremely challenging and often requires the consideration of an infinite number of scalarized problems (see Corley 1985, Bade 2005; see Remark 4.2). Such problems naturally arise due to incomplete preferences in the costs, for example, costs in multiple assets with transaction costs between these assets.

In Section 4.1, we will present the primary theoretical results of this section extending, for example, Corollary 3.2 to provide Corollary 4.4, which proves that the same characterization of Nash games as Pareto-optimal points of a certain vector optimization problem also holds for vector-valued games. Within this context, we also provide a brief introduction to vector-valued Nash games. In Section 4.2, we will illustrate these results with a numerical example, which also demonstrates the computational advantages of the Pareto reformulation of vector-valued Nash games.

4.1. Characterization of Nash Equilibria for Vector-Valued Games

Within this section, we study vector-valued Nash games, that is, N-player noncooperative games in which the costs are partially ordered. We will present these results in the context of generalized Nash games as in Section 3.

Specifically, each player i has a cost function fi:j=1NXjYi mapping to some partially ordered space Yi with associated convex ordering cone KiYi. As in Section 3, each player i also has a constraint set Xij=1NXj on the joint strategy of all players. With this setup, the Nash game is one in which, given all other players fix their strategies xi*jiXj, player i seeks to optimize

Ki-minxiXi{fi(xi,xi*)|(xi,xi*)Xi}i=1,,N.(19)

Within (19), the minimum is in the sense of Pareto optimality (see Definition 2.3). This construction leads to the notion of the Nash equilibrium for vector-valued games as is provided in, for example, Shapley and Rigby (1959) and Bade (2005). The Nash equilibrium in vector-valued games is also called, for example, the Shapley equilibrium in Hamel and Löhne (2018), the Pareto equilibrium in Voorneveld (1999, chapter 11), and the Pareto Nash equilibrium in De Marco and Morgan (2007).

Definition 4.1.

Consider the generalized vector-valued Nash game with N players described by (19). That is, player i has strategies in the space Xi, cost function fi:j=1NXjYi with ordering cone KiYi, and the joint strategies must satisfy the feasibility condition xXii=1NXi. The joint strategy x*i=1NXi is called a generalized Nash equilibrium for a vector-valued game if, for any player i, fi(xi,xi*)Kifi(x*) for any xiXi such that (xi,xi*)Xi and fi(xi,xi*)Kifi(x*). The set of all Nash equilibria will be denoted by NE(f,(Xi)i=1N); we simplify the notation to NE(f,X) if this is a shared-constraint game (i.e., if X=Xi for every player i as in Section 2).

Note again that the joint strategy x*i=1NXi is called a Nash equilibrium if, for any player i,

xi*Ki-argminxiXi{fi(xi,xi*)|(xi,xi*)Xi}.

Remark 4.2.

Let us shortly review the scalarization techniques used in the literature so far to solve vector-valued Nash games. For that purpose, let us for now assume the following. Let Yi be a topological space with dual Yi* and bilinear form ·,·:Yi*×YiR. Let KiYi be a closed and convex ordering cone. Furthermore, let fi(·,xi*) be Ki-convex for every xi*jiXj, that is, fi(λxi+(1λ)x¯i,xi*)Kiλfi(xi,xi*)+(1λ)fi(x¯i,xi*) for any λ[0,1] and xi,x¯iXi, and let Xi be a convex set. Then, as discussed in (Jahn 2011, chapter 11.2.1), xi* solves the player i best response function (19) if and only if there exists some wiKi+{ki*Yi*|ki*,ki0kiKi} such that

xi*argminxiXi{wi,fi(xi,xi*)|(xi,xi*)Xi}.(20)

Equation (20) is often called the linear or weighted-sum scalarization of the vector optimization problem (19). Because of the infinite number of linear scalarizations for a vector optimization problem, the traditional methods for finding Nash equilibria of vector-valued games generally fail. Corley (1985, section 4, p. 498) explicitly discusses “the impossible task of solving all possible scalarizations.”

Remark 4.3.

Note that we recover the typical (scalar-valued) definition for a Nash equilibrium (see Definitions 2.2 and 3.1) if Yi=R and Ki=R+ for every player i. This is because R+-argminxiXi{fi(xi,xi*)|(xi,xi*)Xi} provides the usual definition for the minimizers.

In contrast to the scalarization techniques described in Remark 4.2, we want to relate, similar to the preceding sections for real-valued games, vector-valued Nash games to Pareto-optimal points of certain vector optimization problems. We will see that the additional assumptions stated in Remark 4.2 are not necessary for that. Example 4.6 below will show that the approach proposed here has clear computational advantages for game with linear objectives and constraints.

Consider again the vector optimization problem (5) but with a modification to the ordering cone C that accounts for the more general spaces of costs Yi with ordering cones Ki. Thus, for a constraint set X, consider the following vector optimization problem and ordering cone:

C-min{(x,f(x))|xX},(21)
C{(x,y)i=1NXi×i=1NYi|i{1,,N}:xi=0jiXj,yiKi}.(22)

Similar to the cone defined in (6), the ordering cone C is nonconvex but can be decomposed into convex cones Ci such that C=i=1NCi by defining

Ci(j=1i1{0Xj})×Xi×(j=i+1N{0Xj})×(j=1i1Yj)×Ki×(j=i+1NYj).(23)

As in Section 3, if XiXj for two players ij, then, for vector-valued games, we can consider either a collection of N vector optimization problems to characterize the set of Nash equilibria or consider two specific vector optimization problems to produce a sandwich principle. In fact, in the following corollary—the final main result of this work—we will prove that the relations between the Nash equilibria and Pareto optimizers presented for real-valued games in Corollary 3.2 hold without modification for vector-valued games.

Corollary 4.4.

Consider the generalized vector-valued noncooperative game (19). The strategy x* is a Nash equilibrium if and only if x*Ci-argmin{(x,f(x))|xXi} for every i=1,,N, that is,

NE(f,(Xi)i=1N)=i=1NCi-argmin{(x,f(x))|xXi}.

Remark 4.5.

Before continuing, we wish to make a few notes comparing our results for vector-valued games to the more traditional scalar-valued games presented previously:

  1. The proof is in total analogy to the proof of Corollary 3.2 by just replacing the cones with the ones defined in (23).

  2. Under the shared-constraint setting (i.e., X=Xi=Xj for every pair of two players i, j), the set of all Nash equilibria in Corollary 4.4 can be reformulated as the single vector optimization problem (21) through an application of Lemma 2.7. Thus, the obtained result gives a equivalent characterization of the set of all shared-constraint Nash equilibria of a vector-valued game as the Pareto-optimal points of the vector optimization problem (21) with cone C as given in (22), which is in total analogy to the real-valued case of Theorem 2.6.

  3. Theorem 3.6 and Corollary 3.8 hold in exactly the same formulation also for vector-valued games, only replacing the cones with the ones defined in (22) and (23).

4.2. Examples

Within this section, we will consider a shared-constraint vector-valued Nash game to illustrate the results derived in Section 4.1, in particular, Corollary 4.4 in the shared-constraint case. As with the examples of Section 3, this example is a two-player game with linear objectives and constraints. As such, we are able to utilize the methods for linear vector optimization to construct the set of optimizers as detailed in Remark 3.5. This methodology is particularly noteworthy because, as far as the authors are aware, all prior works would require the study of an infinite number of scalarizations; see, for example, Bade (2005). As noted in Corley (1985), such an approach is computationally intractable. We refer the interested reader to De Marco and Morgan (2007, p. 171) for a survey of various refinements of the Nash equilibria for vector-valued games that take “into account the methodology of the scalarization which adds to the original problem new endogenous parameters.” As such, as far as the authors are aware, there does not exist any other methodology that computes the set of all Nash equilibria for this vector-valued game.

Example 4.6.

Consider the N = 2 player vector-valued game with shared constraints

x1*R+2-argmaxx1R2{(2x11,x12)|(x1,x2*)X},x2*R+2-argmaxx2R2{(2x21,3x22)|(x1*,x2)X},
in which player 1 plays strategy x1=(x11,x12)X1=R2, and player 2 plays strategy x2=(x21,x22)X2=R2. We set the shared constraints X to be the intersection of the constraints from Example 3.3, that is, X=X1X2 for X1 and X2 as in (12) and (13). Thus, we consider a vector-valued game (21) with linear objectives f1(x)=(2x11,x12),f2(x)=(2x21,3x22) both ordered by the natural ordering cone, that is, the positive orthant Ki=R+2 for i = 1, 2.

Note that the scalarization of this game with fixed weights w1=(1,1) and w2=(1,1) coincides with the intersection game of Examples 3.9 and 3.10 (see Remark 4.2). Therefore, {x1} and the sets P2,,P5 (described in Examples 3.3, 3.4, and 3.9) must consist of Nash equilibria of this vector-valued game as well. However, as will be found below, these are not the only Nash equilibria for this game, as some equilibria correspond to different weighted-sum scalarizations. By applying Corollary 4.4 under the shared-constraint setting (as discussed in Remark 4.5), we will solve (21) with respect to the nonconvex ordering cone

C=(R2×{(0,0)}×R+2×R2)({(0,0)}×R2×R2×R+2)=C1C2R8.

We will follow the same algorithmic approach as considered in Remark 3.5 with updated generators Z1, Z2 for the positive dual cones of C1, C2 respectively. In this example, there are m1=m2=6 generating vectors for both of these positive dual cones. Thus, instead of considering two vector optimization problems with eight-dimensional image spaces, one can equivalently solve two multiobjective linear programs with six-dimensional image spaces (with further dimension reduction possible as in Feinstein et al. 2023) using, for example, Van Tu (2017).

The set of Nash equilibria using Corollary 4.4 is given by the union

NE(f,X)NE1NE2NE3NE4
of the four convex polyhedrons NE1=co{x1,x3,x4,x8},NE2=co{x2,x3,x5,x8}, NE3=co{x3,x5,x6,x7}, and NE4=co{x3,x4,x6} for extremal points x1,,x6 as given in the scalar games of Examples 3.3, 3.4, and 3.9 and x7=((0,2.5),(1.5,0)),x8=((855,7855),(0,6)). As x1,,x6 coincide exactly with extremal points found in scalar games of Examples 3.3, 3.4, and 3.9, all those solutions are equilibria w.r.t. the scalarizations w1=w2=(1,1). The other two extremal solutions are new to this vector-valued game: x7 is an equilibrium w.r.t. the scalarizations w1=(0,1) and w2=(1,0); x8 is an equilibrium w.r.t. the scalarizations w1=(2,1) and w2=(1,1). Note that even though, for example, NE4 has extremal points all with scalarizations w1=w2=(1,1), not every point within that polyhedron NE4 is a Nash equilibrium w.r.t. those scalarizations. This can be seen through a comparison of the above representation for the set of equilibria to that given for the intersection game in Examples 3.9 and 3.10; that is, NE4\P. This demonstrates a clear computational advantage to considering the vector optimization formulation presented herein over the more traditional scalarization approach because the convex combination of solutions for a fixed scalarization does not necessarily result in another Nash equilibrium with those weights.

Acknowledgments

The authors are grateful to Ta Van Tu, who computed the efficient faces in Examples 3.9, 3.10, and 4.6 with his implementation based on Van Tu (2017). The authors thank Andreas Löhne for a helpful discussion about nonconvex ordering cones in vector optimization. The authors thank Benjamin Weißing for providing insights into the computation of the set of all efficient extreme points of a linear vector optimization problem with a convex ordering cone containing lines and having an empty interior in Bensolve (Löhne and Weißing 2017) via polyhedral projections, which provides an alternative to the approach used and described here in Remark 3.5 of turning a linear vector optimization problem into a multiobjective linear program with a natural ordering cone. The authors thank Niklas Hey for the numerical implementation of Examples 3.3 and 3.4 based on a small correction of the algorithm proposed in Tohidi and Hassasi (2018).

References

  • Anderson RM (1985) Strong core theorems with nonconvex preferences. Econometrica 53(6):1283–1294.CrossrefGoogle Scholar
  • Armand P (1993) Finding all maximal efficient faces in multiobjective linear programming. Math. Programming 61:357–375.CrossrefGoogle Scholar
  • Bade S (2005) Nash equilibrium in games with incomplete preferences. Econom. Theory 26(2):309–332.CrossrefGoogle Scholar
  • Beck M, Stein O (2023) Semi-infinite models for equilibrium selection. Minimax Theory Appl. Forthcoming.Google Scholar
  • Braouezec Y, Kiani K (2023) Economic foundations of generalized games with shared constraint: Do binding agreements lead to less Nash equilibria? Eur. J. Oper. Res. 308(1):467–479.CrossrefGoogle Scholar
  • Corley HW (1985) Games with vector payoffs. J. Optim. Theory Appl. 47:491–498.CrossrefGoogle Scholar
  • De Marco G, Morgan J (2007) A refinement concept for equilibria in multicriteria games via stable scalarizations. Internat. Game Theory Rev. 9(2):169–181.CrossrefGoogle Scholar
  • Evans JP, Steuer RE (1973) A revised simplex method for multiple objective programs. Math. Programming 5(1):54–72.CrossrefGoogle Scholar
  • Facchinei F, Fischer A, Piccialli V (2007) On generalized Nash games and variational inequalities. Oper. Res. Lett. 35(2):159–164.CrossrefGoogle Scholar
  • Feinstein Z, Hey N, Rudloff B (2023) Approximating the set of Nash equilibria for convex games. Working paper, Stevens Institute of Technology.Google Scholar
  • Hamel AH, Löhne A (2018) A set optimization approach to zero-sum matrix games with multi-dimensional payoffs. Math. Methods Oper. Res. 88:369–397.CrossrefGoogle Scholar
  • Hamel AH, Löhne A, Rudloff B (2014) Benson type algorithms for linear vector optimization and applications. J. Global Optim. 59(4):811–836.CrossrefGoogle Scholar
  • Harker PT (1991) Generalized Nash games and quasi-variational inequalities. Eur. J. Oper. Res. 54(1):81–94.CrossrefGoogle Scholar
  • Herings PJJ, Peeters R (2005) A globally convergent algorithm to compute all Nash equilibria for n-person games. Ann. Oper. Res. 137(1):349–368.CrossrefGoogle Scholar
  • Jahn J (2011) Vector Optimization: Theory, Applications, and Extensions, 2nd ed. (Springer, Berlin).CrossrefGoogle Scholar
  • Judd KL, Renner P, Schmedders K (2012) Finding all pure-strategy equilibria in games with continuous strategies. Quant. Econom. 3(2):289–331.CrossrefGoogle Scholar
  • Khan AA, Tammer C, Zălinescu C (2015) Set-Valued Optimization: An Introduction with Applications. Vector Optimization (Springer-Verlag, Berlin).CrossrefGoogle Scholar
  • Löhne A, Weißing B (2017) The vector linear program solver Bensolve—Notes on theoretical background. Eur. J. Oper. Res. 260(3):807–813.CrossrefGoogle Scholar
  • McKelvey RD, McLennan A (1996) Computation of equilibria in finite games. Amman HM, Kendrick DA, Rust J, eds. Handbook of Computational Economics, vol. 1 (Elsevier, Amsterdam), 87–142.Google Scholar
  • Nabetani K, Tseng P, Fukushima M (2011) Parametrized variational inequality approaches to generalized Nash equilibrium problems with shared constraints. Comput. Optim. Appl. 48(3):423–452.CrossrefGoogle Scholar
  • Nash J (1950) Equilibrium points in n-person games. Proc. Natl. Acad. Sci. USA 36(1):48–49.CrossrefGoogle Scholar
  • Nash J (1951) Non-cooperative games. Ann. Math. 54(2):286–295.CrossrefGoogle Scholar
  • Parsopoulos KE, Vrahatis MN (2004) On the computation of all global minimizers through particle swarm optimization. IEEE Trans. Evolutionary Comput. 8(3):211–224.CrossrefGoogle Scholar
  • Rosen JB (1965) Existence and uniqueness of equilibrium points for concave n-person games. Econometrica 33(3):520–534.CrossrefGoogle Scholar
  • Rudloff B, Ulus F, Vanderbei RJ (2017) A parametric simplex algorithm to solve linear vector optimization problems. Math. Programming 163(1):213–242.CrossrefGoogle Scholar
  • Sawaragi Y, Nakayama H, Tanino T (1985) Theory of Multiobjective Optimization. Mathematics in Science and Engineering, vol. 176 (Elsevier, Amsterdam).Google Scholar
  • Shapley LS, Rigby FD (1959) Equilibrium points in games with vector payoffs. Naval Res. Logist. Quart. 6(1):57–61.CrossrefGoogle Scholar
  • Tadelis S (2013) Game Theory: An Introduction (Princeton University Press, Princeton, NJ).Google Scholar
  • Tammer C, Weidner P (2020) Scalarization and Separation by Translation Invariant Functions—With Applications in Optimization, Nonlinear Functional Analysis, and Mathematical Economics (Springer, Cham).CrossrefGoogle Scholar
  • Tohidi G, Hassasi H (2018) Adjacency-based local top-down search method for finding maximal efficient faces in multiple objective linear programming. Naval Res. Logist. 65(3):203–217.CrossrefGoogle Scholar
  • Van Tu T (2017) A new method for determining all maximal efficient faces in multiple objective linear programming. Acta Math. Vietnamica 42:1–25.CrossrefGoogle Scholar
  • von Neumann J (1928) Zur Theorie der Gesellschaftsspiele. Mathematische Annalen 100(1):295–320.CrossrefGoogle Scholar
  • Voorneveld M (1999) Potential games and interactive decisions with multiple criteria. Unpublished doctoral thesis, Center for Economic Research, Tilburg University, Tilburg, Netherlands.Google Scholar
  • Wu Z, Dang C, Hu F, Fu B (2015) A new method to finding all Nash equilibria. He X, Gao X, Zhang Y, Zhou Z-H, Liu Z-Y, Fu B, Hu F, Zhang Z, eds. Internat. Conf. Intelligent Sci. Big Data Engrg. (Springer, Cham, Switzerland), 499–507.Google Scholar

Zachary Feinstein is an assistant professor in financial engineering at Stevens Institute of Technology. His research interests include financial contagion and systemic risk, risk measurement, game theory and fixed point analysis, and set-valued analysis.

Birgit Rudloff is a full professor in financial mathematics at the Institute for Statistics and Mathematics at Vienna University of Economics and Business, Austria. Her research interests include dynamic multivariate programming, multivariate risk measures, systemic risk, and set and vector optimization.