On the Ergodic Properties and Invariant Measure of a Two-Dimensional Reflected Ornstein–Uhlenbeck Process

Published Online:https://doi.org/10.1287/stsy.2024.0078

Abstract

We consider a two-dimensional reflected Ornstein–Uhlenbeck (ROU) process that arises as the diffusion approximation for a parallel server network with a randomly split Hawkes arrival process (or a multivariate Hawkes arrival process) in heavy traffic. We study the ergodic properties of the process, including the positive recurrence and rate of convergence in total variation distance and in Wasserstein distance. We also provide a numerical scheme based on a Monte Carlo method to approximate the invariant measure of the process.

Funding: G. Pang is partly supported by the National Science Foundation [Grants DMS 2216765 and CMMI 2452829].

1. Introduction

Reflected stochastic processes have attracted significant attention in recent years because of their close connections to queueing systems that arise in computer networks, telecommunications, mathematical biology, and transportation problems. Among the various areas of research, investigations into their ergodic properties have made striking progress. For instance, the recurrence of reflected Brownian motions and reflected diffusions has been widely explored in the literature, including, but not limited to, the references Williams (1985), Hobson and Rogers (1993), Dupuis and Williams (1994), Chen (1996), Budhiraja and Dupuis (1999), and Atar et al. (2001). Additionally, the stationary distributions of two-dimensional reflected Brownian motions have been thoroughly investigated, with explicit analytical expressions available. Relevant references include Harrison et al. (1985), Williams (1985), Dupuis and Ramanan (2002), Dieker and Moriarty (2009), Dai and Miyazawa (2011), and Franceschi and Raschel (2019). However, in higher dimensions, results on the stationary distribution are limited. Harrison and Williams (1987b) showed that under a certain skew symmetry condition, the stationary densities of reflected Brownian motions take an exponential product form. Despite this, Kang and Ramanan (2014) provided a characterization of stationary distributions of reflected diffusions.

However, when focusing specifically on the reflected Ornstein–Uhlenbeck process, the existing literature concentrates on the one-dimensional case. For example, Ward and Glynn (2003b) conducted a comprehensive study of the one-dimensional reflected Ornstein–Uhlenbeck (1-d ROU) process, including its explicit stationary density, a perturbation expansion for the transition density, and approximations for level crossing times. Furthermore, stationary distributions have been explored for certain generalized 1-d ROU processes. Specifically, Xing et al. (2009) investigated the 1-d ROU process with jumps and the 1-d Markov-modulated ROU process, whereas Zhang and Jiang (2009) studied the 1-d ROU process with two-sided barriers. Therefore, the main purpose of this paper is to extend the scope of research by studying a special case of the two-dimensional reflected Ornstein–Uhlenbeck process, as introduced below.

The two-dimensional reflected Ornstein–Uhlenbeck (2-d ROU) process (X,Y) in R+2 studied in this paper is defined as follows:

dXt=θ1(μ1Xt)dt+σ1dWt+dLtX,dYt=θ2(μ2Yt)dt+σ2dBt+dLtY,(1.1)
with initiation condition (X0,Y0)=(x0,y0)R+2, where (μ1,μ2)R2, (θ1,θ2)>0, (σ1,σ2)>0, (W,B) is a two-dimensional Brownian motion with covariance matrix (1ρρ1) with 0<ρ<1, and (LtX,LtY) denotes the local times at the boundaries and corresponds to the coefficients in front of the normal reflections. Specifically, (L0X,L0Y)=(0,0), LtX, and LtY are nondecreasing, and 01(0,)(Xs)dLsX=0 and 01(0,)(Ys)dLsY=0. The existence and uniqueness of a strong solution to the 2-d ROU process are guaranteed by a careful extension of the results of Lions and Sznitman (1984).

Before studying our 2-d process, we first provide an overview of the emergence of ROU processes. These processes arise as the diffusion scaling limit of a sequence of single-server queues with balking or reneging under heavy-traffic conditions (See Ward and Glynn 2003a, 2005 for details). Such queueing models have broad applications across various domains, including telecommunications, supply chain management, and computing and cloud services.

Beyond their derivation from such queueing models, ROU processes have also been shown to serve as effective approximations in various settings. Borovkov (1984) and Srikant and Whitt (1996) demonstrate that ROU processes approximate the number-in-system process in a G/M/s/0 queueing model when both the number of servers and the arrival rate are large. Additionally, Boxma et al. (2016) establish that the ROU process provides a heavy-traffic approximation for a sequence of reflected AR(1) processes.

However, these results focus primarily on the one-dimensional case. In contrast, our 2-d ROU process arises as the diffusion scaling limit for parallel single-server queues with abandonment in the critically loaded regime, which have a randomly split Hawkes process or a bivariate Hawkes process as the arrival processes (Li and Pang 2024). See Figure 1 for an illustration of these queueing models with split Hawkes arrivals. The correlation between these parallel queues emerges from dependencies in the arrival processes, which, in turn, translate into the correlated Brownian motions that drive the dynamics of the ROU process. Our 2-d ROU process is, of course, not the most general form of reflected OU processes; particularly, the drift is linear, the covariance coefficient is constant, and the reflection is normal. Furthermore, because there are no other interactions among the queues other than the arrivals, the reflection terms will be exactly like the reflection for each separate single-server queue with abandonment, as studied in Ward and Glynn (2005).

Figure 1. Parallel Single-Server Queues with Abandonment

The analysis of our 2-d ROU process contributes to the understanding of stationary distributions and transient performance measures of these parallel server queueing models, where explicit expressions are often intractable. Furthermore, we believe our results may provide valuable insights into the stationary workload distribution of bivariate M/G/1 systems with coupled input and parallel service, as posed in Mandjes (2022).

For the one-dimensional ROU process, the ergodic properties are well understood, as discussed in Ward and Glynn (2003b), where the invariant measure is explicitly shown to have a truncated Gaussian distribution. Additionally, the exponential rate of convergence in total variation distance is studied in Lund et al. (1996), and the rate in Wasserstein distance is investigated in Sarantsev (2020). In this paper, our goal is to understand such ergodic properties for the simple 2-d ROU process arising from the parallel server queueing models mentioned above.

In pursuit of this goal, one potential method involves extending the methodologies used for 1-d ROU processes. However, this strategy appears to be intractable. Indeed, in both Ward and Glynn (2003b) and Xing et al. (2009), the study of the stationary distributions and the positive recurrence relies extensively on the explicit solutions to the corresponding ordinary differential equations (ODEs). When transitioning from the 1-d to the 2-d case, these ODEs transform into partial differential equations (PDEs), whose explicit solutions seem to be impossible to find. Moreover, their proofs use the result that the 1-d ROU processes are regenerative. However, in the two-dimensional case, this property appears no longer to hold, as 2-d processes are unlikely to revisit the same point infinitely often.

Furthermore, it might be tempting to consider the 2-d ROU process in (1.1) as a special case in the general class of constrained diffusion processes, which has been extensively studied in literature (Budhiraja and Dupuis 1999, Atar et al. 2001, Budhiraja et al. 2014, Kang and Ramanan 2014). However, these results cannot be directly applied to our 2-d ROU processes. For example, whereas the positive recurrence of constrained diffusions is well studied in Atar et al. (2001), their outcomes require strict constraints on the drift. As a result, they can only demonstrate the positive recurrence of our 2-d ROU processes when both μ1 and μ2 are 0 (see Atar et al. 2001, condition 2.3). Nonetheless, a 2-d ROU process with positive μ1,μ2 does arise in practical applications. Specifically, if a sequence of parallel single-server queues has traffic intensities (ρ1(n),ρ2(n)) such that the limits of n(ρ1(n)1) and n(ρ2(n)1) exist and are positive; then, such a 2-d ROU process emerges as the diffusion scaling limit. Although this result was not explicitly stated in Li and Pang (2024), the derivation of the 2-d ROU process does not impose any constraints on these limits. On the other hand, it is important to explore the positive recurrence of 2-d ROU processes when μ1,μ20. Indeed, when μ1,μ20, the 2-d ROU process (Xt1,Yt1) “dominates” the 2-d ROU process (Xt2,Yt2) when μ1,μ20, meaning Xt1Xt2 and Yt1Yt2 for all t0. Therefore, the positive recurrence of (Xt1,Yt1) immediately implies that of (Xt2,Yt2). Hence, it is sufficient to prove the positive recurrence of (Xt1,Yt1) with μ1,μ20. A detailed explanation will be provided in Section 2. In this paper, we will establish the positive recurrence of the 2-d ROU process in all cases, thereby slightly extending the corresponding results in Atar et al. (2001) as applied to this process.

A common tool for studying the positive recurrence of reflected diffusion processes involves the use of the so-called “fluid path” or “fluid model,” which is a solution to the ODEs obtained by eliminating the randomness from the stochastic differential equations (SDEs) that define the reflected diffusion processes. It has been shown that the “fluid path” tending to the origin generally implies the recurrence of the reflected diffusion process. For more details, refer to Dupuis and Williams (1994), Atar et al. (2001), and Bramson et al. (2010). However, this tool is not applicable to our 2-d ROU processes when μ1 and μ2 are both positive. In fact, solving the following ODEs:

dXt=θ1(μ1Xt)dt+dLtX,dYt=θ2(μ2Yt)dt+dLtY,
subject to the initial conditions X0=x00 and Y0=y00, yields the “fluid path”:
Xt=x0eθ1t+μ1(1eθ1t),Yt=y0eθ2t+μ2(1eθ2t),
which tends to (μ1,μ2)(0,0) as t. As a result, we need a new approach to study the stability of our processes. Using a method that shares the same flavor with those in Hobson and Rogers (1993) and Ernst et al. (2021), we have succeeded in demonstrating the positive recurrence of the 2-d ROU processes, regardless of the values of μ1 and μ2. Indeed, we will prove that the process reaches an arbitrary neighborhood of the origin within a finite mean time. The strategy is summarized as follows:
  • We first construct a discrete-time jump process (XSn,YSn) from the original 2-d ROU process by restricting it to a sequence of elaborately selected stopping times such that one of XSn and YSn is zero for n1.

  • We then demonstrate that the above jump process reaches a given neighborhood of the origin within a finite mean time when starting from a position outside that neighborhood. Consequently, the original process exhibits the same property.

  • Finally, by focusing on the distance between (Xt,Yt) and the origin and using the aforementioned property, we derive a similar regenerative process, enabling us to establish the positive recurrence.

It is worth mentioning that we believe our method, in conjunction with the Skorokhod maps for 1-d ROU processes, may be extended to address the case of oblique reflections. We have a strong inclination that 2-d ROU processes are always positive recurrent, irrespective of the reflection directions. We leave this question for future investigation.

The second contribution of this paper lies in studying the exponential rates of convergence to the stationary distribution. The existence and the uniqueness of the stationary distribution, which are the prerequisites for our study, have been previously explored in Kinnally and Williams (2010). Furthermore, our results shall provide an alternative proof of these properties. Following a similar argument as in (Khasminskii 2011, section 4.4), the existence can be established through the positive recurrence, whereas our subsequent results on convergence rates ensure the uniqueness.

Inspired by Lund et al. (1996) and Sarantsev (2020), we establish the convergence rates of the transition probability measures to the invariant measure in both total variation distance and Wasserstein distance. The derivation of the convergence rate in the total variation distance relies on the tail estimate of the first hitting time for the Ornstein–Uhlenbeck process (see Lemma 13), which affects the exponent involved in the convergence rate. On the other hand, for the Wasserstein distance, we establish a concise bound for the Wasserstein distance between two transition probability measures, resulting in an explicit exponent being min{θ1,θ2}, governing the rate of convergence to the invariant measure.

We next investigate the stationary distribution of the 2-d ROU process by a numerical scheme based on a Monte Carlo method. For diffusions, two common approaches for investigating the stationary distribution are the PDE method (refer to, e.g., Kurtz 1991, Dai and Kurtz 1994, Williams 1995) and the Monte Carlo method (see, e.g., Lamberton and Pages 2002, Talay 2002, Graham and Talay 2013). However, explicitly solving the PDEs derived from our process appears to be impossible. Therefore, we only focus on the Monte Carlo method. For reflected diffusions in polyhedral domains, Budhiraja et al. (2014) studied the numerical computation of their stationary distributions using an Euler scheme. However, their results cannot be directly applied to our case, as Budhiraja et al. (2014, conditions 1.3 and 1.4) are not satisfied. Therefore, utilizing the unique characteristics of our process, we develop our own numerical scheme for approximating the stationary distribution and also analyze the convergence of our scheme to the stationary distribution. This study is also in a similar spirit to the recent work in Jin et al. (2024a, b) on numerical methods using Euler–Maruyama schemes to compute the stationary distributions of limiting diffusions (without reflections) arising in approximations of queueing networks in heavy traffic. Similar to Budhiraja et al. (2014) and Jin et al. (2024a), our numerical scheme takes a decreasing step size.

Finally, it is worth mentioning that unlike the extensively studied ergodicity properties and stationary distributions of two-dimensional reflected Brownian motions (see, for instance, the recent work in El Kharroubp et al. 2000 and Franceschi and Raschel 2019), such studies on 2-d ROU processes seem to be lacking. Whereas the 2-d ROU processes investigated in this paper are not the most general, we contribute to this area by examining those properties for a specific case. In the future, we aim to extend our results to the most general ROU processes.

1.1. Overview of Our Contributions

Our contributions are as follows:

  • Prove the positive recurrence of the 2-d ROU process defined in (1.1); see Theorem 12.

  • Establish the exponential rates of convergence to its stationary distribution; see Theorems 15 and 17.

  • Provide a numerical scheme to approximate its stationary distribution; see Theorem 18.

1.2. Organization of the Paper

We first summarize the notation used in this paper at the end of this section. Section 2 is devoted to investigating the positive recurrence of the 2-d ROU process defined in (1.1), utilizing the aforementioned strategy. In Section 3, we examine the exponential rates of convergence to the stationary distribution in both total variation distance and Wasserstein distance. Finally, Section 4 focuses on analyzing a numerical scheme based on the Monte Carlo method to approximate the stationary distribution of the 2-d ROU process.

1.3. Notation

Let (Ω,F,{Ft}t0,P) be the natural filtration space generated by the two-dimensional Brownian motion (Wt,Bt). Because (Xt,Yt) are the solutions to the SDE (1.1), they are also processes on (Ω,F,{Ft}t0,P). Throughout the paper, R+2{(x,y):x,y0} denotes the two-dimensional positive orthant, and R+2 represents its boundary. Additionally, we use OB to denote the set {(x,y)R+2:x+yB}. For (x,y)R+2, we use P(x,y) and E(x,y) to denote the probability and the expectation, respectively, when the 2-d ROU process starts from (x,y). Similarly, for a 1-d process starting from zR, Pz and Ez are the corresponding probability and expectation. Moreover, for x,yR, we define xymin{x,y}, xymax{x,y}, and x+max{x,0}. Additionally, δ(x,y) is the Dirac measure on R2 concentrated at (x,y). For a set A, we use 𝟙A to represent the indicator function of A.

When studying the convergence rates to the stationary distribution, we will need the following notation. We denote the stationary distribution as π. Furthermore, for (x,y)R+2, Pt((x,y),·) represents the transition probability measure for the 2-d ROU process. Finally, we introduce total variation distance and Wasserstein distance. Given two measures m1 and m2 on R+2, the total variation distance is defined by

dTV(m1,m2)supABR+2|m1(A)m2(A)|,
where BR+2 is the family of all Borel sets on R+2. Further, if both xm1(dx) and xm2(dx) are finite, we define the Wasserstein distance between m1 and m2 by
dW(m1,m2)supfLip(1)|f(x)m1(dx)f(x)m2(dx)|,
where Lip(1) is the set of all Lipschitz functions with Lipschitz constant 1.

Additional notation is introduced in the paper as needed.

2. Positive Recurrence

The aim of this section is to study the positive recurrence of the 2-d ROU process defined in (1.1), following the strategy outlined in Section 1.

2.1. Preliminary

We start by citing a lemma from Ward and Glynn (2003b), which demonstrates that a 1-d ROU process is “controlled” or “dominated” by a 1-d reflected Brownian motion (RBM) with the same parameters. This lemma allows us to exploit the properties of the 1-d RBM to study the ROU process. Subsequently, we extend this lemma to compare between two 1-d ROU processes, and the result is summarized in Lemma 2.

Lemma 1.

Let X be a 1-d ROU process satisfying

dXt=θ(μXt)dt+σdWt+dLtX
starting from x00. Also, let X˜ be a 1-d RBM associated with X, satisfying
dX˜t=θμdt+σdWt+dLtX˜
starting from x00. Then, for each t0,
XtX˜t.

Proof.

See Ward and Glynn (2003b, proof of roposition 2). □

Lemma 2.

Let X be a 1-d ROU process satisfying

dXt=θ(μXt)dt+σdWt+dLtX
starting from x00, where LX represents the local time of X at zero. Furthermore, let X˜ be another 1-d ROU process driven by the same Brownian motion Wt, satisfying
dX˜t=θ˜(μ˜X˜t)dt+σdWt+dLtX˜
starting from x˜00, where LX˜ represents the local time of X˜ at zero. Suppose that x˜0x0, θ˜θ, and θ˜μ˜θμ. Then, for each t0,
XtX˜t.

Proof.

Suppose that there exists t>0 for which Xt>X˜t. By assumptions, X0X˜0. Furthermore, noting that XX˜ has continuous sample paths, there exists s[0,t) such that Xs=X˜s, but Xu>X˜u for s<ut. Hence, θXuθ˜X˜u for s<ut. Note that

XtX˜t=(Xs+stθ(μXu)du+stσdWu+stdLuX)(X˜s+stθ˜(μ˜X˜u)du+stσdWu+stdLuX˜)=XsX˜s(θ˜μ˜θμ)(ts)st(θXuθ˜X˜u)du+(LtXLsX)(LtX˜LsX˜)(LtXLsX)(LtX˜LsX˜).

Because LX˜ is nondecreasing, it follows

XtX˜tLtXLsX.

Noting that Xu>X˜u0 for u(s,t] and LX is a continuous process that increases only when X equals zero, we conclude LtX=LsX. Therefore, XtX˜t, which is a contradiction. □

Remark 3.

By using a similar argument, the result in Lemma 2 still holds if the 1-d ROU processes are replaces by two 1-d Ornstein–Uhlenbeck processes. Furthermore, we can also prove a 1-d Ornstein–Uhlenbeck process is bounded above by a 1-d ROU process with the same parameters.

With the above lemma in hand, we are ready to show that it is sufficient to prove the positive recurrence when both μ1 and μ2 are nonnegative, as promised in Section 1. Indeed, if at least one of μ1 and μ2 is negative, we can construct a new 2-d ROU process (X¯,Y¯) by the following SDEs:

dX¯t=θ1(|μ1|X¯t)dt+σ1dWt+dLtX¯dY¯t=θ2(|μ2|Y¯t)dt+σ2dBt+dLtY¯
subject to X¯0=x0 and Y¯0=y0. Suppose (X,Y) is the 2-d ROU derived from (1.1). Applying Lemma 2, we obtain that (X,Y) is “controlled” by (X¯,Y¯); that is, for any t0, XtX¯t, and YtY¯t. Then, for any neighborhood of the origin, the hitting time of (X,Y) to that neighborhood is always bounded by the hitting time of (X¯,Y¯). Hence, the positive recurrence of (X¯,Y¯) implies the positive recurrence of (X,Y). As a result, in the rest of the section, we will always assume both μ1 and μ2 are nonnegative.

With the above preparation, we now return to the proof of the positive recurrence. For any neighborhood N of the origin, we define

Tinf{t0:(Xt,Yt)N}.

In what follows, we will prove that E(x,y)[T]< for any (x,y)R+2. Consequently, the positive recurrence follows. Here, the symbol E(x,y) represents the expectation when the 2-d ROU process starts from (x,y). The proof will be divided into three subsections, aligning with the three steps described in Section 1.

2.2. Stopping Times

In this subsection, we will first introduce certain stopping times and estimate their expectations. These will serve as the basis for defining a sequence {Sn}n=1 of stopping times, enabling us to construct the jump process. Moreover, we will provide estimates for the expectation of S1, as well as the position of (X,Y) at S1.

Define

τXinf{t:X(t)=0},τYinf{t:Y(t)=0}.

Indeed, τX and τY are the first hitting times of X and Y to zero, respectively. If X starts at zero, we define

ζXinf{t:X(t)=1}
and
δXinf{t>ζX:X(t)=0}.

Thus, δX is the first time that X returns to zero after it hits one. Additionally, δX can also be written as

δX=ζX+τX°θ(ζX).

Here, θ(S) is a shift operator, the effect of which on a path ω is to cut off the part of the path before S(ω) and to shift the remaining part in time. Similarly, if Y starts at zero, we define

ζYinf{t:Y(t)=1}
and
δYinf{t>ζY:Y(t)=0}.

Again, δY is the first time that Y returns to zero after it hits one, and δY can be written as

δY=ζY+τY°θ(ζY).

Once these stopping times are defined, we can proceed to provide estimates for their expectations, which are summarized in Lemma 4, Lemma 5, and Lemma 6.

Lemma 4.

For any (x,y)R+2, we have

E(x,y)[τX]=2σ120xeθ1(vμ1)2σ12veθ1(uμ1)2σ12dudv,(2.1)
E(x,y)[τY]=2σ220yeθ2(vμ2)2σ22veθ2(uμ2)2σ22dudv.(2.2)

Furthermore,

E(x,y)[τX]C1+1θ1log(x+1),(2.3)

E(x,y)[τY]C2+1θ2log(y+1),(2.4)
where
C12σ1πθ10μ1+1eθ1(vμ1)2σ12dv,C22σ2πθ20μ2+1eθ2(vμ2)2σ22dv.

Proof.

The first statement is an immediate consequence of Ward and Glynn (2003b, proposition 4). We then turn to the second statement. By the symmetry, we only need to derive (2.3) from (2.1).

By substituting the variable z=2θ1/σ12(uμ1), we have

veθ1(uμ1)2σ12du=σ122θ12θ1σ12(vμ1)ez22dz.

If vμ1+1,

veθ1(uμ1)2σ12du=σ122θ12θ1σ12(vμ1)ez22dzσ122θ1ez22dz=πσ12θ1.

If v>μ1+1, using the upper bound for the tail of the standard normal distribution,

veθ1(uμ1)2σ12du=σ122θ12θ1σ12(vμ1)ez22dzσ122θ1·12θ1σ12(vμ1)eθ1(vμ1)2σ12=σ122θ11vμ1eθ1(vμ1)2σ12.

When xμ1+1, combining the above two displays together with (2.1), we have

E(x,y)[τX]=2σ120xeθ1(vμ1)2σ12veθ1(uμ1)2σ12dudv=2σ120μ1+1eθ1(vμ1)2σ12veθ1(uμ1)2σ12dudv+2σ12μ1+1xeθ1(vμ1)2σ12veθ1(uμ1)2σ12dudv2σ120μ1+1eθ1(vμ1)2σ12πσ12θ1dv+2σ12μ1+1xeθ1(vμ1)2σ12σ122θ11vμ1eθ1(vμ1)2σ12dv=C1+1θ1μ1+1x1vμ1dv=C1+1θ1log(xμ1)C1+1θ1log(x+1).

When x<μ1+1, it is immediate that E(x,y)[τX]C1C1+1θ1log(x+1). Combining these two cases, (2.3) follows. □

Lemma 5.

For any x,y0, we have

E(0,y)[ζX]=2σ1201eθ1(vμ1)2σ120veθ1(uμ1)2σ12dudv<,E(x,0)[ζY]=2σ2201eθ2(vμ2)2σ220veθ2(uμ2)2σ22dudv<.

Thus, we use constants C3 and C4 to denote E(0,y)[ζX] and E(x,0)[ζY], respectively.

Proof.

See Ward and Glynn (2003b, theorem 2). □

With the above two lemmas and the fact that δX=ζX+τX°θ(ζX) and δY=ζY+τY°θ(ζY), we are ready to establish Lemma 6.

Lemma 6.

For any x,y0, we have

E(0,y)[δX]C5,(2.5)
E(x,0)[δY]C6,(2.6)
where
C5C1+C3+1θ1log(2),C6C2+C4+1θ2log(2).

Proof.

We only prove (2.5), and (2.6) follows similarly.

By the strong Markov property,

E(0,y)[δX]=E(0,y)[ζX]+E(0,y)[τX°θ(ζX)]=E(0,y)[ζX]+E(0,y)[E(1,YζX)[τX]].

By Lemma 5, we have

E(0,y)[ζX]C3.

By Lemma 4, we have

E(1,YζX)[τX]C1+1θ1log(2).

The desired result follows by combining the above three displays. □

The three lemmas above provide bounds for the expectations of the stopping times. To define and analyze the jump process mentioned in Section 1, we also need to evaluate the position of (X,Y) at a given stopping time. The following lemma, which provides a bound for the expectation of a one-dimensional Ornstein–Uhlenbeck process at any stopping time, will be a valuable tool for this purpose.

Lemma 7.

Let Z be a one-dimensional Ornstein–Uhlenbeck process satisfying

dZt=θ(μZt)dt+σdBt
and starting at z, where θ>0, σ>0, μ0 and B is a standard Brownian motion. If R is a stopping time with a finite mean, then
Ez[|ZR|]|z|Ez[eθR]+μ+σ·{Ez[R]}12.

Proof.

It is immediate that Z has the expression

Zt=zeθt+μ(1eθt)+σeθt0teθsdBs.

By substituting R for t and applying the triangle inequality, it easily follows that

|ZR||z|eθR+μ+σeθR|0ReθsdBs|.(2.7)

We then evaluate the expectation of eθR|0ReθsdBs|. By Itô’s lemma,

d(e2θt(0teθsdBs)2)=2θe2θt(0teθsdBs)2dt+2eθt(0teθsdBs)dBt+dt.

Using the optional sampling theorem yields

Ez[e2θ(tR)(0tReθsdBs)2]=2θEz[0tRe2θs(0seθudBu)2ds]+Ez[tR]Ez[tR].

Letting t, together with Fatou’s lemma and monotone convergence theorem, we have

Ez[e2θR(0ReθsdBs)2]Ez[R].

It follows by Jensen’s inequality that

Ez[eθR|0ReθsdBs|]{Ez[e2θR(0ReθsdBs)2]}12{Ez[R]}12.

By taking expectation on both sides of (2.7) and combining it with the above display, the desired result follows. □

Next, we introduce a new stopping time, S, related to τX,τY,δX, and δY. This stopping time is a key ingredient in defining the jump process and is defined as follows:

  • If (X,Y) starts at (x,0), then S=τXδY.

  • If (X,Y) starts at (0,y), then S=τYδX.

In other words, if the process (X,Y) starts from a point on R+2{(0,0)}={(x,y)(0,0):x=0 or y=0}, the stopping time S means the first time when either one component of the pair (Xt,Yt) reaches zero or the other that starts at zero reaches one and then returns to zero. In particular, if the process (X,Y) starts from (0,0), both two definitions result in S=0.

Before introducing the sequence of stopping times that defines the jump process, we pause to examine the properties of S. Indeed, we will estimate the expectations of S and XS+YS, as summarized in Lemma 8 and Lemma 9, respectively.

We begin with Lemma 8.

Lemma 8.

For any (x,y)R+2, we always have

E(x,y)[S]C5C6,
where C5 and C6 are defined in Lemma 6.

Proof.

If (X,Y) starts at (x,0), it follows by Lemma 6 and the definition of S that

E(x,0)[S]=E(x,0)[τXδY]E(x,0)[δY]C6.

Similarly, if (X,Y) starts at (0,y), we have E(0,y)[S]C5. The desired result follows by combining the above two cases. □

The following lemma concerns the expectation of XS+YS.

Lemma 9.

For any x,y0, we have

E(x,0)[XS+YS]C7x+σ2θ11/2x+C9,(2.8)
E(0,y)[XS+YS]C8y+σ1θ21/2y+C10,(2.9)
where
C7E(x,0)[eθ1δY]<1,C8E(0,y)[eθ2δX]<1,
and
C92+μ1+μ2+σ1C6+σ2C1+σ2θ11/2μ1+σ1C4,C102+μ1+μ2+σ2C5+σ1C2+σ1θ21/2μ2+σ2C3.

Proof.

We only prove (2.8), and (2.9) follows similarly.

By the definition of S, when (X,Y) starts at (x,0),

XS=XτXδY=XτX·𝟙{τXδY}+XδY·𝟙{δY<τX}=XδY·𝟙{δY<τX},
where the last equality follows from the fact that XτX=0, as τX is the first time X hits zero. On the event {t<τX}, the 1-d ROU process X is exactly an Ornstein–Uhlenbeck process and, hence, has the representation
Xt=xeθ1t+μ1(1eθ1t)+σ1eθ1t0teθsdWs.

Applying Lemma 7 yields

E(x,0)[XS]=E(x,0)[XδY·𝟙{δY<τX}]=E(x,0)[(xeθ1δY+μ1(1eθ1δY)+σ1eθ1δY0δYeθsdWs)𝟙{δY<τX}]E(x,0)[|xeθ1δY+μ1(1eθ1δY)+σ1eθ1δY0δYeθsdWs|]xE(x,0)[eθ1δY]+μ1+σ1{E(x,0)[δY]}12xE(x,0)[eθ1δY]+μ1+σ1C6,(2.10)
where, in the last inequality, we have invoked Lemma 6.

Similarly, when (X,Y) starts at (x,0), noting that YδY=0, we have

YS=YτXδY=YτX·𝟙{τX<δY}+YδY·𝟙{δYτX}=YτX·𝟙{τX<δY}=YτX·𝟙{τXζY}+YτX·𝟙{ζY<τX<δY}.

Because Yt1 for tζY, we have YτX·𝟙{τXζY}1; thus,

YS1+YτX·𝟙{ζY<τX<δY}.

Taking expectation yields

E(x,0)[YS]1+E(x,0)[YτX·𝟙{ζY<τX<δY}]=1+E(x,0)[𝟙{ζY<τX}YτX·𝟙{τX<δY}]=1+E(x,0)[𝟙{ζY<τX}E(XζY,1)[YτX·𝟙{τX<τY}]],(2.11)
where the last equality follows by the strong Markov property. On the event {t<τY}, the 1-d ROU process Y is exactly an Ornstein–Uhlenbeck process and, hence, has the form
Yt=eθ2t+μ2(1eθ2t)+σ2eθ2t0teθsdBs.

Applying Lemma 7 yields

E(XζY,1)[YτX·𝟙{τX<τY}]=E(XζY,1)[(eθ2τX+μ2(1eθ2τX)+σ2eθ2τX0τXeθsdBs)𝟙{τX<τY}]E(XζY,1)[|eθ2τX+μ2(1eθ2τX)+σ2eθ2τX0τXeθsdBs|]E(XζY,1)[eθ2τX]+μ2+σ2{E(XζY,1)[τX]}121+μ2+σ2·(C1+1θ1log(XζY+1))121+μ2+σ2C1+σ2θ11/2(log(XζY+1))121+μ2+σ2C1+σ2θ11/2·XζY12,
where the third last inequality is due to Lemma 4, the second last inequality follows by the inequality a+ba+b, and in the last inequality, the inequality log(x+1)x is applied. Combining the last display with (2.11), after a routine calculation, we have
E(x,0)[YS]2+μ2+σ2C1+σ2θ11/2·E(x,0)[𝟙{ζY<τX}XζY12]2+μ2+σ2C1+σ2θ11/2·{E(x,0)[XζY𝟙{ζY<τX}]}12,(2.12)
where in the last inequality, we have invoked Jensen’s inequality. Again, using the argument that Xt is an Ornstein–Uhlenbeck process when tτX and Lemma 7, we have
E(x,0)[XζY𝟙{ζY<τX}]xE(x,0)[eθ1ζY]+μ1+σ1{E(x,0)[ζY]}12x+μ1+σ1C4,
where, in the last inequality, Lemma 5 is applied. Plugging the last display into (2.12) yields
E(x,0)[YS]2+μ2+σ2C1+σ2θ11/2·(x+μ1+σ1C4)122+μ2+σ2C1+σ2θ11/2μ1+σ1C4+σ2θ11/2x.

Combining the last display with (2.10), the desired result follows. □

With Lemma 9 in hand, We immediately obtain Corollary 10 as follows:

Corollary 10.

There are constants C11<1, C12 and C13 such that for any (x,y)R+2,

E(x,y)[XS+YS]C11(x+y)+C12x+y+C13.

Consequently, there exist sufficiently large B and α[0,1) such that if (x,y)R+2 and x+yB, then

E(x,y)[XS+YS]C11(x+y)+C12x+y+C13α(x+y).

In the rest of the section, we will use OB to denote the set {(x,y):x+yB}.

With the above preparation, we are ready to introduce the stopping times and the jump process as mentioned in Section 1.

Define S0=0, S1=S, and

Sn=Sn1+S°θ(Sn1)for n2.

By the strong Markov property and Lemma 8, we have, for (x,y)R+2,

E(x,y)[Sn+1Sn]=E(x,y)[E(XSn,YSn)[S]]E(x,y)[C5C6]=C5C6.

Additionally, we define the jump process as follows:

(ξn,ηn)=(XSn,YSn)
for n=0,1,2,. By the definition of Sn, it is immediate that (ξn,ηn)R+2. Therefore, {(ξn,ηn):n=1,2,} is a jump process on R+2.

2.3. Reachability of the Jump Process to the Neighborhood of the Origin

In this subsection, we will prove that if the process {(ξn,ηn):n=0,1,2,} starts from a point on R+2, then it will eventually reach R+2OB within a finite mean time. Consequently, the same property holds for the original 2-d ROU process.

The preceding statements are summarized in the following lemma.

Lemma 11.

Define Ninf{n:(ξn,ηn)OB}. We have N< almost surely. Furthermore,

E(x,y)[SN]C5C6·x+y(1α)B.(2.13)

Therefore, the 2-d ROU process (X,Y), starting from a point (x,y) on R+2, will eventually reach the region R+2OB within an expected time of at most (C5C6)(x+y)/((1α)B).

Proof.

We claim {α(nN)(ξnN+ηnN)} is a nonnegative supermartingale with respect to the filtration {FSn}nN. Recall that (Ft)t0 is the natural filtration generated by (W,B). Therefore, FSn represents the corresponding σ-field stopped at Sn. It is immediate that ξn and ηn are FSn-measurable because ξn=XSn and ηn=YSn.

We now turn to verify the above claim.

E(x,y)[α((n+1)N)(ξ(n+1)N+η(n+1)N)|FSn]=E(x,y)[α((n+1)N)(ξ(n+1)N+η(n+1)N)𝟙{Nn}|FSn]+E(x,y)[α((n+1)N)(ξ(n+1)N+η(n+1)N)𝟙{N>n}|FSn]=E(x,y)[α(nN)(ξnN+ηnN)𝟙{Nn}|FSn]+E(x,y)[α(n+1)(ξn+1+ηn+1)𝟙{N>n}|FSn]=α(nN)(ξnN+ηnN)𝟙{Nn}+𝟙{N>n}·E(ξn,ηn)[α(n+1)(XS+YS)]α(nN)(ξnN+ηnN)𝟙{Nn}+𝟙{N>n}·αn(ξn+ηn)=α(nN)(ξnN+ηnN),
where the second last equality is due to the strong Markov property, and in the last inequality, Corollary 10 is applied. By the standard properties of a supermartingale,
x+y=E(x,y)[ξ0+η0]E(x,y)[α(nN)(ξnN+ηnN)]E(x,y)[α(nN)(ξnN+ηnN)𝟙{N>n}]=E(x,y)[αn(ξn+ηn)𝟙{N>n}]E(x,y)[αn·B·𝟙{N>n}]=αnB·P(x,y)(N>n),
where the last inequality follows by the fact that ξn+ηn>B on the event {N>n}. Thus,
P(x,y)(N>n)x+yBαn.

Given that α[0,1), it follows by letting n that N< almost surely. Therefore, the jump process (ξn,ηn) inevitably hits the region R+2OB. If we look back at the 2-d ROU process (X,Y), we can conclude that (X,Y) must hit R+2OB if it starts from a point on R+2.

Note that the first time when (X,Y) hits R+2OB is less than or equal to SN. In the next step, we estimate the expectation of SN and, consequently, the expected time for the process (X,Y) to visit R+2OB. Indeed, by Lemma 8 and the strong Markov property,

E(x,y)[SN]=E(x,y)[n=0N1(Sn+1Sn)]=E(x,y)[n=0(Sn+1Sn) 𝟙{N>n}]=n=0E(x,y)[(Sn+1Sn)𝟙{N>n}]=n=0E(x,y)[𝟙{N>n}·E(XSn,YSn)[S]]n=0E(x,y)[𝟙{N>n}·C5C6]=C5C6·n=0P(x,y)(N>n)C5C6·n=0x+yBαn=C5C6·x+y(1α)B.

Therefore, for the 2-d ROU process (X,Y) starting from a point (x,y) on R+2, it eventually reaches the region R+2OB with an expected time no greater than (C5C6)(x+y)/((1α)B). □

2.4. Positive Recurrence

The purpose of this subsection is to provide the main (theorem Theorem 12) of this section, which focuses on the positive recurrence of the 2-d ROU process (X,Y).

Recall T is the first time the process hits the neighborhood N of the origin.

Theorem 12.

There exists a constant C14 (see (2.19)) such that for any (x,y)R+2

E(x,y)[T]C14(1+x+y).

Proof.

Define

T0inf{t:(Xt,Yt)R+2}
and
Hinf{tT0:(Xt,Yt)R+2OB}.

H is the first time that the process (X,Y) hits the area R+2OB. We first prove

E(x,y)[H]C15(1+x+y),(2.14)
where
C15C5C6(1α)B·(1+μ1+μ2+(σ1+σ2)(C1+θ11/2))+C1+1θ1.

Note that T0τXτYτX; thus, by Lemma 4,

E(x,y)[T0]E(x,y)[τX]C1+1θ1log(x+1).(2.15)

To bound E(x,y)[H], it remains to provide an upper bound for E(x,y)[HT0], which depends on the estimate for E(x,y)[XT0+YT0]. To achieve this, we note that for tT0, (Xt,Yt) behaves like a 2-d Ornstein–Uhlenbeck process. Using a similar argument as in the proof of Lemma 9, we conclude

E(x,y)[XT0+YT0]xE(x,y)[eθ1T0]+μ1+σ1{E[T0]}12+yE(x,y)[eθ1T0]+μ2+σ2{E[T0]}12x+y+μ1+μ2+(σ1+σ2)(C1+1θ1log(x+1))12.(2.16)

Then, by the strong Markov property,

E(x,y)[HT0]=E(x,y)[E(XT0,YT0)[inf{t0:(Xt,Yt)R+2OB}]]E(x,y)[E((XT0,YT0))[SN]]E(x,y)[C5C6·XT0+YT0(1α)B]C5C6(1α)B·(x+y+μ1+μ2+(σ1+σ2)(C1+1θ1log(x+1))12),
where the second last inequality is due to (2.13), and the last inequality follows from (2.16). Combining the last display with (2.15), after a straightforward algebra, (2.14) follows.

We have already proven that the process (X,Y), starting from any point on R+2, will reach R+2OB within a time H whose mean is bounded by 1+x+y (up to a constant). We then define

R1Tinf{t0:Xt+Yt2B}.

To finish the proof, we need the following result:

There is a constant ϵ>0 such that

P(x,y)(R=T)ϵ,(2.17)
for any (x,y)R+2OB.

The proof of this result relies on the standard properties of Brownian motion. By Lemma 1, we can construct a 2-d reflected Brownian motion (X˜,Y˜) such that XtX˜t and YtY˜t for any t0. Define T˜ and R˜ for (X˜,Y˜) similarly to T and R, respectively. By a standard property of Brownian motion, there exists ϵ>0 such that for all (x,y)R+2OB, P(x,y)(R˜=T˜)ϵ (refer to Hobson and Rogers 1993). Thus,

P(x,y)(R=T)P(x,y)(R˜=T˜)ϵ.

We now return to complete the proof. We define

H1=H,R1=H1+R°θ(H1),
and define recursively for n2,
Hn=Rn1+H°θ(Rn1),Rn=Hn+R°θ(Hn).

It follows immediately from the definition of H and R that (XHn,YHn)R+2OB and XRn+YRn2B for n1. Considering the Estimate (2.14) and applying the strong Markov property, we have, for n2,

E(x,y)[HnRn1]=E(x,y)[E(XRn1,YRn1)[H]]E(x,y)[C15(1+XRn1+YRn1)]C15(1+2B).

Thus, noting that R1, we obtain, for n2,

E(x,y)[HnHn1]=E(x,y)[HnRn1]+E(x,y)[Rn1Hn1]C15(1+2B)+E(x,y)[E(XHn1,YHn1)[R]]C15(1+2B)+1.

From the above estimate, we conclude that for n1,

HnH1(C15(1+2B)+1)(n1)
is a supermartingale with respect to the filtration {FHn}n1. Once again, FHn is the σ-field obtained by stopping {Ft}t0 at Hn (recall {Ft}t0 is the natural filtration generated by (Wt,Bt)). Define
Minf{n1:(XRn,YRn)N}.

Then, M+1 is a stopping time with respect to the filtration {FHn}n because Rn1Hn. Applying the optional sampling theorem yields

E(x,y)[Hn(M+1)H1]E(x,y)[(C15(1+2B)+1)(n(M+1)1)]=(C15(1+2B)+1)E(x,y)[(n1)M].

Letting n and applying the monotone convergence theorem, we have

E(x,y)[HM+1H1](C15(1+2B)+1)E(x,y)[M].

Together with (2.14), we have

E(x,y)[HM+1]C15(1+x+y)+(C15(1+2B)+1)E(x,y)[M].

It follows immediately from the definition of M that TRMHM+1; thus,

E(x,y)[T]C15(1+x+y)+(C15(1+2B)+1)E(x,y)[M].(2.18)

What remains is to estimate the expectation of M.

For any (x,y)R+2OB, by the strong Markov property,

P(x,y)(M>n)=E(x,y)[𝟙{M>n}]=E(x,y)[𝟙{R1H1+T°θ(H1)}·𝟙{M>n}]=E(x,y)[𝟙{R1H1+T°θ(H1)}·E(XH2,YH2)[𝟙{M>n1}]]E(x,y)[𝟙{R1H1+T°θ(H1)}·sup(x,y)R+2OBP(x,y)(M>n1)]=E(x,y)[𝟙{R1H1+T°θ(H1)}]·sup(x,y)R+2OBP(x,y)(M>n1)=E(x,y)[E(XH1,YH1)[𝟙{RT}]]·sup(x,y)R+2OBP(x,y)(M>n1)(1ϵ)·sup(x,y)R+2OBP(x,y)(M>n1),
where the last inequality follows by (2.17). Taking the supremum over (x,y) gives
sup(x,y)R+2OBP(x,y)(M>n)(1ϵ)·sup(x,y)R+2OBP(x,y)(M>n1).

Continuing the above procedure recursively, we have

sup(x,y)R+2OBP(x,y)(M>n)(1ϵ)n.

Because (XH1,YH1)R+2OB,

E(x,y)[M]=E(x,y)[E(XH1,YH1)[M]]=E(x,y)[n=0P(XH1,YH1)(M>n)]E(x,y)[n=0(1ϵ)n]=1ϵ.

Plugging the above result into (2.18) gives

E(x,y)[T]C15(1+x+y)+(C15(1+2B)+1)/ϵC14(1+x+y),
where
C14C15+C15(1+2B)+1ϵ.(2.19)

We conclude the proof. □

3. Exponential Rate of Convergence

The section aims to investigate the rate of convergence to the stationary distribution of the 2-d ROU process. We will provide exponential rates of convergence in both total variation distance and Wasserstein distance. Further, we will explicitly specify the exponent for the latter.

3.1. A Tail Estimate for the First Hitting Time of an OU Process

Before addressing the rate of convergence, we first present a (lemma Lemma 13) regarding the tail estimate of the first hitting time for an Ornstein–Uhlenbeck process, which is the main ingredient in studying the rate of convergence in total variation distance.

Lemma 13.

Let Z be a one-dimensional Ornstein–Uhlenbeck process driven by the SDE

dZt=θ(μZt)dt+σdBt
starting at z, where θ>0, σ>0, and B is a standard Brownian motion. Let
τZinf{t0:Zt=0}.

Then, for any t*>0, there exist constants C16 and C17 depending on θ,μ,σ, and t* such that for tt*,

Pz(τZ>t)C16eC17t+4πzσθ2ezθ/σ2·1t3eθ24σ2t.

Proof.

We start by considering the case where μ0. Our approach to estimating Pz(τZ>t) will be divided into three cases based on the value of z: (i) z=μ+1, (ii) 0z<μ+1, and (iii) z>μ+1.

  1. z=μ+1. Using Alili et al. (2005, corollary 3.2) (after an appropriate transformation), we have that for any t*>0, there exist constants C16 and C17 depending on θ,μ,σ, and t* such that for tt*/2,

    P(μ+1)(τZ>t)C16e2C17t.

  2. 0z<μ+1. By applying Remark 3, Z is bounded above by the Ornstein–Uhlenbeck process with the same parameters, but starting at μ+1; hence, for tt*/2,

    Pz(τZ>t)P(μ+1)(τZ>t)C16e2C17t.

  3. z>μ+1. We define

    κinf{t0:Zt=μ+1}.

Thus, in the event {tκ}, we have Ztμ+1. Let Z˜ be a Brownian motion with a drift driven by the SDE:

dZ˜t=θdt+σdBt,
where it starts at z. Analogously, define
κ˜inf{t0:Z˜t=μ+1}.

By a similar argument to that in the proof of Lemma 1, we have ZtκZ˜tκ for t0. Thus, κκ˜. Then, we have

Pz(κ>t)Pz(κ˜>t)=tz(μ+1)σexp((z(μ+1)θs)22σ2s)2πs3ds,
where the last equality follows by the standard result of the first hitting time for Brownian motion with a drift (cf. Le Gall 2016, section 5.6). A routine calculation gives
tz(μ+1)σexp((z(μ+1)θs)22σ2s)2πs3ds12πz(μ+1)σeθ(z(μ+1))σ2teθ22σ2ss3ds12πzσeθzσ2teθ22σ2ss3ds12πzσeθzσ21t32σ2θ2eθ22σ2t=2πzσθ2ezθ/σ2·1t3eθ22σ2t.

Then, together with the strong Markov property, we have, for tt*,

Pz(τZ>t)=Pz(κ+τZ°θ(κ)>t)Pz(κ>t/2)+Pz(τZ°θ(κ)>t/2)4πzσθ2ezθ/σ2·1t3eθ24σ2t+Ez[EZκ[𝟙{τZ>t/2}]]4πzσθ2ezθ/σ2·1t3eθ24σ2t+C16eC17t,
where, in the last inequality, we have invoked the result from case (i).

Combining the above three cases gives, for z0 and tt*,

Pz(τZ>t)C16eC17t+4πzσθ2ezθ/σ2·1t3eθ24σ2t.

What remains is the case that μ<0. Indeed, the desired result follows from the fact that Zt is bounded by the Ornstein–Uhlenbeck process with μ=0. We conclude the proof. □

3.2. Exponential Rate of Convergence in Total Variation Distance

This subsection is devoted to the rate of convergence in total variation distance. It begins by studying the total variation distance between two transition probability measures, followed by the total variation distance between the transition probability measure and the invariant measure.

Recall that Pt((x,y),·) is the transition probability measure for the process (Xt,Yt) when it starts from (x,y), and π represents the stationary distribution.

Theorem 14.

Fix (x1,y1),(x2,y2)R+2. For any t*>0, there exist constants C18,C19, depending on θ1,μ1,σ1, and t*, and C20, C21, depending on θ2,μ2,σ2, and t* such that for tt*,

dTV(Pt((x1,y1),·),Pt((x2,y2),·))C18eC19t+C20eC21t+8πσ1max(x1,x2)θ12eθ1max(x1,x2)σ12·1t3eθ124σ1t+8πσ2max(y1,y2)θ22eθ2max(y1,y2)σ22·1t3eθ224σ2t.

Proof.

For i=1,2, we use (Xt(i),Yt(i)) to denote the 2-d ROU process satisfying the SDEs

dXt(i)=θ1(μ1Xt(i))dt+σ1dWt+dLtX(i)dYt(i)=θ2(μ2Yt(i))dt+σ2dBt+dLtY(i)
and starting from (xi,yi). Define for i=1,2,
τX(i)inf{t0:Xt(i)=0},τY(i)inf{t0:Yt(i)=0}.

Further, we define

τmaxXτX(1)τX(2),τmaxYτY(1)τY(2).

We first claim that on the event {tτmaxX}, Xt(1)=Xt(2). This will be demonstrated subsequently. Without loss of generality, we assume that x1x2. Applying Lemma 2, we have Xt(1)Xt(2) for t0. Thus, τX(1)τX(2), and τmaxX=τX(2). Because Xt(1) is nonnegative, then

0XτX(2)(1)XτX(2)(2)=0,
which implies XτX(2)(1)=XτX(2)(2)=0. By the strong Markov property, we have Xt(1)=Xt(2) for tτX(2).

Similarly, in the event {tτmaxY}, we have Yt(1)=Yt(2).

With the above preparation, we proceed to study the total variation distance between Pt((x1,y1),·) and Pt((x2,y2),·). It follows from the definition of total variation distance that

dTV(Pt((x1,y1),·),Pt((x2,y2),·))=supABR+2|Pt((x1,y1),A)Pt((x2,y2),A)|=supABR+2|E[𝟙A(Xt(1),Yt(1))]E[𝟙A(Xt(2),Yt(2))]|supABR+2E[|𝟙A(Xt(1),Yt(1))𝟙A(Xt(2),Yt(2))|].

Note that in the event {tτmaxXτmaxY}, (Xt(1),Yt(1))=(Xt(2),Yt(2)). Thus,

|𝟙A(Xt(1),Yt(1))𝟙A(Xt(2),Yt(2))|=|𝟙A(Xt(1),Yt(1))𝟙A(Xt(2),Yt(2))|·𝟙{t<τmaxXτmaxY}2·𝟙{t<τmaxXτmaxY}2·𝟙{t<τmaxX}+2·𝟙{t<τmaxY}.

Taking expectation on both sides of the last display and then taking supremum over A from BR+2, we have

dTV(Pt((x1,y1),·),Pt((x2,y2),·))2P(τmaxX>t)+2P(τmaxY>t).(3.1)

What remains is to evaluate P(τmaxX>t) and P(τmaxY>t). Without loss of generality, we assume x1x2; then, τmaxX=τX(2) and

P(τmaxX>t)=P(τX(2)>t).(3.2)

On the event {tτX(2)}, X(2) behaves like an Ornstein–Uhlenbeck process; hence, τX(2) is the first hitting time to zero for an Ornstein–Uhlenbeck process. By Lemma 13, for any t*, there are constants C18 and C19 depending on θ1,μ1,σ1, and t* such that for tt*,

P(τX(2)>t)12C18eC19t+4πσ1x2θ12eθ1x2σ12·1t3eθ124σ1t=12C18eC19t+4πσ1max(x1,x2)θ12eθ1max(x1,x2)σ12·1t3eθ124σ1t.

Together with (3.2), we have

P(τmaxX>t)=12C18eC19t+4πσ1max(x1,x2)θ12eθ1max(x1,x2)σ12·1t3eθ124σ1t.(3.3)

Similarly, there exist constants C20 and C21 depending on θ2,μ2,σ2, and t* such that for tt*,

P(τmaxY>t)=12C20eC21t+4πσ2max(y1,y2)θ22eθ2max(y1,y2)σ22·1t3eθ224σ2t.(3.4)

The desired result follows by combining (3.1), (3.3), and (3.4). □

With Theorem 14 in hand, we are ready to study the rate of convergence to the stationary distribution in total variation distance.

Theorem 15.

Fix (x,y)R+2. For any t*>0, there exist constants C22, depending on θ1,θ2,μ1,μ2,σ1,σ2,t*,x, and y, and C23, depending on θ1,θ2,μ1,μ2,σ1,σ2, and t*, such that for tt*,

dTV(Pt((x,y),·),π)C22eC23t.

Proof.

It can be easily verified that

dTV(Pt((x,y),·),π)R+2dTV(Pt((x,y),·),Pt((x˜,y˜),·))π(dx˜,dy˜).

Plugging the result of Theorem 14 into the above display, after arrangement, we have, for tt*,

dTV(Pt((x,y),·),π)C18eC19t+C20eC21t+8πt3eθ124σ1tR+2σ1max(x,x˜)θ12eθ1max(x,x˜)σ12π(dx˜,dy˜)+8πt3eθ224σ2tR+2σ2max(y,y˜)θ22eθ2max(y,y˜)σ22π(dx˜,dy˜).

Note that the marginal measures of π are stationary distributions for 1-d ROU processes; hence, they have truncated Gaussian distributions (cf. Ward and Glynn 2003b, proposition 1). Consequently,

R+2σ1max(x,x˜)θ12eθ1max(x,x˜)σ12π(dx˜,dy˜)<R+2σ2max(y,y˜)θ22eθ2max(y,y˜)σ22π(dx˜,dy˜)<.

Then, the desired result follows. □

3.3. Exponential Rate of Convergence in Wasserstein Distance

This subsection aims to demonstrate that the rate of convergence in Wasserstein distance is exponential, with the exponent being explicit. Again, we begin by examining the Wasserstein distance between two transition probability measures and then turn to the Wasserstein distance between any transition probability measure and the stationary distribution.

Theorem 16.

For (x1,y1),(x2,y2)R+2, we have, for t0,

dW(Pt((x1,y1),·),Pt((x2,y2),·))|x1x2|eθ1t+|y1y2|eθ2t.

Proof.

We adopt the notation in the proof of Theorem 14. That is, (Xt(i),Yt(i)) is the 2-d ROU process starting from (xi,yi), and τX(i) and τY(i) are the first hitting times to zero.

By the definition of Wasserstein distance,

dW(Pt((x1,y1),·),Pt((x2,y2),·))=supfLip(1)|f(x˜,y˜)Pt((x1,y1),(dx˜,dy˜))f(x˜,y˜)Pt((x2,y2),(dx˜,dy˜))|=supfLip(1)|E[f(Xt(1),Yt(1))]E[f(Xt(2),Yt(2))]|supfLip(1)E[|f(Xt(1),Yt(1))f(Xt(2),Yt(2))|].

Note that f is a Lipschitz function with Lipschitz constant 1. Thus,

|f(Xt(1),Yt(1))f(Xt(2),Yt(2))|(Xt(1)Xt(2))2+(Yt(1)Yt(2))2|Xt(1)Xt(2)|+|Yt(1)Yt(2)|.

Taking expectation on both sides of the last display and then taking supremum over f from Lip(1), we have

dW(Pt((x1,y1),·),Pt((x2,y2),·))E[|Xt(1)Xt(2)|]+E[|Yt(1)Yt(2)|].(3.5)

In what follows, we will evaluate the expectations of |Xt(1)Xt(2)| and |Yt(1)Yt(2)|. We begin with the expectation of |Xt(1)Xt(2)|. Without loss of generality, we assume that x1x2. Let X˜t(1) be an Ornstein–Uhlenbeck process satisfying the SDE

dX˜t(1)=θ1(μ1X˜t(1))dt+σ1dWt,
starting from x1. Then, X˜t(1) has the representation
X˜t(1)=x1eθ1t+μ1(1eθ1t)+σ10teθ1(ts)dWs.(3.6)

Using Lemma 2 and Remark 3, we have, for t0,

X˜t(1)Xt(1)Xt(2).

By a similar argument in the proof of Theorem 14, we conclude Xt(1)=Xt(2) on the event {tτX(2)}. Thus, combining these two results yields

|Xt(1)Xt(2)|=|Xt(1)Xt(2)|·𝟙{t<τX(2)}=(Xt(2)Xt(1))·𝟙{t<τX(2)}(Xt(2)X˜t(1))·𝟙{t<τX(2)}.(3.7)

In the event {t<τX(2)}, Xt(2) behaves like an Ornstein–Uhlenbeck process and, hence, has the representation

Xt(2)=x2eθ1t+μ1(1eθ1t)+σ10teθ1(ts)dWs.(3.8)

Then, plugging (3.6) and (3.8) into (3.7) gives

|Xt(1)Xt(2)|(x2x1)eθ1t·𝟙{t<τX(2)}(x2x1)eθ1t=|x2x1|eθ1t.

Thus,

E[|Xt(1)Xt(2)|]|x2x1|eθ1t.(3.9)

Similarly,

E[|Yt(1)Yt(2)|]|y2y1|eθ2t.(3.10)

Combining (3.5), (3.9), and (3.10), the desired result follows. □

Theorem 17.

For (x,y)R+2, there exist constants C24, depending on θ1,μ1,σ1, and x, and C25, depending on θ2,μ2,σ2, and y, such that for t0,

dW(Pt((x,y),·),π)C24eθ1t+C25eθ2t.

Proof.

It can be easily verified that

dW(Pt((x,y),·),π)R+2dW(Pt((x,y),·),Pt((x˜,y˜),·))π(dx˜,dy˜).

Together with Theorem 16, we have

dW(Pt((x,y),·),π)R+2(|xx˜|eθ1t+|yy˜|eθ2t)π(dx˜,dy˜)=eθ1tR+2|xx˜|π(dx˜,dy˜)+eθ2tR+2|yy˜|π(dx˜,dy˜).

Because the marginal measure R+π(·,dy) has a truncated Gaussian distribution,

R+2|xx˜|π(dx˜,dy˜)<,
and its value depends on θ1,μ1,σ1, and x. Similarly,
R+2|yy˜|π(dx˜,dy˜)<,
and its value depends on θ2,μ2,σ2, and y. We conclude the proof. □

4. A Numerical Scheme for the Stationary Distribution

The purpose of this section is to numerically study the stationary distribution for the 2-d ROU process. For diffusions, two common approaches for investigating the stationary distribution are the PDE method and the Monte Carlo method. We begin by presenting the PDE that the density of the stationary distribution satisfies, along with the corresponding boundary conditions, provided the existence of the density. However, because of its complexity, we are unable to solve this PDE ourselves and defer it to the experts in PDE. Therefore, we turn to the Monte Carlo method, which is partly inspired by Budhiraja et al. (2014). Additionally, the Monte Carlo method has an advantage in higher dimensions. Indeed, the approach we will elaborate on later can be automatically extended to high-dimensional ROU processes.

4.1. Stationary Distribution: A PDE Perspective

Assume the stationary distribution, denoted π, is absolutely continuous with density function p(x,y). Indeed, we believe the assumption can be justified by modifying the argument in Harrison and Williams (1987a, section 7). However, as this is beyond the scope of the paper, we omit the detailed verification. In the following, we will characterize p(x,y) by introducing the corresponding PDE.

For any smooth function f on [0,)×[0,) with compact support on (0,)×(0,), an application of Itô’s lemma gives

f(Xt,Yt)=f(X0,Y0)+0tAf(Xs,Ys)ds+0tfx(Xs,Ys)dWs+0tfy(Xs,Ys)dBs+0tfx(Xs,Ys)dLsX+0tfy(Xs,Ys)dLsY,
where Af is defined as
Af12σ122fx2+12σ222fy2+ρσ1σ22fxy+θ1(μ1x)fx+θ2(μ2y)fy.

Noting that fx, fy are bounded and fx(0,y)=fy(x,0)=0, it follows by taking expectation that

Eπ[f(Xt,Yt)]=Eπ[f(X0,Y0)]+Eπ[0tAf(Xs,Ys)ds].

Because π is the stationary distribution for (Xt,Yt), we have Eπ[f(Xt,Yt)]=Eπ[f(X0,Y0)]. Then,

Eπ[0tAf(Xs,Ys)ds]=0.

Hence,

Eπ[Af(Xt,Yt)]=0.

Because we assume p(x,y) is the density function of π, we have

00Af(x,y)p(x,y)dxdy=0.

Using integration by parts yields

00f(12σ122px2+12σ222py2+ρσ1σ22pxyθ1(μ1x)pxθ2(μ2y)py+(θ1+θ2)p)dxdy=0.

Here, px,py,2px2, can be understood as weak derivatives. By the arbitrariness of f, we conclude

12σ122px2+12σ222py2+ρσ1σ22pxyθ1(μ1x)pxθ2(μ2y)py+(θ1+θ2)p=0.

We now turn to the boundary conditions for p(x,y). Because Xt and Yt are one-dimensional reflected Ornstein–Uhlenbeck processes, the marginal distributions of π correspond to the stationary distributions of Xt and Yt; that is,

0p(x,y)dy=p1(x)2θ1σ12ϕ(2θ1/σ12(xμ1))1Φ(2θ1μ12/σ12),0p(x,y)dx=p2(y)2θ2σ22ϕ(2θ2/σ22(yμ2))1Φ(2θ2μ22/σ22),
where ϕ(·) and Φ(·) are the density and distribution functions of a standard normal random variable. The explicit representations of p1(x) and p2(y) come from Ward and Glynn (2003b).

In summary, p(x,y) satisfies the following PDE:

12σ122px2+12σ222py2+ρσ1σ22pxyθ1(μ1x)pxθ2(μ2y)py+(θ1+θ2)p=0
subject to the boundary conditions
0p(x,y)dy=p1(x),0p(x,y)dx=p2(y).

We are unable to solve the above PDE, as its boundary conditions do not fall into standard categories such as Dirichlet, Neumann, or Robin. So we entrust the task to experts in PDE.

4.2. Numerical Scheme and Its Convergence

In this subsection, we will develop a convergent numerical procedure to approximate the stationary distribution of our ROU process. Consistently, the stationary distribution is denoted by π. We begin by constructing a discrete-time process that serves as an approximation to the ROU process.

Let {λk}k=1 be a sequence of real numbers satisfying the following conditions:

  1. 0<λk<1/max{θ1,θ2} for all kN+;

  2. λk0 as k;

  3. Λnk=1nλk as n.

Here, N+ is the set of all positive integers. Note that the above conditions are satisfied if λk=1/(max{θ1,θ2}(k+1)ν) with ν(0,1]. Let {(Gk,1,Gk,2)}k=1 be a sequence of independent and identically distributed (i.i.d.) random vectors in R2 with mean 0 and covariance matrix (1ρρ1). Furthermore, we pose the following assumption on Gk,i’s:

E[eλGk,i]eβλ2,(4.1)
for some β(0,) and for all kN+, i=1,2, and λR. The above assumption is satisfied when (Gk,1,Gk,2) has a joint Gaussian distribution. As usual, we define Gk=σ(G1,1,G1,2,,Gk,1,Gk,2) for kN+ and G0={,Ω}.

With the above preparation, we are ready to iteratively construct a discrete-time process in R+2. For (x0,y0)R+2, define

{U0=x0,V0=y0,Uk+1=[Uk+θ1(μ1Uk)λk+1+σ1λk+1Gk+1,1]+,Vk+1=[Vk+θ2(μ2Vk)λk+1+σ2λk+1Gk+1,2]+,
where [z]+max{z,0}. Obviously, {(Uk,Vk)}k=0 is a sequence of random vectors with values in R+2. Employing these random vectors, we construct a sequence of random measures on R+2 that approximate the stationary distribution π as follows:
πn=1Λnk=1nλkδ(Uk1,Vk1),for nN+,
where δ(x,y) is the Dirac measure on R2. In particular, these random measures yield an approximation for any integral of the form R+2f(x,y)dπ(x,y) through the corresponding weighted averages:
1Λnk=1nλkf(Uk1,Vk1).

With these random measures in hand, we are now prepared to introduce the main result of this section.

Theorem 18.

As n, πn converges weakly to π almost surely.

The proof of Theorem 18 is relegated to the following two subsections.

4.3. Tightness

The aim of this subsection is to establish the tightness of {πn}n=1 almost surely. To this end, we prepare the following lemmas.

Lemma 19.

For nonnegative integers n, l, we have

Un+lUnj=n+1n+l(1θ1λj)+μ1++σ1max0ilm=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1,(4.2)
and
Vn+lVnj=n+1n+l(1θ2λj)+μ2++σ2max0ilm=1ij=n+l+2mn+l(1θ2λj)λn+l+1mGn+l+1m,2.(4.3)

Proof.

We only prove (4.2), and (4.3) follows similarly.

Define

Lk+1=min{Uk+θ1(μ1Uk)λk+1+σ1λk+1Gk+1,1,0}.

Then,

Uk+1=[Uk+θ1(μ1Uk)λk+1+σ1λk+1Gk+1,1]+=Uk+θ1(μ1Uk)λk+1+σ1λk+1Gk+1,1+Lk+1=(1θ1λk+1)Uk+θ1μ1λk+1+σ1λk+1Gk+1,1+Lk+1.

Dividing by j=1k+1(1θ1λj) on both sides yields

Uk+1j=1k+1(1θ1λj)=Ukj=1k(1θ1λj)+θ1μ1λk+1j=1k+1(1θ1λj)+σ1λk+1Gk+1,1j=1k+1(1θ1λj)+Lk+1j=1k+1(1θ1λj).

In the last display, by letting k=n,n+1,,n+l1, and summing up these l equations, we have

Un+lj=1n+l(1θ1λj)=Unj=1n(1θ1λj)+k=nn+l1θ1μ1λk+1j=1k+1(1θ1λj)+k=nn+l1σ1λk+1Gk+1,1j=1k+1(1θ1λj)+k=nn+l1Lk+1j=1k+1(1θ1λj).

For simplicity of notation, we define

Fn:lUnj=1n(1θ1λj)+k=nn+l1θ1μ1λk+1j=1k+1(1θ1λj)+k=nn+l1σ1λk+1Gk+1,1j=1k+1(1θ1λj),
and
L˜n:lk=nn+l1Lk+1j=1k+1(1θ1λj).

Thus,

Un+lj=1n+l(1θ1λj)=Fn:l+L˜n:l.

At this stage, we fix n and allow l to vary. Then, Un+l/j=1n+l(1θ1λj) is nonnegative for all lN+. L˜n:l, viewed as a function of l, is nondecreasing. Furthermore, L˜n:l increases at l only if Ln+l>0, which occurs only if Un+l=0 according to the definition of Ln+l. Combining the above observations, together with the uniqueness of the Skorokhod map, it follows that

L˜n:l=max{0,Fn:1,Fn:2,,Fn:l}.

Thus,

Un+lj=1n+l(1θ1λj)=Fn:l+max{0,Fn:1,Fn:2,,Fn:l}=max{Fn:l,Fn:lFn:1,Fn:lFn:2,,Fn:lFn:(l1),0}.

Note that for 1il1,

Fn:lFn:i=k=n+in+l1θ1μ1λk+1j=1k+1(1θ1λj)+k=n+in+l1σ1λk+1Gk+1,1j=1k+1(1θ1λj)k=n+in+l1θ1μ1+λk+1j=1k+1(1θ1λj)+k=n+in+l1σ1λk+1Gk+1,1j=1k+1(1θ1λj)=k=n+in+l1θ1μ1+λk+1j=1k+1(1θ1λj)+m=1liσ1λn+l+1mGn+l+1m,1j=1n+l+1m(1θ1λj),
where, in the last equality, we substitute m for n+lk. Furthermore,
Fn:lUnj=1n(1θ1λj)+k=nn+l1θ1μ1+λk+1j=1k+1(1θ1λj)+k=nn+l1σ1λk+1Gk+1,1j=1k+1(1θ1λj)=Unj=1n(1θ1λj)+k=nn+l1θ1μ1+λk+1j=1k+1(1θ1λj)+m=1lσ1λn+l+1mGn+l+1m,1j=1n+l+1m(1θ1λj).

Combining the last three displays, together with the nonnegativity of θ1μ1+λk+1, we have

Un+lj=1n+l(1θ1λj)Unj=1n(1θ1λj)+k=nn+l1θ1μ1+λk+1j=1k+1(1θ1λj)+0max0il1m=1liσ1λn+l+1mGn+l+1m,1j=1n+l+1m(1θ1λj)=Unj=1n(1θ1λj)+k=nn+l1θ1μ1+λk+1j=1k+1(1θ1λj)+0max1ilm=1iσ1λn+l+1mGn+l+1m,1j=1n+l+1m(1θ1λj)=Unj=1n(1θ1λj)+k=nn+l1θ1μ1+λk+1j=1k+1(1θ1λj)+max0ilm=1iσ1λn+l+1mGn+l+1m,1j=1n+l+1m(1θ1λj),
where, in the second last equality, we substitute i for li, and the last equality follows by the convention that m=10xm=0. In the last display, multiplying by j=1n+l(1θ1λj) on both sides, after changing the dummy variables, we have
Un+lUnj=n+1n+l(1θ1λj)+k=n+1n+lθ1μ1+j=k+1n+l(1θ1λj)λk+max0ilm=1iσ1j=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1.

To prove (4.2), it remains to prove

k=n+1n+lj=k+1n+l(1θ1λj)λk1θ1.(4.4)

Indeed, noting that λn1/θ1 for nN+, it follows that

k=n+1n+lj=k+1n+l(1θ1λj)λk=k=n+2n+lj=k+1n+l(1θ1λj)λk+j=n+2n+l(1θ1λj)λn+1k=n+2n+lj=k+1n+l(1θ1λj)λk+j=n+2n+l(1θ1λj)1θ1(4.5)
=k=n+3n+lj=k+1n+l(1θ1λj)λk+j=n+3n+l(1θ1λj)λn+2+j=n+3n+l(1θ1λj)(1θ1λn+2)=k=n+3n+lj=k+1n+l(1θ1λj)λk+j=n+3n+l(1θ1λj)1θ1.(4.6)

Comparing (4.3) and (4.6) and repeating this procedure, we have

k=n+2n+lj=k+1n+l(1θ1λj)λk+j=n+2n+l(1θ1λj)1θ1=k=n+ln+lj=k+1n+l(1θ1λj)λk+j=n+ln+l(1θ1λj)1θ1=λn+l+(1θ1λn+l)1θ1=1θ1.

Combining the last two displays yields (4.4). We conclude the proof. □

Lemma 20.

For nonnegative integers n, l, and any rR+, we have

E[exp(rσ1max0ilm=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)]4eβr2σ12/θ1(4.7)
and
E[exp(rσ2max0ilm=1ij=n+l+2mn+l(1θ2λj)λn+l+1mGn+l+1m,2)]4eβr2σ22/θ2.

Consequently, it follows by Hölder’s inequality that

E[exp(rσ1max0ilm=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)×exp(rσ2max0ilm=1ij=n+l+2mn+l(1θ2λj)λn+l+1mGn+l+1m,2)]4e2βr2σ12/θ1+2βr2σ22/θ2.

Proof.

By symmetry, we only prove (4.7).

Note that

E[exp(rσ1max0ilm=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)]=E[max0ilexp(rσ1m=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)].

For fixed n and l, because Gn+1,1,Gn+2,1,,Gn+l,1 are independent with a zero mean,

m=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1
forms a martingale with respect to {Gi}. Thus,
exp(rσ1m=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)
is a submartingale. From Doob’s maximal inequality for submartingales, we have
E[max0ilexp(rσ1m=1ij=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)]4E[exp(rσ1m=1lj=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)]=4m=1lE[exp(rσ1j=n+l+2mn+l(1θ1λj)λn+l+1mGn+l+1m,1)]4m=1lexp(βr2σ12j=n+l+2mn+l(1θ1λj)2λn+l+1m)4m=1lexp(βr2σ12j=n+l+2mn+l(1θ1λj)λn+l+1m)=4exp(βr2σ12m=1lj=n+l+2mn+l(1θ1λj)λn+l+1m)=4exp(βr2σ12k=n+1n+lj=k+1n+l(1θ1λj)λk)4eβr2σ12/θ1,
where the second inequality follows by the Assumption (4.1) on Gk,i; in the last equality, we have substituted k for n+l+1m; and in the last inequality, we have invoked (4.4). We complete the proof. □

With these two lemmas in hand, we can establish a uniform upper bound for the expectations of exp(rUl+rVl). This result is summarized in the following lemma.

Lemma 21.

For any rR+, we have

sup0l<E[erUl+rVl]4er(x0+y0+μ1++μ2+)+2βr2σ12/θ1+2βr2σ22/θ2.

Proof.

Letting n=0 in Lemma 19 and noting that U0=x0 yield

UlU0j=1l(1θ1λj)+μ1++σ1max0ilm=1ij=l+2ml(1θ1λj)λl+1mGl+1m,1x0+μ1++σ1max0ilm=1ij=l+2ml(1θ1λj)λl+1mGl+1m,1.

Similarly,

Vly0+μ2++σ2max0ilm=1ij=l+2ml(1θ2λj)λl+1mGl+1m,2.

Combining the last two displays with Lemma 20, the desired result follows. □

Before presenting the next result, we introduce some necessary notation. Define λ:[0,)[0,) and ι:[0,)N as

λ(s)=Λk;ι(s)=k,if Λks<Λk+1,kN,
where we define Λ0=0. Furthermore, define
λ0=max1i<λi.

For any t>0, it can be easily verified that

tλ0λ(s+t)λ(s)t+λ0.

Lemma 22.

For any rR+, define

M(r)rμ1++rμ2++2βr2σ12/θ1+2βr2σ22/θ2+ln4,Δλ0+max{ln2/θ1,ln2/θ2}.

Then, for any t0, we have

E[erUι(t+Δ)+rVι(t+Δ)|Gι(t)]e1erUι(t)+rVι(t)+e2M(r)+1.

Proof.

Applying Lemma 19 and Lemma 20, together with the independence of the sequence {(Gn,1,Gn,2)}n=1, we have

E[erUι(t+Δ)+rVι(t+Δ)|Gι(t)]exp(rUι(t)j=ι(t)+1ι(t+Δ)(1θ1λj)+rVι(t)j=ι(t)+1ι(t+Δ)(1θ2λj))×erμ1++rμ2+×E[exp(rσ1max0iι(t+Δ)ι(t)m=1ij=ι(t+Δ)+2mι(t+Δ)(1θ1λj)λι(t+Δ)+1mGι(t+Δ)+1m,1)×exp(rσ2max0iι(t+Δ)ι(t)m=1ij=ι(t+Δ)+2mι(t+Δ)(1θ2λj)λι(t+Δ)+1mGι(t+Δ)+1m,2)]
exp(rUι(t)j=ι(t)+1ι(t+Δ)(1θ1λj)+rVι(t)j=ι(t)+1ι(t+Δ)(1θ2λj))×4erμ1++rμ2++2βr2σ12/θ1+2βr2σ22/θ2=eM(r)·exp(rUι(t)j=ι(t)+1ι(t+Δ)(1θ1λj)+rVι(t)j=ι(t)+1ι(t+Δ)(1θ2λj)),(4.8)
where the last equality follows by the definition of M(r). We then claim
j=ι(t)+1ι(t+Δ)λj=λ(t+Δ)λ(t).

In fact, if ι(t)=k and ι(t+Δ)=l, then λ(t)=Λk and λ(t+Δ)=Λl. Therefore,

λ(t+Δ)λ(t)=ΛlΛk=j=k+1lλj=j=ι(t)+1ι(t+Δ)λj.

Note that λ(t+Δ)λ(t)Δλ0. It follows that

j=ι(t)+1ι(t+Δ)(1θ1λj)j=ι(t)+1ι(t+Δ)eθ1λj=exp(θ1j=ι(t)+1ι(t+Δ)λj)=eθ1(λ(t+Δ)λ(t))eθ1(Δλ0)eθ1(ln2/θ1+λ0λ0)=12.

Similarly,

j=ι(t)+1ι(t+Δ)(1θ2λj)12.

Combining the last two displays with (4.8), we have

E[erUι(t+Δ)+rVι(t+Δ)|Gι(t)]eM(r)·erUι(t)/2+rVι(t)/2=eM(r)erUι(t)/2+rVι(t)/2𝟙{Uι(t)+Vι(t)>2(M(r)+1)/r}+eM(r)erUι(t)/2+rVι(t)/2𝟙{Uι(t)+Vι(t)2(M(r)+1)/r}eM(r)erUι(t)+rVι(t)r2×2(M(r)+1)/r𝟙{Uι(t)+Vι(t)>2(M(r)+1)/r}+eM(r)er2×2(M(r)+1)/r𝟙{Uι(t)+Vι(t)2(M(r)+1)/r}e1erUι(t)+rVι(t)+e2M(r)+1.

We conclude the proof. □

With the above preparation, we arrive at our primary result in this subsection, indicating the almost sure tightness of the sequence of random measures {πn}n=1.

Proposition 23.

For any rR+, we have

sup1n<1Λnk=1nλkerUk1+rVk1<
almost surely. In other words,
sup1n<R+2erx+ryπn(dx,dy)<
almost surely. Consequently, the sequence {πn}n=1 is tight almost surely.

Proof.

The proof is similar to that of Budhiraja et al. (2014, lemma 6); therefore, we omit the specific details. □

4.4. Identification of the Limit

To complete the proof of Theorem 18, we must demonstrate that for almost every ω, any weak limit of πn(ω) is π. To this end, we follow the method in Budhiraja et al. (2014, section 2.2). It is worth noting that all the conditions necessary for the deduction in Budhiraja et al. (2014, section 2.2) are satisfied, except for the requirement of boundedness in |b(x)|, which corresponds to the boundedness of |μ1x| and |μ2y| in our case. However, |μ1x||μ1|+|x| and |μ2y||μ2|+|y|. When modifying the proof in Budhiraja et al. (2014, section 2.2), it only requires the following results:

  • (R1) 1Λnk=1nλk2(Uk1+Vk1)20 almost surely as n;

  • (R2) For any nonnegative integer j,

    sup1n<1Λnk=1nλk(Uk1+Vk1)j𝟙{Uk1+Vk1>M}0
    almost surely as M;

  • (R3)

    k=1λk+12E[(Uk+Vk)2]Λk2<.

All the results can be derived from Lemma 21 and Proposition 23. Indeed, note that

1Λnk=1nλk2(Uk1+Vk1)22Λnk=1nλk2eUk1+Vk1.

Therefore, (R1) follows immediately from Proposition 23 and the fact that λn0 and Λn. Furthermore, (R2) follows similarly because

sup1n<1Λnk=1nλk(Uk1+Vk1)j𝟙{Uk1+Vk1>M}sup1n<1Λnk=1nλk(Uk1+Vk1)j×Uk1+Vk1M(j+1)!Msup1n<1Λnk=1nλkeUk1+Vk1.

Finally, (R3) follows from the uniform boundedness of E[(Uk+Vk)2], which is a direct result of Lemma 21. This completes the convergence analysis of the numerical scheme.

4.5. Numerical Results

In this subsection, we apply our numerical scheme to approximate the stationary distribution of the 2-d ROU process under the parameter setting θ1=θ2=μ1=μ2=σ1=σ2=1, ρ=0.5, with initial conditions x0=1 and y0=1. The resulting numerical joint and marginal distributions are computed using three different schemes: (i) λk=(1+k)0.1, (ii) λk=(1+k)0.7, and (iii) λk=(1+k)1. The number of iterations is set to n=200,000. Additionally, the true marginal distributions, with density functions given by 2ϕ(2(x1))/(1Φ(2)) and 2ϕ(2(y1))/(1Φ(2)), are plotted as red curves to enable comparison and evaluate the accuracy of the numerical approximations.

The selection of the step size presents a challenge. When the number of iterations is relatively small, the step size should be chosen carefully to balance accuracy and stability. If the step size is too large, such as λk=(1+k)0.1, the discretized process (Un,Vn), as defined in Section 4.2, may frequently visit (0,0), resulting in an approximating distribution that is overly concentrated at (0,0). Moreover, as illustrated in Figure 2, the marginal distributions exhibit a good fit except at zero. Conversely, if the step size is too small, for instance, λk=(1+k)1, the discretized process (Un,Vn) tends to remain near the initial position (1,1), leading to an approximating distribution concentrated at (1,1) and thus producing an inaccurate result (see Figure 4). In contrast, when the step size is moderate, the approximating distribution is more dispersed. As suggested by the marginal distribution diagrams in Figure 3, we believe this choice provides a closer approximation to the true stationary distribution.

Figure 2. The Numerical Results for the Joint Distribution and Marginal Distributions When θ1=θ2=μ1=μ2=σ1=σ2=1, ρ=0.5, and x0=y0=1, with the Scheme λk=(1+k)0.1
Figure 3. The Numerical Results for the Joint Distribution and Marginal Distributions When θ1=θ2=μ1=μ2=σ1=σ2=1, ρ=0.5, and x0=y0=1, with the Scheme λk=(1+k)0.7
Figure 4. The Numerical Results for the Joint Distribution and Marginal Distributions When θ1=θ2=μ1=μ2=σ1=σ2=1, ρ=0.5, and x0=y0=1, with the Scheme λk=(1+k)1

We proceed to numerically estimate the correlation of the 2-d ROU processes under different parameter settings, using the scheme λk=(1+k)0.7. Specifically, we use the empirical correlation

1Λnk=1nλkUk1Vk1(1Λnk=1nλkUk1)(1Λnk=1nλkVk1)1Λnk=1nλkUk12(1Λnk=1nλkUk1)21Λnk=1nλkVk12(1Λnk=1nλkVk1)2
to approximate the true correlation of the 2-d ROU process. As before, the initial position is set to (x0,y0)=(1,1), and the number of iterations is n=200,000. With extensive simulation experiments, we observe that the empirical correlations converge for the choice n=200,000. Furthermore, because the means and variances of the marginal distributions can be explicitly computed from their density functions, we omit their numerical results. The numerical results for the correlation are summarized in Tables 14, as well as in Figure 5. These results strongly suggest that the correlation of the 2-d ROU process is nondecreasing with respect to the correlation of the Brownian motion terms. A formal investigation of this property is left for future work.

Table

Table 1. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=σ2=1, λk=(1+k)0.7, and n=200,000

Table 1. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=σ2=1, λk=(1+k)0.7, and n=200,000

ρ0.10.20.30.40.50.60.70.80.9
ρROU0.04180.21640.17530.30790.53320.57770.67340.76030.8900
ρ−0.1−0.2−0.3−0.4−0.5−0.6−0.7−0.8−0.9
ρROU−0.0023−0.1475−0.2464−0.4193−0.4744−0.5402−0.6105−0.7403−0.8265
Table

Table 2. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=σ2=1, λk=(1+k)0.7, and n=200,000

Table 2. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=σ2=1, λk=(1+k)0.7, and n=200,000

ρ0.10.20.30.40.50.60.70.80.9
ρROU0.12450.13210.22750.37040.41880.51920.59690.77850.8696
ρ−0.1−0.2−0.3−0.4−0.5−0.6−0.7−0.8−0.9
ρROU−0.0650−0.0819−0.0689−0.2009−0.2321−0.2138−0.3121−0.3374−0.4103
Table

Table 3. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=1, μ2=1, σ1=1, σ2=2, λk=(1+k)0.7, and n=200,000

Table 3. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=1, μ2=1, σ1=1, σ2=2, λk=(1+k)0.7, and n=200,000

ρ0.10.20.30.40.50.60.70.80.9
ρROU0.06420.14750.15430.25310.37660.44460.47410.60620.6823
ρ−0.1−0.2−0.3−0.4−0.5−0.6−0.7−0.8−0.9
ρROU−0.0586−0.1079−0.1896−0.3056−0.3685−0.3285−0.4681−0.5157−0.5567
Table

Table 4. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=1, σ2=2, λk=(1+k)0.7, and n=200,000

Table 4. Numerical Results for the Correlation of the 2-d ROU Process for Different Values of ρ When θ1=θ2=1, μ1=μ2=1, σ1=1, σ2=2, λk=(1+k)0.7, and n=200,000

ρ0.10.20.30.40.50.60.70.80.9
ρROU0.09750.10360.19520.34670.39130.49590.58730.76140.8504
ρ−0.1−0.2−0.3−0.4−0.5−0.6−0.7−0.8−0.9
ρROU−0.0909−0.1098−0.0943−0.2434−0.2672−0.2525−0.3485−0.3766−0.4726
Figure 5. Numerical Correlation of the 2-d ROU Process vs. Correlation of the Brownian Motion Terms
Notes. (a) Corresponding to Table 1. (b) Corresponding to Table 2. (c) Corresponding to Table 3. (d) Corresponding to Table 4.

We close this subsection by approximating the Laplace transform of the stationary distribution π, namely, esxtyπ(dx,dy), employing the empirical Laplace transform

esxtyπn(dx,dy)=1Λnk=1nλkesUk1tVk1.

We adopt the parameter setting: θ1=θ2=1, μ1=μ2=1, σ1=1, σ2=2, ρ=0.5, with initial conditions x0=1 and y0=1. We employ the scheme λk=(1+k)0.7 and set the number of iterations to n=200,000. For the parameters s and t, we consider the values {0.1,0.5,1,2,10} and compute the corresponding results, which are summarized in Table 5.

Table

Table 5. Numerical Results for the Laplace Transform When θ1=θ2=1, μ1=μ2=1, σ1=1, σ2=2, ρ=0.5, λk=(1+k)0.7, and n=200,000

Table 5. Numerical Results for the Laplace Transform When θ1=θ2=1, μ1=μ2=1, σ1=1, σ2=2, ρ=0.5, λk=(1+k)0.7, and n=200,000

s\t0.10.51.02.010.0
0.10.9244520.7767820.6490570.4940200.211610
0.50.8289810.7019330.5911220.4551370.200988
1.00.7348280.6274160.5328730.4154520.189715
2.00.6019160.5207690.4483130.3565920.172038
10.00.2851890.2569770.2308480.1960180.115423
Acknowledgments

The authors thank the reviewers for their helpful comments that have led to great improvement in the exposition of the results. The authors also express their sincere gratitude to Dr. Sumith Reddy Anugu for his invaluable contributions to this research.

References

  • Alili L, Patie P, Pedersen JL (2005) Representations of the first hitting time density of an Ornstein–Uhlenbeck process. Stochastic Models 21(4):967–980.Google Scholar
  • Atar R, Budhiraja A, Dupuis P (2001) On positive recurrence of constrained diffusion processes. Ann. Probab. 29(2):979–1000.Google Scholar
  • Borovkov AA (1984) Asymptotic Methods in Queuing Theory (John Wiley & Sons, New York).Google Scholar
  • Boxma O, Mandjes M, Reed J (2016) On a class of reflected AR (1) processes. J. Appl. Probab. 53(3):818–832.Google Scholar
  • Bramson M, Dai JG, Harrison JM (2010) Positive recurrence of reflecting Brownian motion in three dimensions. Ann. Appl. Probab. 20(2):753–783.Google Scholar
  • Budhiraja A, Dupuis P (1999) Simple necessary and sufficient conditions for the stability of constrained processes. SIAM J. Appl. Math. 59(5):1686–1700.Google Scholar
  • Budhiraja A, Chen J, Rubenthaler S (2014) A numerical scheme for invariant distributions of constrained diffusions. Math. Oper. Res. 39(2):262–289.LinkGoogle Scholar
  • Chen H (1996) A sufficient condition for the positive recurrence of a semimartingale reflecting Brownian motion in an orthant. Ann. Appl. Probab. 6(3):758–765.Google Scholar
  • Dai JG, Kurtz TG (1994) Characterization of the stationary distribution for a semimartingale reflecting Brownian motion in a convex polyhedron. Preprint 1–31.Google Scholar
  • Dai JG, Miyazawa M (2011) Reflecting Brownian motion in two dimensions: Exact asymptotics for the stationary distribution. Stochastic Systems 1(1):146–208.LinkGoogle Scholar
  • Dieker AB, Moriarty J (2009) Reflected Brownian motion in a wedge: Sum-of-exponential stationary densities. Electronic Comm. Probab. 14:1–16.Google Scholar
  • Dupuis P, Ramanan K (2002) A time-reversed representation for the tail probabilities of stationary reflected Brownian motion. Stochastic Processes Appl. 98(2):253–287.Google Scholar
  • Dupuis P, Williams R (1994) Lyapunov functions for semimartingale reflecting Brownian motions. Ann. Probab. 22(2):680–702.Google Scholar
  • El Kharroubp A, Ben Tahar A, Yaacoubi A (2000) Sur la récurrence positivedu mouvement brownien réflechidans l’orthant positif de Rn. Stochastics Stochastic Rep. 68(3–4):229–253.Google Scholar
  • Ernst PA, Franceschi S, Huang D (2021) Escape and absorption probabilities for obliquely reflected Brownian motion in a quadrant. Stochastic Processes Appl. 142:634–670.Google Scholar
  • Franceschi S, Raschel K (2019) Integral expression for the stationary distribution of reflected Brownian motion in a wedge. Bernoulli 25(4B):3673–3713.Google Scholar
  • Graham C, Talay D (2013) Stochastic Simulation and Monte Carlo Methods: Mathematical Foundations of Stochastic Simulation, Stochastic Modelling and Applied Probability, vol. 68 (Springer, Berlin, Heidelberg).Google Scholar
  • Harrison JM, Williams RJ (1987a) Brownian models of open queueing networks with homogeneous customer populations. Stochastics 22(2):77–115.Google Scholar
  • Harrison M, Williams R (1987b) Multidimensional reflected Brownian motions having exponential stationary distributions. Ann. Probab. 15(1):115–137.Google Scholar
  • Harrison JM, Landau HJ, Shepp LA (1985) The stationary distribution of reflected Brownian motion in a planar region. Ann. Probab. 13(3):744–757.Google Scholar
  • Hobson DG, Rogers LCG (1993) Recurrence and transience of reflecting Brownian motion in the quadrant. Math. Proc. Cambridge Philos. Soc. 113(2):387–399.Google Scholar
  • Jin X, Pang G, Wang Y, Xu L (2024a) Approximation of the steady state for piecewise stable Ornstein-Uhlenbeck processes arising in queueing networks. Preprint, submitted May 29, https://arxiv.org/html/2405.18851v1.Google Scholar
  • Jin X, Pang G, Xu L, Xu X (2024b) An approximation to the invariant measure of the limiting diffusion of G/Ph/n+ GI queues in the Halfin–Whitt regime and related asymptotics. Math. Oper. Res. 50(2):783–812.Google Scholar
  • Kang W, Ramanan K (2014) Characterization of stationary distributions of reflected diffusions. Ann. Appl. Probab. 24(4):1329–1374.Google Scholar
  • Khasminskii R (2011) Stochastic Stability of Differential Equations, Stochastic Modelling and Applied Probability, vol. 66 (Springer, Berlin, Heidelberg).Google Scholar
  • Kinnally M, Williams R (2010) On existence and uniqueness of stationary distributions for stochastic delay differential equations with positivity constraints. Electronic J. Probab. 15:409–451.Google Scholar
  • Kurtz TG (1991) A control formulation for constrained Markov processes. Kohler WE, White BS, eds. Mathematics of Random Media, Lectures in Applied Mathematics, vol. 27 (American Mathematical Society, Providence, RI).Google Scholar
  • Lamberton D, Pages G (2002) Recursive computation of the invariant distribution of a diffusion. Bernoulli 8(3):367–405.Google Scholar
  • Le Gall JF (2016) Brownian Motion, Martingales, and Stochastic Calculus, Graduate Texts in Mathematics, vol. 274 (Springer, Cham, Switzerland).Google Scholar
  • Li B, Pang G (2024) Heavy-traffic limits for parallel single-server queues with randomly split Hawkes arrival processes. J. Appl. Probab. 61(2):490–514.Google Scholar
  • Lions PL, Sznitman AS (1984) Stochastic differential equations with reflecting boundary conditions. Comm. Pure Appl. Math. 37(4):511–537.Google Scholar
  • Lund RB, Meyn SP, Tweedie RL (1996) Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Probab. 6(1):218–237.Google Scholar
  • Mandjes M (2022) Multivariate m/G/1 systems with coupled input and parallel service. Queueing Systems 100(3):309–311.Google Scholar
  • Sarantsev A (2020) Convergence rate to equilibrium in Wasserstein distance for reflected jump–diffusions. Statist. Probab. Lett. 165:108860.Google Scholar
  • Srikant R, Whitt W (1996) Simulation run lengths to estimate blocking probabilities. ACM Trans. Modeling Comput. Simulation 6(1):7–52.Google Scholar
  • Talay D (2002) Stochastic Hamiltonian systems: Exponential convergence to the invariant measure, and discretization by the implicit Euler scheme. Markov Processes Related Fields 8(2):163–198.Google Scholar
  • Ward AR, Glynn PW (2003a) A diffusion approximation for a Markovian queue with reneging. Queueing Systems 43:103–128.Google Scholar
  • Ward AR, Glynn PW (2003b) Properties of the reflected Ornstein–Uhlenbeck process. Queueing Syst. 44(2):109–123.Google Scholar
  • Ward AR, Glynn PW (2005) A diffusion approximation for a GI/GI/1 queue with balking or reneging. Queueing Systems 50:371–400.Google Scholar
  • Williams R (1985) Recurrence classification and invariant measure for reflected Brownian motion in a wedge. Ann. Probab. 13(3):758–778.Google Scholar
  • Williams RJ (1995) Semimartingale reflecting Brownian motions in the orthant. Kelly FP, Williams RJ, eds. Stochastic Networks, The IMA Volumes in Mathematics and Its Applications, vol. 71 (Springer, New York), 125–137.Google Scholar
  • Xing X, Zhang W, Wang Y (2009) The stationary distributions of two classes of reflected Ornstein–Uhlenbeck processes. J. Appl. Probab. 46(3):709–720.Google Scholar
  • Zhang L, Jiang C (2009) Stationary distribution of reflected O–U process with two-sided barriers. Statist. Probab. Lett. 79(2):177–181.Google Scholar