Some Conditions for Ergodicity and Recurrence of Markov Chains

A. G. Pakes
A. G. Pakes
Monash University, Victoria, Australia
Search for more papers by this author

Monash University, Victoria, Australia

Published Online:1 Dec 1969https://doi.org/10.1287/opre.17.6.1058

Abstract

This paper finds sufficient conditions for the ergodicity and recurrence of irreducible and aperiodic Markov chains. They extend some of the ones commonly used. The paper also indicates their use in discussing a certain class of queuing problem with state dependent service times.

Cited by
- Anomalous diffusion in convergence to effective ergodicity
  9 March 2026 | Physica Scripta, Vol. 101, No. 10
- Ergodicity of a Special Class of Markov Chains
  2 January 2026 | Acta Mathematicae Applicatae Sinica, English Series, Vol. 42, No. 1
- A mathematical model for the double orbital queue with recurrent customers under working vacation and its optimal control analysis
  29 October 2025 | Hacettepe Journal of Mathematics and Statistics, Vol. 54, No. 5
- Particle swarm optimization of a single server retrial queue with balking and immediate feedback under Bernoulli working vacation
  29 October 2025 | Hacettepe Journal of Mathematics and Statistics, Vol. 54, No. 5
- Swarm based Heuristic Optimization of the Recurrent Customers and Standby Server Under General Retrial Times
  1 August 2025 | International Journal of Mathematical, Engineering and Management Sciences, Vol. 10, No. 4
- Analysis of repairable discrete-time queueing systems with negative customers, disasters, balking customers and interruptible working vacations under Bernoulli schedule
  Mathematics and Computers in Simulation, Vol. 232
- Unpredictable two-stage retrial model featuring impatient customers pinned Bernoulli working vacations and starting failure
  9 March 2025 | Annals of Operations Research, Vol. 57
- Modelling and optimisation for a retrial queue with imperfect coverage and reboot delay
  23 May 2023 | Journal of Control and Decision, Vol. 12, No. 1
- Nonlinear metaheuristic cost optimization and ANFIS computing of feedback retrial queue with two dependent phases of service under Bernoulli working vacation
  12 December 2023 | International Journal of Modern Physics B, Vol. 38, No. 30
- Meta heuristic optimization of a batch arrival retrial queue with optional re-service and M-optional vacations
  16 July 2024 | International Journal of System Assurance Engineering and Management, Vol. 15, No. 9
- Unreliable M[]/G(P1,P2)/1 feedback retrial queues with combined working vacation
  Heliyon, Vol. 10, No. 17
- Dynamical modelling and cost optimization of a 5G base station for energy conservation using feedback retrial queue with sleeping strategy
  13 May 2024 | Telecommunication Systems, Vol. 86, No. 4
- Optimal control of a two-phase heterogeneous service retrial queueing system with collisions and delayed vacations
  17 April 2024 | Journal of Applied Mathematics and Computing, Vol. 70, No. 4
- Two phase of service in M/G/1 queueing system with retrial customers
  27 August 2023 | The Journal of Analysis, Vol. 32, No. 4
- Cost optimization for system stability and orbital search under working vacation and starting failure by using the ANFIS soft computing
  Ain Shams Engineering Journal, Vol. 15, No. 8
- Dynamical behaviour and meta heuristic optimization of a hospital management software system
  Heliyon, Vol. 10, No. 16
- Performance analysis of a collision channel with abandonments
  Performance Evaluation, Vol. 165
- Exploring non-Markovian dynamics: Stochastic analysis of a single-server retrial queue with recurrent clients and balking behavior under extended Bernoulli vacations
  Heliyon, Vol. 10, No. 13
- Performance Analysis of Two Different Types of Waiting Queues with Working Vacations
  Journal of Mathematics, Vol. 2024
- Non-linear Dynamical Functioning of a Time-Independent Uncertain System with Optimization
  18 September 2024
- Sensitivity analysis of a non-Markovian feedback retrial queue, reneging, delayed repair with working vacation subject to server breakdown
  AIMS Mathematics, Vol. 9, No. 8
- Analysis of a retrial queueing system with priority service and modified multiple vacations
  25 January 2022 | Communications in Statistics - Theory and Methods, Vol. 52, No. 17
- Evaluating the Performance Impact of No-Wait Approach to Resolving Write Conflicts in Databases
  7 October 2023
- Analysis of an M/G/1 Retrial Queue with Delayed Repair and Feedback under Working Vacation policy with Impatient Customers
  27 September 2022 | Symmetry, Vol. 14, No. 10
- A retrial stochastic service system with balking and two-phase service
- An information theory approach to network evolution models
  6 June 2022 | Journal of Complex Networks, Vol. 10, No. 3
- An unreliable single server retrial queue with collisions and transmission errors
  14 May 2020 | Communications in Statistics - Theory and Methods, Vol. 51, No. 4
- Reliability and Optimization Measures of Retrial Queue with Different Classes of Customers under a Working Vacation Schedule
  28 October 2022 | Discrete Dynamics in Nature and Society, Vol. 2022, No. 1
- Analysis of a batch arrival retrial queue with impatient customers subject to the server disasters
  Journal of Industrial & Management Optimization, Vol. 17, No. 4
- Investigating a general service retrial queue with damaging and licensed units: an application in local area networks
  14 May 2020 | OPSEARCH, Vol. 57, No. 3
- Finite-State-Space Truncations for Infinite Quasi-Birth-Death Processes
  Journal of Applied Mathematics, Vol. 2020
- Exact Performance Analysis of Retrial Queues with Collisions
  8 November 2020
- Three Approaches in the Study of Recurrent Markovian and Semi-Markovian Processes
  2 January 2021
- An unreliable discrete-time retrial queue with probabilistic preemptive priority, balking customers and replacements of repair times
  AIMS Mathematics, Vol. 5, No. 5
- On the ergodicity of a class of level-dependent quasi-birth-and-death processes
  15 November 2019 | Advances in Applied Probability, Vol. 51, No. 4
- Numerical solution for the performance characteristics of the M/M/C/K retrial queue with negative customers and exponential abandonments by using value extrapolation method
  24 June 2019 | RAIRO - Operations Research, Vol. 53, No. 3
- Performance Analysis of Preemptive Priority Retrial Queueing System with Disaster under Working Breakdown Services
  21 March 2019 | Symmetry, Vol. 11, No. 3
- Stability Analysis of Frame Slotted Aloha Protocol
  7 June 2018
- Optimal Pricing Strategies in Cognitive Radio Networks With Heterogeneous Secondary Users and Retrials
  IEEE Access, Vol. 7
- Analysis of an unreliable retrial G-queue with working vacations and vacation interruption under Bernoulli schedule
  Ain Shams Engineering Journal, Vol. 9, No. 4
- Unreliable M/M/1/1 retrial queues with set-up time
  8 May 2017 | Quality Technology & Quantitative Management, Vol. 15, No. 5
- Long-term forecasting of nitrogen dioxide ambient levels in metropolitan areas using the discrete-time Markov model
  Environmental Modelling & Software, Vol. 107
- A study on M/G/1 feedback retrial queue with subject to server breakdown and repair under multiple working vacation policy
  Alexandria Engineering Journal, Vol. 57, No. 2
- Performance Analysis of an M/G/1 Retrial Queueing System Under LCFS-PR Discipline with General Retrial and Setup Times
  5 August 2018
- Control and Optimization of the SRPT Service Policy by Frequency Scaling
  15 August 2018
- Sensitivity analysis of an M/G/1 retrial queueing system with disaster under working vacations and working breakdowns
  18 April 2018 | RAIRO - Operations Research, Vol. 52, No. 1
- A study on M/G/1 retrial G - queue with two phases of service, immediate feedback and working vacations
  2 December 2017 | IOP Conference Series: Materials Science and Engineering, Vol. 263
- Performance analysis of an M/G/1 retrial queue with general retrial time, modified M-vacations and collision
  4 May 2016 | Operational Research, Vol. 17, No. 2
- Stability Analysis of Frame Slotted Aloha Protocol
  IEEE Transactions on Mobile Computing, Vol. 16, No. 5
- Hybrid-beamforming-based millimeter-wave cellular network optimization
- A survey of retrial queueing systems
  15 October 2015 | Annals of Operations Research, Vol. 247, No. 1
- Analysis of an M[X]/G/1 unreliable retrial G-queue with orbital search and feedback under Bernoulli vacation schedule
  3 October 2015 | OPSEARCH, Vol. 53, No. 1
- LINEAR BIRTH/IMMIGRATION-DEATH PROCESS WITH BINOMIAL CATASTROPHES
  14 October 2015 | Probability in the Engineering and Informational Sciences, Vol. 30, No. 1
- Embedded Markov chain approach to retrial queue with vacation, phase repair and multioptional services
  1 May 2015 | OPSEARCH, Vol. 52, No. 4
- Bounded truncation error for long-run averages in infinite Markov chains
  30 March 2016 | Journal of Applied Probability, Vol. 52, No. 3
- On a retrial queueing model with single/batch service and search of customers from the orbit
  6 November 2014 | TOP, Vol. 23, No. 2
- A preemptive priority retrial queue with two classes of customers and general retrial times
  2 April 2015 | Operational Research, Vol. 15, No. 2
- Stability analysis of Frame Slotted Aloha protocol
- On an M/G/1 Queue with Vacation in Random Environment
  9 December 2015
- A retrial queue for modeling fault-tolerant systems with checkpointing and rollback recovery
  Computers & Industrial Engineering, Vol. 79
- Recurrence Criterion
  29 September 2014
- Effective ergodicity in single-spin-flip dynamics
  29 September 2014 | Physical Review E, Vol. 90, No. 3
- On finite long run costs and rewards in infinite Markov chains
  Statistics & Probability Letters, Vol. 91
- Queues with random back-offs
  10 October 2013 | Queueing Systems, Vol. 77, No. 1
- Insensitive Bounds for the Stationary Distribution of a Single Server Retrial Queue with Server Subject to Active Breakdowns
  Advances in Operations Research, Vol. 2014
- A preemptive resume priority retrial queue with state dependent arrivals, unreliable server and negative customers
  11 June 2011 | TOP, Vol. 21, No. 3
- An M[X]/G/1 retrial g-queue with single vacation subject to the server breakdown and repair
  20 November 2013 | Acta Mathematicae Applicatae Sinica, English Series, Vol. 29, No. 3
- An M/G/1 Bernoulli feedback retrial queueing system with negative customers
  18 March 2011 | Operational Research, Vol. 13, No. 2
- A mixed priority retrial queue with negative arrivals, unreliable server and multiple vacations
  Applied Mathematical Modelling, Vol. 37, No. 3
- Analysis of the -queueing system with retrial customers
  Nonlinear Analysis: Real World Applications, Vol. 14, No. 1
- A single-server retrial G-queue with priority and unreliable server under Bernoulli vacation schedule
  Computers & Industrial Engineering, Vol. 64, No. 1
- On an M ( X ) / G /1 Retrial System with Two Types of Search of Customers from the Orbit
  Stochastic Analysis and Applications, Vol. 31, No. 1
- Carrier Sense Multiple Access Communications on Multipacket Reception Channels: Theory and Applications to IEEE 802.11 Wireless Networks
  IEEE Transactions on Communications, Vol. 61, No. 1
- Random Access Algorithms in Packet Networks—A Review of Three Research Decades
  International Journal of Communications, Network and System Sciences, Vol. 05, No. 10
- An M/G/1 retrial G-queue with non-exhaustive random vacations and an unreliable server
  Computers & Mathematics with Applications, Vol. 62, No. 5
- On the distribution of the number stranded in bulk-arrival, bulk-service queues of the M/G/1 form
  European Journal of Operational Research, Vol. 212, No. 2
- The M/M/1 queue with synchronized abandonments
  31 March 2011 | Queueing Systems, Vol. 68, No. 1
- Mathematical Analysis of Throughput Bounds in Random Access with ZigZag Decoding
  17 December 2010 | Mobile Networks and Applications, Vol. 16, No. 2
- An M/M/1 system with an unreliable device and a threshold recovery policy
  8 January 2011 | Journal of Communications Technology and Electronics, Vol. 55, No. 12
- The Single Server Queue with Synchronized Services
  Stochastic Models, Vol. 26, No. 4
- A repairable queueing model with two-phase service, start-up times and retrial customers
  Computers & Operations Research, Vol. 37, No. 7
- An retrial queue with an unreliable server and general repair times
  Performance Evaluation, Vol. 67, No. 7
- A Single Server Retrial Queue with Bernoulli Feedback and Collisions
  Journal of Statistical Theory and Practice, Vol. 4, No. 2
- A single-server batch arrival queue with returning customers
  European Journal of Operational Research, Vol. 201, No. 3
- Optimal control of M/M/1 queueing system with constant retrial rate and non-reliable removable server
- Estimation of available bandwidth for an M/G/1 queueing system
  Applied Mathematical Modelling, Vol. 33, No. 8
- Mathematical analysis of throughput bounds in random access with ZIGZAG decoding
- A Queueing Model with Start-Up/Close-Down Times and Retrial Customers
  Stochastic Models, Vol. 25, No. 2
- Conditions for the stability of wireless ARQ protocols and reliable communications
- Analysis of a retrial queue with two-phase service and server vacations
  2 October 2008 | Queueing Systems, Vol. 60, No. 1-2
- Transmission costs, selfish nodes, and protocol design
  29 December 2006 | Wireless Networks, Vol. 14, No. 5
- Optimal Channel-Aware ALOHA Protocol for Random Access in WLANs With Multipacket Reception and Decentralized Channel State Information
  IEEE Transactions on Signal Processing, Vol. 56, No. 6
- Tests for nonergodicity of denumerable continuous time Markov processes
  Computers & Mathematics with Applications, Vol. 55, No. 6
- High-Throughput Random Access Using Successive Interference Cancellation in a Tree Algorithm
  IEEE Transactions on Information Theory, Vol. 53, No. 12
- Fair Resource Allocation in Wireless Networks Using Queue-Length-Based Scheduling and Congestion Control
  IEEE/ACM Transactions on Networking, Vol. 15, No. 6
- An M [X]/G/1 retrial queue with server breakdowns and constant rate of repeated attempts
  7 July 2007 | Annals of Operations Research, Vol. 157, No. 1
- Impatient Backoff Algorithm: Fairness in a Distributed Ad-Hoc MAC
- A two phase batch arrival retrial queueing system with Bernoulli vacation schedule
  Applied Mathematics and Computation, Vol. 188, No. 2
- Analysis of an M/{Dn}/1 retrial queue
  Journal of Computational and Applied Mathematics, Vol. 200, No. 2
- Stationary distribution of queue length in G / M / 1 queue with two-stage service policy
  6 September 2006 | Mathematical Methods of Operations Research, Vol. 64, No. 3
- An M/M/1 retrial queue with unreliable server
  Operations Research Letters, Vol. 34, No. 6
- Applying foster’s criteria to a GI / PH /1 queuing system
  Cybernetics and Systems Analysis, Vol. 42, No. 3
- A Batch Arrival Queue with a Second Optional Service Channel Under N -Policy
  Stochastic Analysis and Applications, Vol. 24, No. 1
- Parallel downloads for streaming applications—a resequencing analysis
  Performance Evaluation, Vol. 63, No. 1
- Recurrence Criterion
  15 August 2006
- Information Capacity and Power Control for Slotted Aloha Random-Access Systems
  IEEE Transactions on Information Theory, Vol. 51, No. 12
- Price-based rate control in random access networks
  IEEE/ACM Transactions on Networking, Vol. 13, No. 5
- DISCRETE-TIME QUEUE WITH VARIABLE SERVICE CAPACITY
  Journal of the Korean Mathematical Society, Vol. 42, No. 3
- Exploiting decentralized channel state information for random access
  IEEE Transactions on Information Theory, Vol. 51, No. 2
- Achieving Fairness in a Distributed Ad-Hoc MAC
- Fair resource allocation in wireless networks using queue-length-based scheduling and congestion control
- Transmission Costs, Selfish Nodes, and Protocol Design
- Non-ergodicity criteria for denumerable continuous time Markov processes
  Operations Research Letters, Vol. 32, No. 6
- Recurrence Criterion
  15 October 2004
- Ergodicity of a certain class of Non Feller Models: Applications to ARCH and Markov switching models
  15 September 2004 | ESAIM: Probability and Statistics, Vol. 8
- Rate control for random access networks: The finite node case
- Minimal backlogging method for estimation of available bandwidth
- AN OVERVIEW OF SOME STOCHASTIC STABILITY METHODS(Network Design, Control and Optimization)
  Journal of the Operations Research Society of Japan, Vol. 47, No. 4
- A queueing system with linear repeated attempts, bernoulli schedule and feedback
  Top, Vol. 11, No. 2
- Discrete-Time Geo X /G/1 Queue with Preemptive Repeat Different Priority
  Queueing Systems, Vol. 44, No. 4
- Stability of multipacket slotted Aloha with selfish users and perfect information
- On non-ergodic infinite-state stochastic Petri nets
- Resequencing considerations in parallel downloads
- Reliability Analysis of the Retrial Queue with Server Breakdowns and Repairs
  Queueing Systems, Vol. 38, No. 4
- STABILITY IN QUEUES WITH IMPATIENT CUSTOMERS
  Stochastic Models, Vol. 17, No. 3
- The BMAP/G/1 Queue with Level-Dependent Arrivals – An Overview
  Telecommunication Systems, Vol. 16, No. 3-4
- Randomized Communication in Radio Networks
- Ergodicity of a polling network with an infinite number of stations
  Queueing Systems, Vol. 32, No. 1-3
- Bibliography
  27 May 2008
- A batch arrival reader-writer queue with retrial writers
  Communications in Statistics. Stochastic Models, Vol. 13, No. 3
- Adaptive control strategy for the multi-layer collision resolution protocol
- The generalizedD [X] /D/1 queue: A flexible computer communications model
  Telecommunication Systems, Vol. 6, No. 1
- On oscillating random walks
  Siberian Mathematical Journal, Vol. 37, No. 4
- Heavy traffic analysis of integrated services systems
  Performance Evaluation, Vol. 24, No. 4
- Stability and throughput optimization of multichannel slotted non-persistent CSMA protocol
  Computer Communications, Vol. 18, No. 12
- A framework for jitter analysis in cell based multiplexers
  Performance Evaluation, Vol. 22, No. 3
- Two processes interacting only during breakdown: The case where the load is not lost
  Queueing Systems, Vol. 19, No. 3
- An error bound for a continuous time approximation of a time-sharing queue
  21 March 2007 | Communications in Statistics. Stochastic Models, Vol. 11, No. 1
- Heavy traffic analysis of a random walk on a lattice semi-strip
  Communications in Statistics. Stochastic Models, Vol. 11, No. 3
- Unslotted CSMA/CD protocol with the threshold control policy
  Korean Journal of Computational & Applied Mathematics, Vol. 1, No. 1
- Stability and throughput optimisation of multichannelslotted nonpersistent CSMA random choice protocol
  Electronics Letters, Vol. 30, No. 17
- TheM/G/1 retrial queue with the server subject to starting failures
  Queueing Systems, Vol. 16-16, No. 1-2
- Message delay analysis of the DQDB subnetwork based on an approximate node model
  IEEE Transactions on Communications, Vol. 42, No. 2/3/4
- Bounds on the delay distribution of window random-access algorithms
  IEEE Transactions on Communications, Vol. 41, No. 5
- A class of scheduling policies for mixed data with renewal arrival processes
  IEEE Transactions on Automatic Control, Vol. 38, No. 3
- Transmission algorithms for a multi‐channel packet radio system with priority users
  21 March 2007 | International Journal of Digital & Analog Communication Systems, Vol. 6, No. 4
- Saturation conditions for Stochastic Petri Nets
  6 June 2005
- The M/G/1 Retrial Queue With Retrial Rate Control Policy
  27 July 2009 | Probability in the Engineering and Informational Sciences, Vol. 7, No. 1
- The Average Cost Optimality Equation and Critical Number Policies
  27 July 2009 | Probability in the Engineering and Informational Sciences, Vol. 7, No. 1
- A queueing theoretic approach to the delay analysis for the FCFS 0.487 conflict resolution algorithm
  IEEE Transactions on Information Theory, Vol. 39, No. 6
- Retrial queues with collision arising from unslottedCSMA/CD protocol
  Queueing Systems, Vol. 11, No. 4
- Analysis, stability and optimization of Aloha-type protocols for multichannel networks
  Computer Communications, Vol. 15, No. 10
- Transient phenomena for Markov chains and applications
  1 July 2016 | Advances in Applied Probability, Vol. 24, No. 2
- Delay upper bounds for a finite user random-access system with bursty arrivals
  IEEE Transactions on Communications, Vol. 40, No. 3
- A random-access algorithm for data networks carrying high-priority traffic
  IEEE Transactions on Communications, Vol. 40, No. 1
- Near-optimum control of multiple-access collision channels
  IEEE Transactions on Communications, Vol. 40, No. 8
- A transmission scheduling algorithm for mixed traffic: high and low priority
- Message delay analysis of the DQDB (IEEE 802.6) network
- Value iteration in countable state average cost Markov decision processes with unbounded costs
  Annals of Operations Research, Vol. 28, No. 1
- A certainty equivalence principle based nonlinear separation control rule for random access channels: Stability and delay analysis
  Information Sciences, Vol. 56, No. 1-3
- An optimal policy for competitive processing of high‐ and low‐priority arrivals
  21 March 2007 | International Journal of Digital & Analog Communication Systems, Vol. 4, No. 3
- Optimal routing to parallel heterogeneous servers-small arrival rates
  IEEE Transactions on Automatic Control, Vol. 35, No. 7
- Chapter 11 Queueing networks
- Random-access systems with a time varying channel
  IEEE Transactions on Communications, Vol. 38, No. 9
- Waiting time analysis in a single buffer DQDB (802.6) network
  IEEE Journal on Selected Areas in Communications, Vol. 8, No. 8
- Waiting time analysis in a single buffer DQDB (802.6) network
- A random access algorithm for data networks carrying high priority traffic
- Throughput analysis of blocked access tree algorithms with mini-slots
  Computer Networks and ISDN Systems, Vol. 17, No. 3
- Phase transitions in queueing systems connected with a virtual expectation time
  Ukrainian Mathematical Journal, Vol. 41, No. 7
- Optimal decentralized control in the random access multipacket channel
  IEEE Transactions on Automatic Control, Vol. 34, No. 11
- Optimal dispatching to parallel heterogeneous servers in light traffic
- Interconnection of CSMA/CD LANs via an N-port bridge
- Delay analysis of an asymmetric, buffered random access system
- Interconnection algorithms in multi-hop packet radio topologies
- On the Ergodicity and Stability of the Sequence $w_{n + 1} = f(w_n ,\xi _n )$: Applications to Communication Networks
  Theory of Probability & Its Applications, Vol. 33, No. 4
- Asymptotic inference for continuous-time Markov chains
  Probability Theory and Related Fields, Vol. 77, No. 4
- Ergodicity of Random walks in the half-strip
  Mathematical Notes of the Academy of Sciences of the USSR, Vol. 44, No. 2
- On periodic phenomena and stationary distribution of queueing system M/G/1 with group arrivals and batch service
  Acta Mathematicae Applicatae Sinica, Vol. 4, No. 3
- Stability properties of slotted Aloha with multipacket reception capability
  IEEE Transactions on Automatic Control, Vol. 33, No. 7
- An algorithm for random access communication over noisy channels
- Retransmission control of capture-ALOHA systems
- Performance modeling of distributed multiaccess protocols
- Asymptotic marginal independence in large networks of loss systems
  Annals of Operations Research, Vol. 8, No. 1
- On the Relation Between the Finite and the Infinite Population Models for a Class of RAA's
  IEEE Transactions on Communications, Vol. 35, No. 11
- Conditions for the non-ergodicity of Markov chains with application to a communication system
  14 July 2016 | Journal of Applied Probability, Vol. 24, No. 2
- Erasures and noise in splitting multiple access algorithms
  IEEE Transactions on Information Theory, Vol. 33, No. 1
- Control procedures for slotted Aloha systems that achieve stability
  1 August 1986 | ACM SIGCOMM Computer Communication Review, Vol. 16, No. 3
- Control procedures for slotted Aloha systems that achieve stability
  1 August 1986
- A new condition for the existence of optimal stationary policies in average cost Markov decision processes
  Operations Research Letters, Vol. 5, No. 1
- Markov chains with binomial time change
  14 July 2016 | Journal of Applied Probability, Vol. 23, No. 02
- Markov chains with binomial time change
  14 July 2016 | Journal of Applied Probability, Vol. 23, No. 2
- Computation of the state probabilities in a class of semi-regenerative queueing models
- The M/G/1/1 queue with repeated attempts and different types of feedback effects
  OR Spektrum, Vol. 7, No. 4
- Tree-Based Multiaccess Protocols Where Collision Multiplicities Are Known
  IEEE Transactions on Communications, Vol. 33, No. 9
- Stability and throughout in virtual time CSMA
  Computer Networks and ISDN Systems, Vol. 10, No. 1
- Comments on "Synchronous and Channel-Sense Asynchronous Dynamic Group-Random-Access Schemes for Multiple-Access Communications"
  IEEE Transactions on Communications, Vol. 33, No. 6
- The Effect of Capture on Collision-Resolution Algorithms
  IEEE Transactions on Communications, Vol. 33, No. 4
- Some sufficient conditions for non-ergodicity of markov chains
  14 July 2016 | Journal of Applied Probability, Vol. 22, No. 1
- A Modified Access Policy for ETHERNETTMVersion 1.0 Data Link Layer
  IEEE Transactions on Communications, Vol. 32, No. 8
- The asymptotic behavior o queues with time-varying arrival rates
  14 July 2016 | Journal of Applied Probability, Vol. 21, No. 01
- The asymptotic behavior o queues with time-varying arrival rates
  14 July 2016 | Journal of Applied Probability, Vol. 21, No. 1
- Ergodicity aspects of multidimensional Markov chains with application to computer communication system analysis
- Performance Analysis of an Integrated Switch with Fixed or Variable Frame Rate and Movable Voice/Data Boundary
  IEEE Transactions on Communications, Vol. 32, No. 1
- Computation of the state probabilities in M/G/1 queues with state dependent input and state dependent service
  1 December 1983 | Operations-Research-Spektrum, Vol. 5, No. 4
- Stabilité de la récurrence nulle pour certaines chaines de Markov perturbées
  14 July 2016 | Journal of Applied Probability, Vol. 20, No. 03
- Stabilité de la récurrence nulle pour certaines chaines de Markov perturbées
  14 July 2016 | Journal of Applied Probability, Vol. 20, No. 3
- Stabilite de la recurrence d'une chaine de markov sous i'effet d'une perturbation
  8 May 2007 | Stochastics, Vol. 9, No. 1-2
- Hitting-time and occupation-time bounds implied by drift analysis with applications
  1 July 2016 | Advances in Applied Probability, Vol. 14, No. 3
- A note on the ergodicity of Markov chains
  14 July 2016 | Journal of Applied Probability, Vol. 18, No. 1
- Criteria for ergodicity, exponential ergodicity and strong ergodicity of Markov processes
  14 July 2016 | Journal of Applied Probability, Vol. 18, No. 1
- A positive recurrence criterion associated with multidimensional queueing processes
  14 July 2016 | Journal of Applied Probability, Vol. 17, No. 03
- A positive recurrence criterion associated with multidimensional queueing processes
  14 July 2016 | Journal of Applied Probability, Vol. 17, No. 3
- A sufficient condition of nonergodicity of a Markov chain (Corresp.)
  IEEE Transactions on Information Theory, Vol. 25, No. 4
- Transience and recurrence of state-dependent branching processes with an immigration component
  1 July 2016 | Advances in Applied Probability, Vol. 11, No. 1
- Necessary and sufficient conditions for recurrence and transience of Markov chains, in terms of inequalities
  14 July 2016 | Journal of Applied Probability, Vol. 15, No. 04
- Necessary and sufficient conditions for recurrence and transience of Markov chains, in terms of inequalities
  14 July 2016 | Journal of Applied Probability, Vol. 15, No. 4
- Techniques for establishing ergodic and recurrence properties of continuous‐valued markov chains
  21 November 2006 | Naval Research Logistics Quarterly, Vol. 25, No. 3
- Near optimal behaviour of the packet switching broadcast channel
- Algebraic characterization of infinite Markov chains where movement to the right is limited to one step
  14 July 2016 | Journal of Applied Probability, Vol. 14, No. 4
- Hitting times of Markov chains, with application to state-dependent queues
  17 April 2009 | Bulletin of the Australian Mathematical Society, Vol. 17, No. 1
- Stability and Optimal Control of the Packet Switching Broadcast Channel
  1 July 1977 | Journal of the ACM, Vol. 24, No. 3
- Existence and uniqueness of stationary distributions in a model of roll-back recovery
- Criteria for classifying general Markov chains
  1 July 2016 | Advances in Applied Probability, Vol. 8, No. 4
- On the equivalence of certain Markov chains
  14 July 2016 | Journal of Applied Probability, Vol. 13, No. 02
- On the equivalence of certain Markov chains
  14 July 2016 | Journal of Applied Probability, Vol. 13, No. 2
- Sufficient conditions for ergodicity and recurrence of Markov chains on a general state space
  Stochastic Processes and their Applications, Vol. 3, No. 4
- Sufficient conditions for regularity, recurrence and ergodicity of Markov processes
  24 October 2008 | Mathematical Proceedings of the Cambridge Philosophical Society, Vol. 78, No. 1
- RELATIONS BETWEEN ERGODICITY AND MEAN DRIFT FOR MARKOV CHAINS 1
  28 June 2008 | Australian Journal of Statistics, Vol. 17, No. 2
- A queue with waiting time dependent service times
  21 November 2006 | Naval Research Logistics Quarterly, Vol. 20, No. 2
- A Note on Feedback Queues with Bulk Service
  1 October 1972 | Journal of the ACM, Vol. 19, No. 4
- The analysis of queues by state-dependent parameters by Markov renewal processes
  1 July 2016 | Advances in Applied Probability, Vol. 3, No. 1

Volume 17, Issue 6

November-December 1969

Pages 927-1092

Article Information

Metrics

Information

Published Online:December 01, 1969

Cite as

A. G. Pakes, (1969) Some Conditions for Ergodicity and Recurrence of Markov Chains. Operations Research 17(6):1058-1061.

https://doi.org/10.1287/opre.17.6.1058

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Some Conditions for Ergodicity and Recurrence of Markov Chains

Abstract

Volume 17, Issue 6

Article Information

Metrics

Information

Cite as

Sign Up for INFORMS Publications Updates and News