Free Access

Exceptional Paper—Markov Renewal Theory: A Survey

Erhan Çinlar
Erhan Çinlar
Northwestern University
Search for more papers by this author

Erhan Çinlar

Northwestern University

Search for more papers by this author

Published Online:1 Mar 1975https://doi.org/10.1287/mnsc.21.7.727

Cited by
- Availability Evaluation and Maintenance Optimization of Balanced Systems Considering State-Dependent Inspection Intervals
  IEEE Transactions on Reliability, Vol. 74, No. 1
- Availability Analysis of Satellite Constellation Based on METRIC Theory
  18 March 2025
- Finite hybrid- and semi-Markov chains
  Mathematical Control and Related Fields, Vol. 0, No. 0
- Weighted-indexed semi-Markov model: calibration and application to financial modeling
  15 January 2023 | Financial Innovation, Vol. 9, No. 1
- Arbitrarily accurate, nonparametric coarse graining with Markov renewal processes and the Mori–Zwanzig formulation
  29 September 2023 | AIP Advances, Vol. 13, No. 9
- A Bayesian decision support system for counteracting activities of terrorist groups
  24 January 2023 | Journal of the Royal Statistical Society Series A: Statistics in Society, Vol. 186, No. 3
- A Semi-Markov Approach to Financial Modelling During the COVID-19 Pandemic
  10 November 2023
- Compositional Analysis of Hierarchical UML Statecharts
  IEEE Transactions on Software Engineering, Vol. 146
- A predictive maintenance policy considering the market price volatility for deteriorating systems
  Computers & Industrial Engineering, Vol. 162
- Forecasting intermittent and sparse time series: A unified probabilistic framework via deep renewal processes
  29 November 2021 | PLOS ONE, Vol. 16, No. 11
- How far are mangrove ecosystems in Benin (West Africa) conserved by the Ramsar Convention?
  Land Use Policy, Vol. 108
- An adaptive predictive maintenance model for repairable deteriorating systems using inverse Gaussian degradation process
  Reliability Engineering & System Safety, Vol. 213
- The ORIS Tool: Quantitative Evaluation of Non-Markovian Systems
  IEEE Transactions on Software Engineering, Vol. 47, No. 6
- Renewal Theorems and Their Application in Fractal Geometry
  24 March 2021
- Dual Sourcing and Joint Replenishment of Hospital Supplies
  IEEE Transactions on Engineering Management, Vol. 67, No. 3
- Minimizing Age of Information in Multi-channel Time-sensitive Information Update Systems
- Staircase patterns in words: Subsequences, subwords, and separation number
  European Journal of Combinatorics, Vol. 86
- Modelling failures times with dependent renewal type models via exchangeability
  21 May 2019 | Statistics, Vol. 53, No. 5
- Optimal Satellite Constellation Spare Strategy Using Multi-Echelon Inventory Control
  Journal of Spacecraft and Rockets, Vol. 56, No. 5
- Spectrum Sensing Using Markovian Models
  22 February 2019
- A Note on Sufficient Conditions of Almost Sure Exponential Stability for Semi-Markovian Jump Stochastic Systems
  IEEE Access, Vol. 7
- Fluctuation Theory for Markov Random Walks
  10 August 2017 | Journal of Theoretical Probability, Vol. 31, No. 4
- Ladder epochs and ladder chain of a Markov random walk with discrete driving chain
  1 February 2019 | Advances in Applied Probability, Vol. 50, No. A
- Mapping changes in land use/land cover and prediction of future extension of bowé in Benin, West Africa
  Land Use Policy, Vol. 69
- Bibliography
  26 May 2017
- Asymptotic behavior for a generalized Domany–Kinzel model
  27 February 2017 | Journal of Statistical Mechanics: Theory and Experiment, Vol. 2017, No. 2
- Exploiting Non-deterministic Analysis in the Integration of Transient Solution Techniques for Markov Regenerative Processes
  11 August 2017
- Spectrum Sensing Using Markovian Models
  31 May 2017
- Strategies for energy pricing to modify energy consumption using reward process functions
  13 July 2017 | Energy and Policy Research, Vol. 4, No. 1
- Evaluation of transitional behavior of wetness/drought regimes in the Poyang Lake Basin, China
  16 August 2015 | Theoretical and Applied Climatology, Vol. 126, No. 3-4
- Reliability Evaluation of a Load-sharing Parallel System with Failure Dependence
  21 October 2014 | Communications in Statistics - Simulation and Computation, Vol. 45, No. 9
- Stability of Markov regenerative switched linear systems
  Automatica, Vol. 69
- Reliability evaluation of a Semi-Markov repairable system under alternative environments
  13 July 2015 | Communications in Statistics - Theory and Methods, Vol. 45, No. 10
- Probabilistic Model Checking of Regenerative Concurrent Systems
  IEEE Transactions on Software Engineering, Vol. 42, No. 2
- Hierarchical and Stochastic Modelling
  8 June 2016
- References
- Stability of Spreading Processes over Time-Varying Large-Scale Networks
  IEEE Transactions on Network Science and Engineering, Vol. 3, No. 1
- Bibliography
  7 August 2015
- Mission reliability of semi-Markov systems under generalized operational time requirements
  Reliability Engineering & System Safety, Vol. 140
- HITS: Hurricane Intensity and Track Simulator with North Atlantic Ocean Applications for Risk Assessment
  Journal of Applied Meteorology and Climatology, Vol. 54, No. 7
- Semi-Markov and reward fields
  Statistics & Probability Letters, Vol. 95
- Semi‐Markov Processes ‐ Basic
  29 September 2014
- Markov Decision Process and Linear Programming Based Control of MAP/MAP/N Queues
- Bivariate Markov Processes and Their Estimation
  26 June 2013 | Foundations and Trends® in Signal Processing, Vol. 6, No. 1
- DYNAMIC ANALYSIS OF A MULTIVARIATE REWARD PROCESS DEFINED ON THE UMCP WITH APPLICATION TO OPTIMAL PREVENTIVE MAINTENANCE POLICY PROBLEMS IN MANUFACTURING
  28 March 2013 | Probability in the Engineering and Informational Sciences, Vol. 27, No. 2
- Maintenance optimisation of a multi-state series–parallel system considering economic dependence and state-dependent inspection intervals
  Reliability Engineering & System Safety, Vol. 111
- Consistency of Maximum Likelihood Parameter Estimation for Bivariate Markov Chains
  Stochastic Models, Vol. 29, No. 1
- An EM algorithm for continuous-time bivariate Markov chains
  Computational Statistics & Data Analysis, Vol. 57, No. 1
- Reliability Evaluation of Two-Stage Directed Semi-Markov Repairable Network Systems
  Applied Mathematics, Vol. 04, No. 04
- A diagnostic approach to Weibull‐Weibull stress‐strength model and its generalization
  International Journal of Quality & Reliability Management, Vol. 28, No. 4
- Aggregated semi-Markov repairable systems with history-dependent up and down states
  Mathematical and Computer Modelling, Vol. 53, No. 5-6
- Passage-time computation and aggregation strategies for large semi-Markov processes
  Performance Evaluation, Vol. 68, No. 3
- On modeling network congestion using continuous-time bivariate Markov chains
- Web Markov skeleton processes and their applications
  Tohoku Mathematical Journal, Vol. 63, No. 4
- An EM Algorithm for Markov Modulated Markov Processes
  IEEE Transactions on Signal Processing, Vol. 57, No. 2
- Dynamic Analysis of a Unified Multivariate Counting Process and Its Asymptotic Behavior
  22 September 2009 | International Journal of Mathematics and Mathematical Sciences, Vol. 2009, No. 1
- DYNAMIC ANALYSIS OF A REWARD PROCESS DEFINED ON A CYCLIC RENEWAL PROCESS WITH APPLICATIONS TO PREVENTIVE MAINTENANCE PROBLEMS
  Journal of the Operations Research Society of Japan, Vol. 52, No. 3
- Strong Law of Large Numbers for Nonlinear Semi-Markov Reward Processes
  Asian Journal of Mathematics & Statistics, Vol. 1, No. 1
- Some Reward Paths in Semi-Markov Models with Stochastic Selection of the Transition Probabilities
  5 May 2007 | Methodology and Computing in Applied Probability, Vol. 9, No. 3
- Chapter 15 Queuing Theoretic Approaches to Financial Price Fluctuations
- A Stochastic Model for the HIV/AIDS Dynamic Evolution
  Mathematical Problems in Engineering, Vol. 2007
- TWO COMMODITY COORDINATED INVENTORY SYSTEM WITH MARKOVIAN DEMAND
  20 November 2011 | Asia-Pacific Journal of Operational Research, Vol. 23, No. 04
- A Limit Theorem for Financial Markets with Inert Investors
  Erhan Bayraktar,
  Ulrich Horst,
  Ronnie Sircar,
  1 November 2006 | Mathematics of Operations Research, Vol. 31, No. 4
- Homogeneous semi-Markov reliability models for credit risk management*
  Decisions in Economics and Finance, Vol. 28, No. 2
- Semi‐Markov Processes
  15 August 2006
- Simple derivations of properties of counting processes associated with Markov renewal processes
  14 July 2016 | Journal of Applied Probability, Vol. 42, No. 4
- S emi‐ M arkov Processes
  15 October 2004
- Economic Rewards in Non-homogeneous Semi-Markov Systems
  Communications in Statistics - Theory and Methods, Vol. 33, No. 3
- Minimizing Cost of Continuous Audit: Counting and Time Dependent Strategies
  SSRN Electronic Journal, Vol. 21
- Dynamic Airline Revenue Management with Multiple Semi-Markov Demand
  Shelby Brumelle,
  Darius Walczak,
  1 February 2003 | Operations Research, Vol. 51, No. 1
- Minimizing Cost of Continuous Audit: Counting and Time Dependent Strategies
  SSRN Electronic Journal, Vol. 21
- GI / M /1/1 queue with finite retrials and finite orbits
  15 February 2007 | Stochastic Analysis and Applications, Vol. 20, No. 2
- On Numerical Solution of the Markov Renewal Equation: Tight Upper and Lower Kernel Bounds
  Methodology And Computing In Applied Probability, Vol. 3, No. 3
- Moment Solutions for the State Exiting Counting Processes of a Markov Renewal Process
  Methodology And Computing In Applied Probability, Vol. 1, No. 3
- Managing supply chain inventories: A multiple retailer, one warehouse, multiple supplier model
  International Journal of Production Economics, Vol. 59, No. 1-3
- Semi-Markov Models for Lifetime Data Analysis
- Reward processes for semi-Markov processes: asymptotic behaviour
  14 July 2016 | Journal of Applied Probability, Vol. 35, No. 04
- Reward processes for semi-Markov processes: asymptotic behaviour
  14 July 2016 | Journal of Applied Probability, Vol. 35, No. 4
- Reward processes with nonlinear reward functions
  14 July 2016 | Journal of Applied Probability, Vol. 33, No. 4
- Probability of first passage analysis of a two-stage transfer-line production system with storage and rework
  Microelectronics Reliability, Vol. 36, No. 3
- A finite capacity G (1,2) / M (1,2) /1 queue with markov dependent shift in service
  Optimization, Vol. 37, No. 2
- Expected number analysis of a two-server queueing network subject to inter-stage inspection and rework
  Computers & Operations Research, Vol. 22, No. 9
- Probabilistic analysis of a n-unit cold-standby system with general failure and repair time distributions
  Microelectronics Reliability, Vol. 35, No. 5
- Analysis of an n ‐unit cold‐standby system with general failure and repair time distributions
  International Journal of Quality & Reliability Management, Vol. 12, No. 3
- Strong approximation of the number of renewal paced record times
  Journal of Statistical Planning and Inference, Vol. 45, No. 1-2
- Multi‐type Rework in Two‐stage Production Systems
  International Journal of Quality & Reliability Management, Vol. 11, No. 6
- Superposition of Markov renewal processes and applications
  1 July 2016 | Advances in Applied Probability, Vol. 25, No. 3
- TRANSIENT ANALYSIS OF THE DYNAMICS OF A MANUFACTURING SYSTEM: A CASE STUDY11This research has been supported by NSERC-Canada, Grants # OGP003 6444, FCAR NC0271 F and OGP0006820
- Transient Analysis of the Dynamics of a Manufacturing System: A Case Study 1
  IFAC Proceedings Volumes, Vol. 25, No. 7
- New better than used in expectation processes
  14 July 2016 | Journal of Applied Probability, Vol. 29, No. 01
- New better than used in expectation processes
  14 July 2016 | Journal of Applied Probability, Vol. 29, No. 1
- A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions
  14 July 2016 | Journal of Applied Probability, Vol. 28, No. 02
- A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions
  14 July 2016 | Journal of Applied Probability, Vol. 28, No. 2
- A renewal theoretic analysis of a class of manufacturing systems
  IEEE Transactions on Automatic Control, Vol. 36, No. 5
- A jump-driven Markovian electric load model
  1 July 2016 | Advances in Applied Probability, Vol. 22, No. 3
- A novel viewpoint for the analysis of the production control of FMS
- First passage times and lumpability of semi-Markov processes
  14 July 2016 | Journal of Applied Probability, Vol. 25, No. 04
- First passage times and lumpability of semi-Markov processes
  14 July 2016 | Journal of Applied Probability, Vol. 25, No. 4
- Inspection policies and processes for deteriorating systems subject to catastrophic failure
  Naval Research Logistics, Vol. 35, No. 4
- Dynamic Performance Evaluation of Communication/Computer Systems with Highly Reliable Components
  27 July 2009 | Probability in the Engineering and Informational Sciences, Vol. 2, No. 2
- Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of state space
  1 July 2016 | Advances in Applied Probability, Vol. 19, No. 4
- On the unutilized capacity of a production-storage system
  Operations Research Letters, Vol. 6, No. 5
- Operating characteristics of a two-echelon inventory system for repairable and consumable items under batch ordering and shipment policy
  Naval Research Logistics, Vol. 34, No. 3
- Two-Parameter Approximations For Multi-Echelon Repairable Inventory Models With Batch Ordering Policy
  IIE Transactions, Vol. 19, No. 2
- An alternative approach to the analysis of finite semi-markov and related processes
  21 March 2007 | Communications in Statistics. Stochastic Models, Vol. 3, No. 1
- A class of general stochastic compartmental systems
  Bulletin of Mathematical Biology, Vol. 48, No. 5-6
- A useful generalization of renewal theory: counting processes governed by non-negative Markovian increments
  14 July 2016 | Journal of Applied Probability, Vol. 23, No. 1
- A Second bibliography on semi-Markov processes
- Filtering of Markov renewal queues, IV: Flow processes in feedback queues
  1 July 2016 | Advances in Applied Probability, Vol. 17, No. 2
- Analysis of an exhibiting inventory system
  12 April 2007 | Stochastic Analysis and Applications, Vol. 3, No. 4
- Some notes on the total service time in certain loss systems
  14 July 2016 | Journal of Applied Probability, Vol. 21, No. 03
- Some notes on the total service time in certain loss systems
  14 July 2016 | Journal of Applied Probability, Vol. 21, No. 3
- The matrix Laguerre transform
  Applied Mathematics and Computation, Vol. 15, No. 1
- Filtering of Markov renewal queues, III: semi-Markov processes embedded in feedback queues
  1 July 2016 | Advances in Applied Probability, Vol. 16, No. 2
- Filtering of Markov renewal queues, I: Feedback queues
  1 July 2016 | Advances in Applied Probability, Vol. 15, No. 2
- Filtering of Markov renewal queues, II: Birth-death queues
  1 July 2016 | Advances in Applied Probability, Vol. 15, No. 2
- Stationary queuing systems with dependencies
  Journal of Soviet Mathematics, Vol. 21, No. 6
- A note on "Multilayer control of large markov chains"
  IEEE Transactions on Automatic Control, Vol. 27, No. 3
- References Supplement
- Regenerative processes with Markov-dependent cycles and their applications
  27 June 2007 | Mathematische Operationsforschung und Statistik. Series Optimization, Vol. 13, No. 2
- Estimation of the parameters of a semi-Markov process from censored records
  1 July 2016 | Advances in Applied Probability, Vol. 13, No. 4
- Response-time simulation of multivariate point process models for multiprogrammed jobstreams
  International Journal of Computer & Information Sciences, Vol. 9, No. 2
- Some limit theorems for the general semi-Markov storage model
  14 July 2016 | Journal of Applied Probability, Vol. 16, No. 03
- Some limit theorems for the general semi-Markov storage model
  14 July 2016 | Journal of Applied Probability, Vol. 16, No. 3
- The aggregation problem of logistic processes
  27 April 2007 | International Journal of Systems Science, Vol. 10, No. 8
- A circulatory model for human metabolism
  Journal of Theoretical Biology, Vol. 74, No. 4
- Managing Wilderness Travel: A Markov-Based Linear Programming Model
  1 January 1978 | Environment and Planning A: Economy and Space, Vol. 10, No. 1
- A continuous review inventory model with compound poisson demand process and stochastic lead time
  21 November 2006 | Naval Research Logistics Quarterly, Vol. 24, No. 4

Volume 21, Issue 7

March 1975

Pages 727-847

Article Information

Metrics

Information

Published Online:March 01, 1975

Cite as

Erhan Çinlar, (1975) Exceptional Paper—Markov Renewal Theory: A Survey. Management Science 21(7):727-752.

https://doi.org/10.1287/mnsc.21.7.727

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Exceptional Paper—Markov Renewal Theory: A Survey

Volume 21, Issue 7

Article Information

Metrics

Information

Cite as

Sign Up for INFORMS Publications Updates and News