Improved Dynamic Programming Methods for Optimal Control of Lumped-Parameter Stochastic Systems

References

• Bar-Shalom Y. Stochastic dynamic programming: Caution and probing. IEEE Trans. Automatic Control (1981) AC-26(5):1184–1195Crossref, Google Scholar
• Bar-Shalom Y., Tse E., Leondes C. T. Concepts and methods in stochastic control. Control and Dynamic Systems (1976) 99–172Crossref, Google Scholar
• Bellman R. E.Dynamic Programming (1957) (Princeton University Press, Princeton, NJ) Google Scholar
• Bellman R. E., Dreyfus S. E.Applied Dynamic Programming (1962) (Princeton University Press, Princeton, NJ) Crossref, Google Scholar
• Bertsekas D. P., Tsitsiklis J. N.Neuro-Dynamic Programming (1996) (Athena Scientific, Belmont, MA) Google Scholar
• Chow V T., Maidment D. R., Tauxe G. W. Computer time and memory requirements for DP and DDDP in water resource systems analysis. Water Resources Res.11(5):621–628Crossref, Google Scholar
• Davis P.J.Interpolation and Approximation (1975) (Dover Publications, Toronto, Ontario) Google Scholar
• Ecker J. G., Kupferschid M.Introduction to Operations Research (1991) (Krieger Publishing, Malabar,FL) Google Scholar
• Foufoula-Georgiou E. Convex interpolation for gradient dynamic programming. Water Resources Res. (1991) 27(1):31–36Crossref, Google Scholar
• Foufoula-Georgiou E., Kitanidis P. K. Gradient dynamic programming for stochastic optimal control of multidimensional water resources systems. Water Resources Res. (1988) 24(8):1345–1359Crossref, Google Scholar
• Gal S. Optimal management of a multireservoir water supply system. Water Resources Res. (1979) 15(4):737–749Crossref, Google Scholar
• Georgakakos A. P., Esogbue A. O. Extended linear quadratic guassian control for the real time operatoin of reservoir systems. (1989a) (Prentice Hall, Englewood Cliffs, NJ) 329–360Dynamic Programming for Optimal Water Resources Systems AnalysisGoogle Scholar
• Georgakakos A. P. Extended linear quadratic gaussian control: further extensions. Water Resources Res. (1989b) 25(2):191–201Crossref, Google Scholar
• Georgakakos A. P., Marks D. H. New method for the real-time operation of reservoir systems. Water Resources Res. (1987) 23(7):1376–1390Crossref, Google Scholar
• Gill P. E., Murray W., Saunders M. A., Wright M. H. User's Guide for NPSOL (Version 4.0): A Fortran Package for Nonlinear Programming. (1986) . Technical Report SOL 86-2, Department of Operations Research, Stanford University, Stanford, CAGoogle Scholar
• Heidari M., Te Chow V. E. N., Kokotovic P. V, Meredith D. D. Discrete differential dynamic programming approach to water resources systems optimization. Water Resources Res. (1971) 7(2):273–282Crossref, Google Scholar
• Infanger G. Monte Carlo (importance) sampling within a Benders decomposition algorithm for stochastic linear programs. Ann. Oper. Res. (1991) 39:69–95Crossref, Google Scholar
• Jain S. K., Goel M. K., Agarwal P. K. Reservoir operation studies of Sabarmati system, India. J. Water Resources Planning and Management (1998) 124(1):31–38Crossref, Google Scholar
• Johnson S. A., Stedinger J. R., Shoemaker C. A., Li Y., Tejada-Guibert J. A. Numerical solution of continuous-state dynamic programs using linear and spline interpolation. Oper. Res. (1993) 41(3):484–500Link, Google Scholar
• Johnson S. A., Stedinger J. R., Staschus K. Heuristic operating policies for reservoir system simulation. Water Resources Res. (1991) 27(5):673–685Crossref, Google Scholar
• Kitanidis P. K. Real-time forecasting of river flows and stochastic optimal control of multireservoir systems. (1983) . IIHR report no 258, ISWRRI completion report no 133, Iowa Institute of Hydraulic Research, The University of Iowa, Iowa City, IAGoogle Scholar
• Kitanidis P. K. Hermite interpolation on an n-dimensional rectangular grid. (1986) (St. Anthony Falls Hydraulics Laboratory, University of Minnesota, Minneapolis) Google Scholar
• Kitanidis P. K. A first-order approximation to stochastic optimal control of reservoirs. Stochastic Hydrology and Hydraulics (1987) 1(3):169–184Crossref, Google Scholar
• Kitanidis P. K., Andricevic R., Esogbue A. O. Accuracy of the first-order approximation to the stochastic optimal control of reservoirs. (1989) (Prentice Hall, Englewood Cliffs, NJ) 373–385Dynamic Programming for Optimal Water Resources Systems AnalysisGoogle Scholar
• Kitanidis P. K., Foufoula Georgiou E. “Error analysis of conventional discrete and gradient dynamic programming”. Water Resources Res. (1987) 23(5):845–858Crossref, Google Scholar
• Lamond B. F., Boukhtouta A. Optimizing future hydropower production using Markov decision processes. (1995) (Laval University, Quebec, Canada) . Document of Work 95-44Google Scholar
• Larson R. E.State Increment Dynamic Programming (1968) (Elsevier, New York) Google Scholar
• Marino M. A., Mahammadi B. Reservoir management: A reliability programming approach. Water Resources Res. (1983) 19(3):613–620Crossref, Google Scholar
• Marino M. A., Simonovic S. P. Single multipurpose reservoir design: a modified optimal control problem by chance-constrained programming. Advances in Water Resources (1981) 4(1):43–48Crossref, Google Scholar
• Murray D., Yakowitz S. Constrained differential dynamic programming and its application to multireservoir control. Water Resources Res. (1979) 15(5):1017–1027Crossref, Google Scholar
• Pereira M. V. F., Pinto L. M. V. G. Stochastic optimization of a multireservoir hydroelectric system: a decomposition approach. Water Resources Res. (1985) 21(6):779–792Crossref, Google Scholar
• Pereira M. V. F., Pinto L. M. V. G. Multi-stage stochastic optimization applied to energy planning. Mathematical Programming (1991) 52(2):359–375Crossref, Google Scholar
• Philbrick C. R. Optimal real-time control of stochastic multipurpose multireservoir systems. (1997) . Ph.D. Dissertation, Department of Civil Engineering, Stanford University, Stanford, CAGoogle Scholar
• Philbrick C. R., Kitanidis P. K. Optimal conjunctive-use operations and plans. Water Resources Res. (1998) 34(5):1307–1316Crossref, Google Scholar
• Philbrick C. R., Kitanidis P. K. Limitations of deterministic optimization applied to reservoir operations. J. Water Resources Planning and Management (1999) 125(3):135–142Crossref, Google Scholar
• Press W. H., Teukolsky S. A., Vetterling W. T., Flannery B. P.Numerical Recipes in FORTRAN: the Art of Scientific Computing (1992) (Press Syndicate of the University of Cambridge, Cambridge) Google Scholar
• Raman H., Chandramouli V. Deriving a general operating policy for reservoirs using neural network. J. Water Resources Planning and Management (1996) 122(5):342–347Crossref, Google Scholar
• ReVelle C., Joeres E., Kirby W. The linear decision rule in reservoir management and design, I. development of the stochastic models. Water Resources Res. (1969) 5(4):767–777Crossref, Google Scholar
• Saad M., Bigras P., Turgeon A., Duquette R. Fuzzy learning decomposition for the scheduling of hydroelectric power systems. Water Resources Res. (1996) 32(1):179–186Crossref, Google Scholar
• Saad M., Turgeon A. Application of principal component analysis to long-term reservoir management. Water Resources Res. (1988) 24(7):907–912Crossref, Google Scholar
• Saad M., Turgeon A., Stedinger J. R. Censored-Data Correlation and Principal Component Dynamic Programming. Water Resources Res. (1992) 28(8):2135–2140Crossref, Google Scholar
• Simonovic S. Two-step algorithm for design-stage long-term control of a multipurpose reservoir. Advances in Water Resources (1979) 2(1):47–49Crossref, Google Scholar
• Sobel M. J., Esogbue A. O. A multi-reservoir model with a myopic optimum. (1989) (Prentice Hall, Englewood Cliffs, NJ) 309–315Dynamic Programming for Optimal Water Resources Systems AnalysisGoogle Scholar
• Turgeon A. Optimal operation of multireservoir power systems with stochastic inflows. Water Resources Res. (1980) 16(2):275–283Crossref, Google Scholar
• Turgeon A. A decomposition method for the long-term scheduling of reservoirs in series. Water Resources Res. (1981) 17(6):1565–1570Crossref, Google Scholar
• U.S. Army Corps of Engineers Management of water control systems. (1987) (Washington, DC). EM 1110-2-3600Google Scholar
• U.S. Army Corps of Engineers Hydrologic engineering requirements for reservoirs. (1997) (Washington, DC). EM 1110-2-1420Google Scholar
• U.S. Bureau of Reclamation Central Valley Project Operations Criteria and Plans (CVP-OCAP). (1992) (U. S. Department of the Interior, Bureau of Reclamation, Mid-Pacific Region, Sacramento, CA) Google Scholar
• Yakowitz S. Dynamic programming applications in water resources. Water Resources Res. (1982) 18(4):673–696Crossref, Google Scholar
• Yeh W. W.-G. Reservoir management and operations models: A state-of-the-art review. Water Resources Res. (1985) 21(12):1797–1818Crossref, Google Scholar