Stochastic Gradient Descent in Continuous Time: A Central Limit Theorem

References

• Basawa I, Rao B (1980) Asymptotic inference for stochastic processes. Stochastic Processes Appl. 10(3):221–254.Google Scholar
• Benveniste A, Metivier M, Priouret P (1990) Adaptive Algorithms and Stochastic Approximations (Springer-Verlag, Berlin, Heidelberg).Google Scholar
• Bishwal JPN (2008) Parameter Estimation in Stochastic Differential Equations, Lecture Notes in Mathematics, vol. 1923 (Springer Science & Business Media, Berlin, Heidelberg).Google Scholar
• Chicone C (2006) Ordinary Differential Equations with Applications, 2nd ed. (Springer, New York).Google Scholar
• Doya K (2000) Reinforcement learning in continuous time and space. Neural Comput. 12(1):219–245.Google Scholar
• Ikeda N, Watanabe S (1977) A comparison theorem for solutions of stochastic differential equations and its applications. Osaka J. Math. 14(3):619–633.Google Scholar
• Kutoyants Y (2004) Statistical Inference for Ergodic Diffusion Processes (Springer, London).Google Scholar
• Pardoux E, Veretennikov AY (2001) On Poisson equation and diffusion approximation 1. Ann. Probab. 29(3):1061–1085.Google Scholar
• Pardoux E, Veretennikov AY (2003) On Poisson equation and diffusion approximation 2. Ann. Probab. 31(3):1166–1192.Google Scholar
• Raginsky M, Bouvrie J (2012) Continuous-time stochastic mirror descent on a network: Variance reduction, consensus, convergence. Proc. 51st IEEE Conf. Decision Control, Maui, Hawaii, 6793–6800.Google Scholar
• Rao BLSP (1999) Statistical Inference for Diffusion Type Processes (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Sakrison DJ (1964) A continuous Kiefer-Wolfowitz procedure for random processes. Ann. Math. Statist. 35(2):590–599.Google Scholar
• Sirignano J, Spiliopoulos K (2017) Stochastic gradient descent in continuous time. SIAM J. Financial Math. 8(1):933–961.Google Scholar
• Surace S, Pfister J (2016) Online maximum likelihood estimation of the parameters of partially observed diffusion processes. IEEE Trans. Automated Control 64(7):2814–2829.Google Scholar
• Yin G, Gupta I (1993) On a continuous time stochastic approximation problem. Acta Appl. Math. 33(1):3–20.Google Scholar