Achieving Efficiency in Black-Box Simulation of Distribution Tails with Self-Structuring Importance Samplers

References

• Ahn D, Kim K-K (2018) Efficient simulation for expectations over the union of half-spaces. ACM Trans. Model. Comput. Simulation 28(3):23.Crossref, Google Scholar
• Arief M, Huang Z, Kumar GKS, Bai Y, He S, Ding W, Lam H, Zhao D (2021) Deep probabilistic accelerated evaluation: A robust certifiable rare-event simulation methodology for black-box safety-critical systems. Muandet K, ed. Internat. Conf. Artificial Intelligence Statist. (PMLR, New York), 595–603.Google Scholar
• Asmussen S, Glynn PW (2007) Stochastic Simulation: Algorithms and Analysis (Springer, New York).Crossref, Google Scholar
• Asmussen S, Kroese DP (2006) Improved algorithms for rare event simulation with heavy tails. Adv. Appl. Probab. 38(2):545–558.Crossref, Google Scholar
• Bai Y, Huang Z, Lam H, Zhao D (2022) Rare-event simulation for neural network and random forest predictors. ACM Trans. Model. Comput. Simulation 32(3):18.Crossref, Google Scholar
• Ban G-Y, Rudin C (2019) The big data newsvendor: Practical insights from machine learning. Oper. Res. 67(1):90–108.Link, Google Scholar
• Bassamboo A, Juneja S, Zeevi A (2008) Portfolio credit risk with extremal dependence: Asymptotic analysis and efficient simulation. Oper. Res. 56(3):593–606.Link, Google Scholar
• Blanchet J, Mandjes M (2009) Rare event simulation for queues. Rubino G, Tuffin B, eds. Rare Event Simulation Using Monte Carlo Methods (John Wiley & Sons, New York), 87–124.Crossref, Google Scholar
• Blanchet J, Li J, Nakayama MK (2019) Rare-event simulation for distribution networks. Oper. Res. 67(5):1383–1396.Link, Google Scholar
• Borovkov AA (2008) Asymptotic Analysis of Random Walks, vol. 118 (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Chen B, Rhee C-H, Zwart B (2018) Importance sampling of heavy-tailed iterated random functions. Adv. Appl. Probab. 50(3):805–832.Crossref, Google Scholar
• Collamore JF (2002) Importance sampling techniques for the multidimensional ruin problem for general Markov additive sequences of random vectors. Ann. Appl. Probab. 12(1):382–421.Crossref, Google Scholar
• de Valk C (2016) Approximation and estimation of very small probabilities of multivariate extreme events. Extremes 19(4):687–717.Crossref, Google Scholar
• Deo A, Juneja S (2020) Credit risk: Simple closed-form approximate maximum likelihood estimator. Oper. Res. 69(2):361–379.Link, Google Scholar
• Deo A, Murthy K (2021) Efficient black-box importance sampling for VaR and CVaR estimation. Kim S, Feng B, Smith K, Masoud S, Zheng Z, eds. 2021 Winter Simulation Conf. (WSC) (IEEE, Piscataway, NJ), 1–12.Google Scholar
• Dupuis P, Leder K, Wang H (2007) Importance sampling for sums of random variables with regularly varying tails. ACM Trans. Model. Comput. Simulation 17(3):14.Crossref, Google Scholar
• Elmachtoub A, Grigas P (2022) Smart “predict, then optimize.” Management Sci. 68(1):9–26.Link, Google Scholar
• Embrechts P, Lindskog F, McNeil A (2001) Modelling dependence with copulas. Rapport technique. Working paper, Département de mathématiques, Institut Fédéral de Technologie de Zurich, Zurich.Google Scholar
• Glasserman P (2004) Monte Carlo Methods in Financial Engineering (Springer, New York).Crossref, Google Scholar
• Glasserman P, Li J (2005) Importance sampling for portfolio credit risk. Management Sci. 51(11):1643–1656.Link, Google Scholar
• Glasserman P, Wang Y (1997) Counterexamples in importance sampling for large deviations probabilities. Ann. Appl. Probab. 7(3):731–746.Crossref, Google Scholar
• Glasserman P, Heidelberger P, Shahabuddin P (2000) Variance reduction techniques for estimating value-at-risk. Management Sci. 46(10):1349–1364.Link, Google Scholar
• Glasserman P, Kang W, Shahabuddin P (2007) Large deviations in multifactor portfolio credit risk. Math. Finance 17(3):345–379.Crossref, Google Scholar
• Glasserman P, Kang W, Shahabuddin P (2008) Fast simulation of multifactor portfolio credit risk. Oper. Res. 56(5):1200–1217.Link, Google Scholar
• Glynn P (1996) Importance sampling for Monte Carlo estimation of quantiles. Proc. 2nd St. Petersburg Workshop Simulation (Publishing House of St. Petersburg University, St. Petersburg, Russia), 180–185.Google Scholar
• Heidelberger P (1995) Fast simulation of rare events in queueing and reliability models. ACM Trans. Model. Comput. Simulation 5(1):43–85.Crossref, Google Scholar
• Hong LJ, Hu Z, Liu G (2014) Monte Carlo methods for value-at-risk and conditional value-at-risk: A review. ACM Trans. Model. Comput. Simulation 24(4):22.Crossref, Google Scholar
• Honnappa H, Pasupathy R, Jaiswal P (2018) Dominating points of Gaussian extremes. Working paper, Purdue University, West Lafayette, IN.Google Scholar
• Hult H, Lindskog F, Hammarlid O, Rehn CJ (2012) Risk and Portfolio Analysis (Springer, New York).Crossref, Google Scholar
• Jeong S, Namkoong H (2020) Robust causal inference under covariate shift via worst-case subpopulation treatment effects. Gunasekar S, ed. Proc. 33rd Conf. Learn. Theory, vol. 125 (PMLR, New York), 2079–2084.Google Scholar
• Juneja S, Shahabuddin P (2002) Simulating heavy tailed processes using delayed hazard rate twisting. ACM Trans. Model. Comput. Simulation 12(2):94–118.Crossref, Google Scholar
• Juneja S, Shahabuddin P (2006) Rare-event simulation techniques: An introduction and recent advances. Henderson SG, Nelson BL, eds. Handbooks in Operations Research and Management Science, vol. 13 (Elsevier, Amsterdam), 291–350.Google Scholar
• Juneja S, Karandikar RL, Shahabuddin P (2007) Asymptotics and fast simulation for tail probabilities of maximum of sums of few random variables. ACM Trans. Model. Comput. Simulation 17(2):7.Crossref, Google Scholar
• Liu G (2015) Simulating risk contributions of credit portfolios. Oper. Res. 63(1):104–121.Link, Google Scholar
• O’Kelly M, Sinha A, Namkoong H, Tedrake R, Duchi J (2018) Scalable end-to-end autonomous vehicle testing via rare-event simulation. Wallach H, ed. Adv. Neural Inform. Processing Systems, vol. 31, 9827–9838.Google Scholar
• Pasupathy R (2010) On choosing parameters in retrospective-approximation algorithms for stochastic root finding and simulation optimization. Oper. Res. 58(4 part 1):889–901.Link, Google Scholar
• Rockafellar RT, Wets RJB (1998) Variational Analysis (Springer, Berlin).Crossref, Google Scholar
• Rubino G, Tuffin B (2009) Rare Event Simulation Using Monte Carlo Methods (John Wiley & Sons, New York).Crossref, Google Scholar
• Rubinstein RY, Kroese DP (2013) The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning (Springer Science & Business Media, New York).Google Scholar
• Sadhwani A, Giesecke K, Sirignano J (2020) Deep learning for mortgage risk. J. Financial Econom. 19(2):313–368.Crossref, Google Scholar
• Sadowsky JS, Bucklew JA (1990) On large deviations theory and asymptotically efficient Monte Carlo estimation. IEEE Trans. Inform. Theory 36(3):579–588.Crossref, Google Scholar
• Siegmund D (1976) Importance sampling in the Monte Carlo study of sequential tests. Ann. Statist. 4(4):673–684.Crossref, Google Scholar
• Sirignano J, Giesecke K (2019) Risk analysis for large pools of loans. Management Sci. 65(1):107–121.Link, Google Scholar
• Uesato J, Kumar A, Szepesvari C, Erez T, Ruderman A, Anderson K, Dvijotham K, Heess N, Kohli P (2019) Rigorous agent evaluation: An adversarial approach to uncover catastrophic failures. Levine S, Livescu K, Mohamed S, eds. Internat. Conf. Learn. Representations.Google Scholar
• Williamson R, Menon A (2019) Fairness risk measures. Chaudhuri K, Salakhutdinov R, eds. Proc. 36th Internat. Conf. Machine Learn., vol. 97 (PMLR, New York), 6786–6797.Google Scholar
• Zhao D, Lam H, Peng H, Bao S, LeBlanc DJ, Nobukawa K, Pan CS (2017) Accelerated evaluation of automated vehicles safety in lane-change scenarios based on importance sampling techniques. IEEE Trans. Intelligent Transportation Systems 18(3):595–607.Crossref, Google Scholar