Simple Bayesian Algorithms for Best-Arm Identification

Daniel Russo
Daniel Russo
[email protected]
http://orcid.org/0000-0001-5926-8624
Columbia University, New York, New York 10027
Search for more papers by this author

Columbia University, New York, New York 10027

Search for more papers by this author

Published Online:16 Apr 2020https://doi.org/10.1287/opre.2019.1911

Supplemental Material

opre.2019.1911.sm1.pdf

Cited by
- Quantum Gambling: Best-Arm Strategies for Generator Selection in Adaptive Variational Algorithms
  17 April 2026 | Journal of Chemical Theory and Computation, Vol. 22, No. 9
- Getting the Most Out of A/B Tests Using the Asymptotic Minimax-Regret Criteria
  Joonhwi Joo,
  Khai X. Chiong
  11 September 2025 | Management Science, Vol. 72, No. 5
- Dual-Directed Algorithm Design for Efficient Pure Exploration
  Chao Qin,
  Wei You
  15 July 2025 | Operations Research, Vol. 74, No. 2
- Efficient simulation budget allocation for contextual ranking and selection with quadratic models
  European Journal of Operational Research, Vol. 328, No. 3
- Optimal dose selection in phase I/II dose finding trial with contextual bandits: a case study and practical recommendations
  27 February 2025 | Journal of Biopharmaceutical Statistics, Vol. 36, No. 1
- A Bayesian formulation for optimizing resource allocation via simulation
- Revisiting an Open Question in Ranking and Selection under Unknown Variances
- Simulation Optimization and Artificial Intelligence
  4 December 2025 | Foundations and Trends® in Optimization, Vol. 9, No. 4
- Learning Personalized Treatment Strategies with Predictive and Prognostic Covariates in Adaptive Clinical Trials
  Andres Alban,
  Stephen E. Chick,
  Spyros I. Zoumpoulis
  29 October 2025 | Management Science, Vol. 0, No. 0
- Adaptive experiments toward learning treatment effect heterogeneity
  24 February 2025 | Journal of the Royal Statistical Society Series B: Statistical Methodology, Vol. 87, No. 4
- Simulation Budget Allocation for Improving Scheduling and Routing of Automated Guided Vehicles in Warehouse Management
  29 July 2024 | Journal of the Operations Research Society of China, Vol. 13, No. 3
- Approximation to the optimal allocation for response adaptive designs
  12 December 2024 | Statistical Methods in Medical Research, Vol. 34, No. 9
- An Efficient Node Selection Policy for Monte Carlo Tree Search with Neural Networks INFORMS Journal on Computing Meritorious Paper Awardee
  Xiaotian Liu,
  Yijie Peng,
  Gongbo Zhang,
  Ruihan Zhou
  18 September 2024 | INFORMS Journal on Computing, Vol. 37, No. 4
- Stochastically constrained best arm identification with Thompson sampling
  Automatica, Vol. 176
- A review of simulation optimization with connection to artificial intelligence
  Fundamental Research, Vol. 14
- Feature Misspecification in Sequential Learning Problems
  Dohyun Ahn; ,
  Dongwook Shin; ,
  Assaf Zeevi
  29 August 2024 | Management Science, Vol. 71, No. 5
- Efficient Creative Selection in Online Advertising using Top-Two Thompson Sampling
  10 March 2025
- Efficient Best Arm Identification in Stochastic Bandits: Beyond β−Optimality
  IEEE Transactions on Information Theory, Vol. 71, No. 1
- Adaptive Maximization of Social Welfare
  1 January 2025 | Econometrica, Vol. 93, No. 3
- Rate-Optimal Budget Allocation for the Probability of Good Selection
- Thompson Sampling Procedures for Ranking and Selection with Pairwise Comparisons and Binary Outcomes
- Finite Budget Allocation Improvement in Ranking and Selection
- Weak Signal Asymptotics for Sequentially Randomized Experiments
  Xu Kuang,
  Stefan Wager
  6 December 2023 | Management Science, Vol. 70, No. 10
- Rate-Optimal Bayesian Simple Regret in Best Arm Identification
  Junpei Komiyama,
  Kaito Ariu,
  Masahiro Kato,
  Chao Qin
  25 August 2023 | Mathematics of Operations Research, Vol. 49, No. 3
- BAI in Exponential Family: Efficiency and Optimality
- Finding the optimal exploration-exploitation trade-off online through Bayesian risk estimation and minimization
  Artificial Intelligence, Vol. 330
- A Contextual Ranking and Selection Method for Personalized Medicine
  Jianzhong Du,
  Siyang Gao,
  Chun-Hung Chen
  22 August 2023 | Manufacturing & Service Operations Management, Vol. 26, No. 1
- Parallel Adaptive Survivor Selection
  Linda Pei,
  Barry L. Nelson,
  Susan R. Hunter
  24 August 2022 | Operations Research, Vol. 72, No. 1
- Sourcing Under Correlated Uncertainty: An integrated estimation and learning approach
  1 January 2024 | SSRN Electronic Journal, Vol. 6
- Risk-Sensitive Ordinal Optimization
- Data-Driven Optimal Allocation for Ranking and Selection under Unknown Sampling Distributions
- Top-Two Thompson Sampling for Selecting Context-Dependent Best Designs
- Epsilon Optimal Sampling
- Adaptive designs for best treatment identification with top‐two Thompson sampling and acceleration
  12 August 2023 | Pharmaceutical Statistics, Vol. 22, No. 6
- Online Allocation of Sensing and Computation in Large Graphs
- Using Cache or Credit for Parallel Ranking and Selection
  26 October 2023 | ACM Transactions on Modeling and Computer Simulation, Vol. 33, No. 4
- Simulation Optimization in the New Era of AI
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu
  13 October 2023
- Balancing Optimal Large Deviations in Sequential Selection
  Ye Chen,
  Ilya O. Ryzhov
  14 September 2022 | Management Science, Vol. 69, No. 6
- A Distributed Online Learning Method for Opportunistic Channel Access with Multiple Secondary Users
- On the finite-sample statistical validity of adaptive fully sequential procedures
  European Journal of Operational Research, Vol. 307, No. 1
- An Improved Thompson Sampling Method for Dynamic Spectrum Access in Non-Stationary Environments
- Ranking and Selection
  21 September 2023
- An Approach to Generating Adaptive Feedback for Online Formative Assessment
  22 May 2023
- SPRT-Based Efficient Best Arm Identification in Stochastic Bandits
  IEEE Journal on Selected Areas in Information Theory, Vol. 4
- Optimizing resource allocation in service systems via simulation: A Bayesian formulation
  1 January 2023 | Production and Operations Management, Vol. 32, No. 1
- Getting the Most Out of Online A/B Tests Using the Minimax-Regret Criteria
  1 January 2023 | SSRN Electronic Journal, Vol. 74
- An Efficient Node Selection Policy for Value Network Based Monte Carlo Tree Search
  1 January 2023 | SSRN Electronic Journal, Vol. 47
- An Efficient Dynamic Sampling Policy for Monte Carlo Tree Search
- Thompson Sampling Meets Ranking and Selection
- Dismemberment and Design for Controlling the Replication Variance of Regret for the Multi-Armed Bandit
  1 August 2022 | Journal of Statistical Theory and Practice, Vol. 16, No. 4
- Universal Thompson Sampling
- Diffusion Approximations for a Class of Sequential Experimentation Problems
  Victor F. Araman,
  René A. Caldentey
  28 December 2021 | Management Science, Vol. 68, No. 8
- Bayesian Sequential Learning for Clinical Trials of Multiple Correlated Medical Interventions
  Stephen E. Chick,
  Noah Gans,
  Özge Yapar
  5 November 2021 | Management Science, Vol. 68, No. 7
- SPRT-based Best Arm Identification in Stochastic Bandits
- Posterior-Based Stopping Rules for Bayesian Ranking-and-Selection Procedures
  David J. Eckman,
  Shane G. Henderson
  19 January 2022 | INFORMS Journal on Computing, Vol. 34, No. 3
- Optimal Learning and Optimal Design
  12 April 2022
- Greedy $k$-Center From Noisy Distance Samples
  IEEE Transactions on Signal and Information Processing over Networks, Vol. 8
- Learning Personalized Treatment Strategies with Predictive and Prognostic Covariates in Adaptive Clinical Trials
  1 January 2022 | SSRN Electronic Journal, Vol. 68
- Dynamically Aggregating Diverse Information
  1 January 2022 | Econometrica, Vol. 90, No. 1
- Greedy $k$-Center from Noisy Distance Samples
- An index-based deterministic convergent optimal algorithm for constrained multi-armed bandit problems
  Automatica, Vol. 129
- Confidence intervals for policy evaluation in adaptive experiments
  5 April 2021 | Proceedings of the National Academy of Sciences, Vol. 118, No. 15
- Online Ordinal Optimization under Model Misspecification
  SSRN Electronic Journal, Vol. 23
- Joint Resource Allocation for Input Data Collection and Simulation
- Ordinal Optimization with Generalized Linear Model
- Discrete Convex Simulation Optimization
  SSRN Electronic Journal, Vol. 27
- Balancing Optimal Large Deviations in Ranking and Selection
- Adaptive Experimental Design: Prospects and Applications in Political Science
  SSRN Electronic Journal, Vol. 64
- Dynamically Aggregating Diverse Information
  SSRN Electronic Journal, Vol. 58
- Diffusion Approximations for a Class of Sequential Testing Problems
  SSRN Electronic Journal, Vol. 67
- Bayesian Sequential Learning for Clinical Trials of Multiple Correlated Medical Interventions
  SSRN Electronic Journal, Vol. 248

Volume 68, Issue 6

November-December 2020

Pages ii-iv, 1625-1931, C2

Article Information

Supplemental Material

Metrics

Information

Received:December 12, 2016
Accepted:April 10, 2019
Published Online:April 16, 2020

Cite as

Daniel Russo (2020) Simple Bayesian Algorithms for Best-Arm Identification. Operations Research 68(6):1625-1647.

https://doi.org/10.1287/opre.2019.1911

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Simple Bayesian Algorithms for Best-Arm Identification

Supplemental Material

Volume 68, Issue 6

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News