Index Policies and Performance Bounds for Dynamic Selection Problems

David B. Brown
Corresponding Author
David B. Brown
http://orcid.org/0000-0002-5458-9098
Fuqua School of Business, Duke University, Durham, North Carolina 27708
Search for more papers by this author
,
James E. Smith
Corresponding Author
James E. Smith
http://orcid.org/0000-0002-9429-7567
Tuck School of Business, Dartmouth College, Hanover, New Hampshire 03755
Search for more papers by this author

David B. Brown

Corresponding Author

David B. Brown

http://orcid.org/0000-0002-5458-9098

Fuqua School of Business, Duke University, Durham, North Carolina 27708

Search for more papers by this author

James E. Smith

Corresponding Author

James E. Smith

http://orcid.org/0000-0002-9429-7567

Tuck School of Business, Dartmouth College, Hanover, New Hampshire 03755

Search for more papers by this author

Published Online:23 Jan 2020https://doi.org/10.1287/mnsc.2019.3342

Supplemental Material

mnsc.2019.3342.sm1.pdf

Cited by
- When to Push Ads: Optimal Mobile Ad Campaign Strategy Under Markov Customer Dynamics
  Guokai Li,
  Pin Gao,
  Zizhuo Wang
  11 May 2026 | Manufacturing & Service Operations Management, Vol. 0, No. 0
- Asymptotically optimal policies for weakly coupled Markov decision processes
  25 March 2026 | Journal of Applied Probability, Vol. 73
- Enabling Ultrafast Online Order Fulfillment: Efficient Inventory Management for In-Store Microfulfillment Centers
  Qian Jia,
  Zhengrui Jiang,
  Syam Menon
  19 March 2026 | INFORMS Journal on Computing, Vol. 0, No. 0
- Optimal Control of Fluid Restless Multi-armed Bandits: A Machine Learning Approach
  10 March 2026 | Machine Learning, Vol. 115, No. 3
- Lagrangian index policy for restless bandits with average reward
  7 March 2026 | Queueing Systems, Vol. 110, No. 1
- A Primal-Dual Approach to Constrained Markov Decision Processes with Applications to Queue Scheduling and Inventory Management
  Yi Chen,
  Jing Dong,
  Zhaoran Wang,
  Chuheng Zhang
  20 May 2025 | Management Science, Vol. 72, No. 2
- AoI-Based Scheduling of Correlated Sources for Timely Inference
  IEEE Transactions on Networking, Vol. 34
- Unichain and Aperiodicity Are Sufficient for Asymptotic Optimality of Average-Reward Restless Bandits
  Yige Hong,
  Qiaomin Xie,
  Yudong Chen,
  Weina Wang
  11 December 2025 | Mathematics of Operations Research, Vol. 0, No. 0
- Relaxed Indexability and Index Policy for Partially Observable Restless Bandits
  Keqin Liu
  16 April 2025 | Management Science, Vol. 71, No. 12
- On the sensitivity of restless bandits solutions to uncertainty in the models of the arms
  8 September 2025 | Annals of Operations Research, Vol. 355, No. 3
- Index policies for campaign promotion strategies in reward-based crowdfunding
  European Journal of Operational Research, Vol. 327, No. 2
- E-Commerce Order Fulfillment Problem with Limited Time Window
  Quan Zhou,
  Mehmet Gümüş,
  Sentao Miao
  11 July 2025 | Operations Research, Vol. 73, No. 6
- Near-Optimal Mixed (s,S) Policy for a Multiwarehouse, Multistore Inventory System with Lost Sales and Fixed Cost
  Sentao Miao,
  Stefanus Jasin,
  Xiuli Chao
  20 May 2025 | Operations Research, Vol. 73, No. 5
- Unit Commitment Without Commitment: A Dynamic Programming Approach for Managing an Integrated Energy System Under Uncertainty
  David B. Brown,
  James E. Smith
  5 March 2025 | Operations Research, Vol. 73, No. 4
- Coordinated Multiagent Patrolling With State-Dependent Cost Rates: Asymptotically Optimal Policies for Large-Scale Systems
  IEEE Transactions on Automatic Control, Vol. 70, No. 6
- An Enhanced Lagrangian Index Policy for Beam Scheduling of Colocated MIMO Radars
  IEEE Transactions on Aerospace and Electronic Systems, Vol. 61, No. 3
- A Multiindex Policy for Joint Selection of Subarrays and Operational Mode of Distributed Coherent Aperture Radars
  IEEE Transactions on Aerospace and Electronic Systems, Vol. 61, No. 3
- Adaptive Lagrangian Policies for a Multiwarehouse, Multistore Inventory System with Lost Sales
  Xiuli Chao; ,
  Stefanus Jasin; ,
  Sentao Miao
  16 April 2024 | Operations Research, Vol. 73, No. 3
- Thompson Sampling with Information Relaxation Penalties
  Seungki Min; ,
  Costis Maglaras,
  Ciamac C. Moallemi
  22 May 2024 | Management Science, Vol. 71, No. 3
- Fluid Policies, Reoptimization, and Performance Guarantees in Dynamic Resource Allocation
  David B. Brown; ,
  Jingwei Zhang
  11 December 2023 | Operations Research, Vol. 73, No. 2
- Self-Adapting Network Relaxations for Weakly Coupled Markov Decision Processes
  Selvaprabu Nadarajah; ,
  Andre A. Cire
  21 May 2024 | Management Science, Vol. 71, No. 2
- Dynamic allocation of display advertising impressions in dual sales channels
  Omega, Vol. 131
- Approximated Whittle Index for Femtocell Scheduling
  2 July 2025
- An Optimal-Control Approach to Infinite-Horizon Restless Bandits: Achieving Asymptotic Optimality with Minimal Assumptions
- Non-Myopic Beam Scheduling for Multiple Smart-Target Tracking in Phased Array Radar Networks
  4 December 2024 | Sensors, Vol. 24, No. 23
- Linear Program-Based Policies for Restless Bandits: Necessary and Sufficient Conditions for (Exponentially Fast) Asymptotic Optimality
  Nicolas Gast,
  Bruno Gaujal,
  Chen Yan
  1 December 2023 | Mathematics of Operations Research, Vol. 49, No. 4
- Information Relaxation and a Duality-Driven Algorithm for Stochastic Dynamic Programs
  Nan Chen,
  Xiang Ma,
  Yanchu Liu,
  Wei Yu
  31 July 2024 | Operations Research, Vol. 72, No. 6
- Timely Remote Estimation with Memory at the Receiver
- Low-complexity algorithm for restless bandits with imperfect observations
  5 September 2024 | Mathematical Methods of Operations Research, Vol. 100, No. 2
- Channel-Aware Joint AoI and Diversity Optimization for Client Scheduling in Federated Learning With Non-IID Datasets
  IEEE Transactions on Wireless Communications, Vol. 23, No. 6
- Stochastic Scheduling
  24 May 2024
- Two families of indexable partially observable restless bandits and Whittle index computation
  Performance Evaluation, Vol. 163
- Technical Note—On the Strength of Relaxations of Weakly Coupled Stochastic Dynamic Programs
  David B. Brown,
  Jingwei Zhang
  7 June 2022 | Operations Research, Vol. 71, No. 6
- Optimal Hospital Care Scheduling During the SARS-CoV-2 Pandemic
  Josh C. D’Aeth,
  Shubhechyya Ghosal,
  Fiona Grimm,
  David Haw,
  Esma Koca,
  Krystal Lau,
  Huikang Liu,
  Stefano Moret,
  Dheeya Rizmie,
  Peter C. Smith,
  Giovanni Forchini,
  Marisa Miraldo,
  Wolfram Wiesemann
  21 February 2023 | Management Science, Vol. 69, No. 10
- Dynamic ordering and buyer selection policies when service affects future demand
  Omega, Vol. 118
- Exponential asymptotic optimality of Whittle index policy
  21 May 2023 | Queueing Systems, Vol. 104, No. 1-2
- AoI-Driven Client Scheduling for Federated Learning: A Lagrangian Index Approach
- From prediction to decision: Optimizing long‐term care placements among older delayed discharge patients
  1 April 2023 | Production and Operations Management, Vol. 32, No. 4
- Markovian Restless Bandits and Index Policies: A Review
  28 March 2023 | Mathematics, Vol. 11, No. 7
- When to Push Ads: Optimal Mobile Ad Campaign Strategy under Markov Customer Dynamics
  1 January 2023 | SSRN Electronic Journal, Vol. 60
- Multi-Item Inventory Systems with Joint Expected Value and Chance Constraints: Asymptotically Optimal Heuristics
  1 January 2023 | SSRN Electronic Journal, Vol. 56
- Unit Commitment without Commitment: A Dynamic Framework for Managing an Integrated Energy System Under Uncertainty
  1 January 2023 | SSRN Electronic Journal, Vol. 56
- Joint Optimization of Pricing and Personalized Recommendations in Online Retailing
  1 January 2023 | SSRN Electronic Journal, Vol. 55
- Restless Bandits for Sensor Scheduling in Energy Constrained Networks
- Optimistic Gittins Indices
  Vivek F. Farias,
  Eli Gutin
  1 March 2022 | Operations Research, Vol. 70, No. 6
- Bandits with Dynamic Arm-acquisition Costs
- Dynamic Programs with Shared Resources and Signals: Dynamic Fluid Policies and Asymptotic Optimality
  David B. Brown,
  Jingwei Zhang
  16 December 2021 | Operations Research, Vol. 70, No. 5
- Information Relaxations and Duality in Stochastic Dynamic Programs: A Review and Tutorial
  21 March 2022 | Foundations and Trends® in Optimization, Vol. 5, No. 3
- Asymptotically Optimal Lagrangian Policies for Multi-Warehouse, Multi-Store Systems with Lost Sales
  Sentao Miao,
  Stefanus Jasin,
  Xiuli Chao
  29 October 2021 | Operations Research, Vol. 70, No. 1
- Asymptotically Optimal Lagrangian Priority Policy for Deadline Scheduling With Processing Rate Limits
  IEEE Transactions on Automatic Control, Vol. 67, No. 1
- Dynamic Ordering and Buyer Selection Policies in a Newsvendor Setting with Service-Dependent Demand
  SSRN Electronic Journal, Vol. 135
- A Dynamic Model for Airline Fleeting and Scheduling
  SSRN Electronic Journal, Vol. 56
- Fluid Policies, Reoptimization, and Performance Guarantees in Dynamic Resource Allocation
  SSRN Electronic Journal, Vol. 56
- Dynamic Pricing of Relocating Resources in Large Networks
  Santiago R. Balseiro,
  David B. Brown,
  Chen Chen
  20 October 2020 | Management Science, Vol. 67, No. 7
- On the Strength of Relaxations of Weakly Coupled Stochastic Dynamic Programs
  SSRN Electronic Journal, Vol. 52
- Asymptotically Optimal Lagrangian Policies for One-Warehouse Multi-Store System with Lost Sales
  SSRN Electronic Journal, Vol. 55
- Dynamic Programs with Shared Resources and Signals: Dynamic Fluid Policies and Asymptotic Optimality
  SSRN Electronic Journal, Vol. 56
- Dynamic Pricing of Relocating Resources in Large Networks
  SSRN Electronic Journal, Vol. 55

Volume 66, Issue 7

July 2020

Pages 2801-3294, iii-iv

Article Information

Supplemental Material

Metrics

Information

Received:September 18, 2017
Accepted:March 05, 2019
Published Online:January 23, 2020

Cite as

David B. Brown, James E. Smith (2020) Index Policies and Performance Bounds for Dynamic Selection Problems. Management Science 66(7):3029-3050.

https://doi.org/10.1287/mnsc.2019.3342

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Index Policies and Performance Bounds for Dynamic Selection Problems

Supplemental Material

Volume 66, Issue 7

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News