Gamifying the Vehicle Routing Problem with Stochastic Requests

Do you remember your first video game console? We remember ours. Decades ago, they provided hours of entertainment. Now, we have repurposed them to solve dynamic and stochastic optimization problems. With deep reinforcement learning methods posting superhuman performance on a wide range of Atari games, we consider the task of representing a classic logistics problem as a game. Then, we train agents to play it. We consider several game designs for the vehicle routing problem with stochastic requests. We show how various design features impact agents’ performance, including perspective, field of view, and minimaps. With the right game design, general purpose Atari agents outperform optimization-based benchmarks, especially as the problem size grows. Our work points to the representation of dynamic and stochastic optimization problems via games as a promising research direction.

History: Accepted by Pascal Van Hentenryck, Area Editor for Computational Modeling: Methods & Analysis.

Funding: This research was enabled in part by support from Calcul Québec, the Digital Research Alliance of Canada, HEC Montreal, and the Institute for Data Valorization (IVADO).

Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information (https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2024.0838) as well as from the IJOC GitHub software repository (https://github.com/INFORMSJoC/2024.0838). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/.