Optimal Hour-Ahead Bidding in the Real-Time Electricity Market with Battery Storage Using Approximate Dynamic Programming

Daniel R. Jiang
Daniel R. Jiang
[email protected]
Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540
Search for more papers by this author
,
Warren B. Powell
Warren B. Powell
[email protected]
Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540
Search for more papers by this author

Daniel R. Jiang

[email protected]

Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540

Search for more papers by this author

Warren B. Powell

[email protected]

Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08540

Search for more papers by this author

Published Online:25 Aug 2015https://doi.org/10.1287/ijoc.2015.0640

Supplemental Material

ijoc.2015.0640-sm-final_bidding_joc_online_supplement.pdf (190 KB)

Cited by
- A Nested Design and Analysis of Computer Experiments Approach to Enable Design for Controllability of a System of Electric Vehicle Charging Stations
  Ukesh Chawal,
  Ying Chen,
  Victoria C. P. Chen,
  Jay M. Rosenberger,
  Wei-Jen Lee
  5 May 2026 | INFORMS Journal on Data Science, Vol. 0, No. 0
- Cost-Saving Synergy: Energy Stacking in Battery Energy Storage Systems
  Joonho Bae,
  Roman Kapuscinski,
  John Silberholz
  2 September 2025 | Management Science, Vol. 72, No. 5
- Joint matching and pricing for crowd-shipping with in-store customers
  22 April 2026 | INFOR: Information Systems and Operational Research
- Scheduling maintenance activities subject to continuous stochastic job-dependent machine deterioration
  European Journal of Operational Research, Vol. 63
- Frozen-State Value Iteration: Faster Reinforcement Learning by Freezing Slow States
  Yijia Wang,
  Daniel R. Jiang
  18 March 2026 | Management Science, Vol. 0, No. 0
- A bilevel multistage stochastic self-scheduling model with indivisibilities for trading in the continuous intraday electricity market
  European Journal of Operational Research, Vol. 328, No. 3
- Optimal hour-ahead commitment and storage decisions of wind power producers
  International Journal of Production Economics, Vol. 292
- Asymmetries and evolution in energy market Interactions: Evidence from solar PV systems and spot electricity prices in Australia
  Renewable Energy, Vol. 255
- Bidding Strategies for Battery Energy Storage Addressing Uncertain Market Clearance
  IEEE Transactions on Power Systems, Vol. 40, No. 6
- Modeling distributed energy resource aggregations in security constrained unit commitment and economic dispatch
  International Journal of Electrical Power & Energy Systems, Vol. 170
- Multi-Interval Energy-Reserve Co-Optimization With SoC-Dependent Bids From Battery Storage
  IEEE Transactions on Power Systems, Vol. 40, No. 4
- Continuous Intraday Trading: An Open-Source Multi-Market Bidding Framework for Energy Storage Systems
  16 June 2025
- Regularized MIP Model for Integrating Energy Storage Systems and Its Application for Solving a Trilevel Interdiction Problem
  Dahye Han,
  Nan Jiang,
  Santanu S. Dey,
  Weijun Xie
  16 June 2025 | INFORMS Journal on Computing, Vol. 0, No. 0
- Enhancing Optimization Algorithms for Controlling Large-Scale Solar and Storage Participation in Awarded Energy Market Bids
- The evolutionary game equilibrium theory on power market bidding involving renewable energy companies
  International Journal of Electrical Power & Energy Systems, Vol. 167
- Perturbed Decision-Focused Learning for Modeling Strategic Energy Storage
  IEEE Transactions on Smart Grid, Vol. 16, No. 3
- Wind Power Intermittency and Profitability: The Role of Strategic Bidding
  1 January 2025 | SSRN Electronic Journal, Vol. 61
- A novel carbon reduction engineering method-based deep Q-learning algorithm for energy-efficient scheduling on a single batch-processing machine in semiconductor manufacturing
  14 September 2023 | International Journal of Production Research, Vol. 62, No. 18
- Renewable, Flexible, and Storage Capacities: Friends or Foes?
  Xiaoshan Peng,
  Owen Q. Wu,
  Gilvan C. Souza
  3 July 2024 | Manufacturing & Service Operations Management, Vol. 26, No. 5
- Transfer-Based Approximate Dynamic Programming for Rolling Security-Constrained Unit Commitment with Uncertainties
  Protection and Control of Modern Power Systems, Vol. 9, No. 5
- Daily Episodic and Continuous Arbitrage Trading With Electric Batteries
  4 October 2024 | The Energy Journal, Vol. 45, No. 4
- An optimal solutions-guided deep reinforcement learning approach for online energy storage control
  Applied Energy, Vol. 361
- Transferable Energy Storage Bidder
  IEEE Transactions on Power Systems, Vol. 39, No. 2
- Real-Time Risk-Averse Dispatch of an Integrated Electricity and Natural Gas System via Conditional Value-at-Risk-Based Lookup-Table Approximate Dynamic Programming
  Protection and Control of Modern Power Systems, Vol. 9, No. 2
- Carbon-free Electricity Supply in a Cournot Wholesale Market: Israel
  16 May 2024 | The Energy Journal, Vol. 45, No. 2
- Stochastic search for a parametric cost function approximation: Energy storage with rolling forecasts
  European Journal of Operational Research, Vol. 312, No. 2
- Real-time dispatch of integrated electricity and thermal system incorporating storages via a stochastic dynamic programming with imitation learning
  International Journal of Electrical Power & Energy Systems, Vol. 153
- Role of reinforcement learning for risk‐based robust control of cyber‐physical energy systems
  6 February 2023 | Risk Analysis, Vol. 43, No. 11
- Optimal Electricity Imbalance Pricing for the Emerging Penetration of Renewable and Low-Cost Generators
  Yashar Ghiassi-Farrokhfal,
  Rodrigo Belo,
  Mohammad Reza Hesamzadeh,
  Derek Bunn
  13 July 2023 | Manufacturing & Service Operations Management, Vol. 25, No. 5
- Energy storage operation and electricity market design: On the market power of monopolistic storage operators
  European Journal of Operational Research, Vol. 307, No. 2
- Energy Storage State-of-Charge Market Model
  IEEE Transactions on Energy Markets, Policy and Regulation, Vol. 1, No. 1
- Optimal economic dispatch policy for prosumer with energy storage considering self-consumption demand
  Computers & Industrial Engineering, Vol. 176
- Meeting Corporate Renewable Power Targets
  Alessio Trivella,
  Danial Mohseni-Taheri,
  Selvaprabu Nadarajah
  25 March 2022 | Management Science, Vol. 69, No. 1
- The Value of Coordination in Multimarket Bidding of Grid Energy Storage
  Nils Löhndorf,
  David Wozabal
  31 January 2022 | Operations Research, Vol. 71, No. 1
- Deviations from commitments: Markov decision process formulations for the role of energy storage
  International Journal of Production Economics, Vol. 255
- Bidding strategy for wireless charging roads with energy storage in real-time electricity markets
  Applied Energy, Vol. 327
- The bidding strategies of large-scale battery storage in 100% renewable smart energy systems
  Applied Energy, Vol. 326
- Day-Ahead Scheduling of Behind-the-Meter Battery Energy Storage Systems to Serve Utility Infrastructure
- Arbitraging Variable Efficiency Energy Storage Using Analytical Stochastic Dynamic Programming
  IEEE Transactions on Power Systems, Vol. 37, No. 6
- Fast computation of global solutions to the single-period unit commitment problem
  29 November 2019 | Journal of Combinatorial Optimization, Vol. 44, No. 3
- Stochastic one-way carsharing systems with dynamic relocation incentives through preference learning
  Transportation Research Part E: Logistics and Transportation Review, Vol. 166
- Economic dispatch for electricity merchant with energy storage and wind plant: State of charge based decision making considering market impact and uncertainties
  Journal of Energy Storage, Vol. 53
- The role of modeling battery degradation in bulk power system optimizations
  19 September 2022 | MRS Energy & Sustainability, Vol. 9, No. 2
- Seasonal hydrogen storage decisions under constrained electricity distribution capacity
  Renewable Energy, Vol. 195
- An ensemble learning-based framework for assessing the energy flexibility of residential buildings with multicomponent energy systems
  Applied Energy, Vol. 315
- Optimal bidding functions for renewable energies in sequential electricity markets
  26 July 2021 | OR Spectrum, Vol. 44, No. 1
- Implication of production tax credit on economic dispatch for electricity merchants with storage and wind farms
  Applied Energy, Vol. 308
- Improving the Scheduling of Energy Storage System: Case of South Korean Energy Market
  SSRN Electronic Journal, Vol. 99
- Cost-Saving Synergy: Energy Stacking In Battery Energy Storage Systems
  SSRN Electronic Journal, Vol. 24
- A deep reinforcement learning framework for continuous intraday market bidding
  12 July 2021 | Machine Learning, Vol. 110, No. 9
- Rolling-horizon dispatch of advanced adiabatic compressed air energy storage based energy hub via data-driven stochastic dynamic programming
  Energy Conversion and Management, Vol. 243
- Optimal Daily Trading of Battery Operations Using Arbitrage Spreads
  12 August 2021 | Energies, Vol. 14, No. 16
- Optimal scheduling for profit maximization of energy storage merchants considering market impact based on dynamic programming
  Computers & Industrial Engineering, Vol. 155
- Making green power purchase agreements more predictable and reliable for companies
  Decision Support Systems, Vol. 144
- Optimal valuation of wind energy projects co-located with battery storage
  Applied Energy, Vol. 283
- A Discussion of Non‐Gaussian Price Processes for Energy and Commodity Operations
  1 January 2021 | Production and Operations Management, Vol. 30, No. 1
- Offline-Online Approximate Dynamic Programming for Stochastic Carsharing Systems with Relocation Incentives
  SSRN Electronic Journal, Vol. 284
- Renewable, Flexible, and Storage Capacities: Friends or Foes?
  SSRN Electronic Journal, Vol. 19
- Operational Valuation of Energy Storage under Multi-stage Price Uncertainties
- Approximate Dynamic Programming for Selective Maintenance in Series–Parallel Systems
  IEEE Transactions on Reliability, Vol. 69, No. 3
- Operating and Investment Models for Energy Storage Systems
  4 September 2020 | Energies, Vol. 13, No. 18
- Meso-parametric value function approximation for dynamic customer acceptances in delivery routing
  European Journal of Operational Research, Vol. 285, No. 1
- Dynamic Programming Models for Maximizing Customer Lifetime Value: An Overview
  24 August 2019
- Reinforcement-Learning-based Optimization for Day-ahead Flexibility Extraction in Battery Pools
  IFAC-PapersOnLine, Vol. 53, No. 2
- Energy Storage Arbitrage in Grid-Connected Micro-Grids Under Real-Time Market Price Uncertainty: A Double-Q Learning Approach
  IEEE Access, Vol. 8
- Real‐time stochastic operation strategy of a microgrid using approximate dynamic programming‐based spatiotemporal decomposition approach
  19 November 2019 | IET Renewable Power Generation, Vol. 13, No. 16
- Electric Power Industry: Operational and Public Policy Challenges and Opportunities
  1 November 2019 | Production and Operations Management, Vol. 28, No. 11
- A cooperative demand-response framework for day-ahead optimization in battery pools
  27 September 2019 | Energy Informatics, Vol. 2, No. S1
- Stochastic Optimization of Economic Dispatch for Microgrid Based on Approximate Dynamic Programming
  IEEE Transactions on Smart Grid, Vol. 10, No. 3
- Battery storage systems: An economic model-based analysis of parallel revenue streams and general implications for industry
  Applied Energy, Vol. 239
- Optimal Real-Time Operation Strategy for Microgrid: An ADP-Based Stochastic Nonlinear Optimization Approach
  IEEE Transactions on Sustainable Energy, Vol. 10, No. 2
- Managing Wind‐Based Electricity Generation in the Presence of Storage and Transmission Capacity
  1 April 2019 | Production and Operations Management, Vol. 28, No. 4
- Optimal operation value of combined wind power and energy storage in multi-stage electricity markets
  Applied Energy, Vol. 235
- Application value of energy storage in power grid: A special case of China electricity market
  Energy, Vol. 165
- Low-Rank Value Function Approximation for Co-Optimization of Battery Storage
  IEEE Transactions on Smart Grid, Vol. 9, No. 6
- Merchant Energy Trading in a Network
  Selvaprabu Nadarajah,
  Nicola Secomandi
  14 August 2018 | Operations Research, Vol. 66, No. 5
- Optimal Trading Strategies for Energy Hubs Equipped with Power-to-Gas Technology
- Spare Parts Inventory Management with Substitution-Dependent Reliability
  Amin Khademi,
  Burak Eksioglu
  21 September 2018 | INFORMS Journal on Computing, Vol. 30, No. 3
- Energy Storage Arbitrage in Real-Time Markets via Reinforcement Learning
- Two-Scale Stochastic Optimization for Controlling Distributed Storage Devices
  IEEE Transactions on Smart Grid, Vol. 9, No. 4
- Risk-Averse Approximate Dynamic Programming with Quantile-Based Risk Measures
  Daniel R. Jiang,
  Warren B. Powell
  13 November 2017 | Mathematics of Operations Research, Vol. 43, No. 2
- Energy management for stationary electric energy storage systems: A systematic literature review
  European Journal of Operational Research, Vol. 264, No. 2
- Meeting Corporate Renewable Power Targets
  SSRN Electronic Journal, Vol. 19
- A Discussion of Non-Gaussian Price Processes for Energy and Commodity Operations
  SSRN Electronic Journal, Vol. 19
- Heuristic decision rules for short-term trading of renewable energy with co-located energy storage
  Computers & Operations Research, Vol. 83
- Stochastic valuation of energy storage in wholesale power markets
  Energy Economics, Vol. 64
- Sell or store? An ADP approach to marketing renewable energy
  5 April 2016 | OR Spectrum, Vol. 38, No. 3
- An Approximate Dynamic Programming Algorithm for Monotone Value Functions
  Daniel R. Jiang,
  Warren B. Powell
  4 November 2015 | Operations Research, Vol. 63, No. 6
- Managing Wind-based Electricity Generation with Storage and Transmission Capacity
  SSRN Electronic Journal, Vol. 19

cover image INFORMS Journal on Computing

Volume 27, Issue 3

Summer 2015

Pages 431-578

Article Information

Supplemental Material

Metrics

Information

Received:March 01, 2014
Accepted:November 01, 2014
Published Online:August 25, 2015

Cite as

Daniel R. Jiang, Warren B. Powell (2015) Optimal Hour-Ahead Bidding in the Real-Time Electricity Market with Battery Storage Using Approximate Dynamic Programming. INFORMS Journal on Computing 27(3):525-543.

https://doi.org/10.1287/ijoc.2015.0640

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Optimal Hour-Ahead Bidding in the Real-Time Electricity Market with Battery Storage Using Approximate Dynamic Programming

Supplemental Material

Volume 27, Issue 3

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News