Data-Driven Clustering and Feature-Based Retail Electricity Pricing with Smart Meters

References

• Allcott H (2009) Real time pricing and electricity markets. Working paper, Harvard University, Boston.Google Scholar
• Aouad A, Elmachtoub AN, Ferreira KJ, McNellis R (2023) Market segmentation trees. Manufacturing Service Oper. Management 25(2):648–667.Link, Google Scholar
• Arthur D, Vassilvitskii S (2006) k-means++: The advantages of careful seeding. Technical report, Stanford University, Stanford, CA.Google Scholar
• Austin Energy (2014) Austin Energy annual performance report. Accessed June 25, 2019, https://services.austintexas.gov/edims/document.cfm?id=241185.Google Scholar
• Ban GY, Keskin NB (2021) Personalized dynamic pricing with machine learning: High-dimensional features and heterogeneous elasticity. Management Sci. 67(9):5549–5568.Link, Google Scholar
• Bernstein F, Modaresi S, Sauré D (2019) A dynamic clustering approach to data-driven assortment personalization. Management Sci. 65(5):2095–2115.Abstract, Google Scholar
• Bertsimas D, Mersereau AJ (2007) A learning approach for interactive marketing to a customer segment. Oper. Res. 55(6):1120–1135.Link, Google Scholar
• Bertsimas DJ, Mersereau AJ, Patel NR (2003) Dynamic classification of online customers. Proc. SIAM Internat. Conf. Data Mining (SIAM, Philadelphia, PA), 107–118.Google Scholar
• Borenstein S (2005) The long-run efficiency of real-time electricity pricing. Energy J. 26(3):93–116.Crossref, Google Scholar
• Cesa-Bianchi N, Gentile C, Zappella G (2013) A gang of bandits. Proc. 26th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 737–745.Google Scholar
• Cohen MC, Leung NHZ, Panchamgam K, Perakis G, Smith A (2017) The impact of linear optimization on promotion planning. Oper. Res. 65(2):446–468.Link, Google Scholar
• ComEd (2020) ComEd’s hourly pricing program. Accessed July 9, 2020, https://hourlypricing.comed.com/.Google Scholar
• Davies DL, Bouldin DW (1979) A cluster separation measure. IEEE Trans. Pattern Anal. Machine Intelligence 2:224–227.Crossref, Google Scholar
• de Clercq G (2018) Run your dishwasher when the sun shines: Dynamic power pricing grows. Accessed July 10, 2020, https://www.reuters.com/article/us-europe-electricity-prices-insight/run-your-dishwasher-when-the-sun-shines-dynamic-power-pricing-grows-idUSKBN1KN0L7.Google Scholar
• Ding C, Rusmevichientong P, Topaloglu H (2014) Balancing revenues and repair costs under partial information about product reliability. Production Oper. Management 23(11):1899–1918.Crossref, Google Scholar
• Dong C, Ng CT, Cheng T (2017) Electricity time-of-use tariff with stochastic demand. Production Oper. Management 26(1):64–79.Crossref, Google Scholar
• Dunn JC (1974) Well-separated clusters and optimal fuzzy partitions. J. Cybernetics 4(1):95–104.Crossref, Google Scholar
• Dutta G, Mitra K (2017) A literature review on dynamic pricing of electricity. J. Oper. Res. Soc. 68(10):1131–1145.Crossref, Google Scholar
• ECOFYS (2018) Dynamic electricity prices. Accessed July 9, 2020, https://asset-ec.eu/wp-content/uploads/2018/10/Dynamic-electricity-prices.pdf.Google Scholar
• Eligo Energy (2022) Compare energy rates in Texas. Accessed December 15, 2022, https://prices.eligoenergy.com/texas.Google Scholar
• Energy Ogre (2021) Custom pricing now available to Energy Ogre members. Accessed August 24, 2021, www.energyogre.com/energy-ogre-custom-pricing.Google Scholar
• Energy Online (2014) ERCOT real-time price. Accessed September 4, 2023, http://www.energyonline.com/Data/GenericData.aspx?DataId=4&ERCOT___Real-time_Price.Google Scholar
• EU (2019) Directive (EU) 2019/944 of the European parliament and the council – Common rules for the internal market for electricity. Accessed July 9, 2020, https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32019L0944.Google Scholar
• European Commission (2021) Smart grids and meters. Accessed July 22, 2021, https://ec.europa.eu/energy/topics/markets-and-consumers/smart-grids-and-meters_en.Google Scholar
• Everitt B, Landau S, Leese M, Stahl D (2011) Cluster Analysis (Wiley, New York).Crossref, Google Scholar
• Faruqui A, Bourbonnais C (2019) A meta analysis of time-varying rates. Accessed July 9, 2020, https://brattlefiles.blob.core.windows.net/files/16560_a_meta_analysis_of_time-varying_rates.pdf.Google Scholar
• Faruqui A, Sergici S (2010) Household response to dynamic pricing of electricity: A survey of 15 experiments. J. Regulatory Econom. 38(2):193–225.Crossref, Google Scholar
• Federal Energy Regulatory Commission (2019) 2019 assessment of demand response and advanced metering. Accessed June 2, 2020, https://www.ferc.gov/legal/staff-reports/2019/DR-AM-Report2019.pdf.Google Scholar
• Feng Z, Dawande M, Janakiraman G, Qi A (2023) An asymptotically tight learning algorithm for mobile-promotion platforms. Management Sci. 69(3):1536–1554.Link, Google Scholar
• Ferreira KJ, Lee BHA, Simchi-Levi D (2016) Analytics for an online retailer: Demand forecasting and price optimization. Manufacturing Service Oper. Management 18(1):69–88.Link, Google Scholar
• Gentile C, Li S, Zappella G (2014) Online clustering of bandits. Proc. 31st Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 757–765.Google Scholar
• Gentile C, Li S, Kar P, Karatzoglou A, Zappella G, Etrue E (2017) On context-dependent clustering of bandits. Proc. 34th Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 1253–1262.Google Scholar
• Green Mountain Energy (2021) Get a quote. Accessed August 24, 2021, www.greenmountainenergy.com/business-electricity/get-a-quote.Google Scholar
• Harrison JM, Sunar N (2015) Investment timing with incomplete information and multiple means of learning. Oper. Res. 63(2):442–457.Link, Google Scholar
• He L, Ma G, Qi W, Wang X (2021) Charging an electric vehicle-sharing fleet. Manufacturing Service Oper. Management 23(2):471–487.Abstract, Google Scholar
• Huang H, Sunar N, Swaminathan JM, Roy R (2023) Do noisy customer reviews discourage platform sellers? Empirical analysis of an online solar marketplace. Manufacturing Service Oper. Management 25(6):2195–2215.Link, Google Scholar
• Javanmard A, Nazerzadeh H (2019) Dynamic pricing in high-dimensions. J. Machine Learn. Res. 20(1):315–363.Google Scholar
• Kallus N (2017) Recursive partitioning for personalization using observational data. Proc. 34th Internat. Conf. Machine Learn. (PMLR, Cambridge, MA), 1789–1798.Google Scholar
• Keskin NB, Birge JR (2019) Dynamic selling mechanisms for product differentiation and learning. Oper. Res. 67(4):1069–1089.Abstract, Google Scholar
• Keskin NB, Zeevi A (2014) Dynamic pricing with an unknown demand model: Asymptotically optimal semi-myopic policies. Oper. Res. 62(5):1142–1167.Link, Google Scholar
• Kim MJ (2020) Variance regularization in sequential Bayesian optimization. Math. Oper. Res. 45(3):966–992.Link, Google Scholar
• Kök AG, Shang K, Yücel Ş (2018) Impact of electricity pricing policies on renewable energy investments and carbon emissions. Management Sci. 64(1):131–148.Link, Google Scholar
• Lazaar J (2016) Electricity regulation in the U.S.: A guide. Accessed July 8, 2021, www.raponline.org/wp-content/uploads/2016/07/rap-lazar-electricity-regulation-US-june-2016.pdf.Google Scholar
• MacQueen J (1967) Some methods for classification and analysis of multivariate observations. Proc. 5th Berkeley Sympos. Math. Statist. Probability (University of California Press, Berkeley and Los Angeles, CA), 281–297.Google Scholar
• Mak HY (2022) Enabling smarter cities with operations management. Manufacturing Service Oper. Management 24(1):24–39.Link, Google Scholar
• McKinsey & Company (2019) The new way to engage with energy customers: Personalization at scale. Accessed July 23, 2021, https://www.mckinsey.com/industries/electric-power-and-natural-gas/our-insights/the-new-way-to-engage-with-energy-customers-personalization-at-scale.Google Scholar
• Miao S, Chen X, Chao X, Liu J, Zhang Y (2022) Context-based dynamic pricing with online clustering. Production Oper. Management 31(9):3559–3575.Crossref, Google Scholar
• Nambiar M, Simchi-Levi D, Wang H (2019) Dynamic learning and pricing with model misspecification. Management Sci. 65(11):4980–5000.Link, Google Scholar
• Navigant Research (2017) Big data drives demand side management innovation. Accessed June 2, 2020, https://blog.aee.net/big-data-drives-demand-side-management-innovation.Google Scholar
• Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: Analysis and an algorithm. Proc. 14th Internat. Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 849–856.Google Scholar
• Nguyen TT, Lauw HW (2014) Dynamic clustering of contextual multi-armed bandits. Proc. 23rd ACM Internat. Conf. Information Knowledge Management (ACM, New York), 1959–1962.Google Scholar
• OECD (2018) Personalised pricing in the digital era: Note by the United States. Accessed August 24, 2021, https://www.ftc.gov/system/files/attachments/us-submissions-oecd-2010-present-other-international-competition-fora/personalized_pricing_note_by_the_united_states.pdf.Google Scholar
• Open EI (2019) U.S. utility rate database: Austin Energy. Accessed June 25, 2019, https://openei.org/apps/USURDB/rate/view/539fcac1ec4f024d2f53fef2#3__Energy.Google Scholar
• Pecan Street (2019) Dataport: Pecan Street Inc. Accessed June 25, 2019, https://www.pecanstreet.org/dataport/.Google Scholar
• Qi W, Shen ZJM (2019) A smart-city scope of operations management. Production Oper. Management 28(2):393–406.Crossref, Google Scholar
• Qi A, Ahn HS, Sinha A (2017) Capacity investment with demand learning. Oper. Res. 65(1):145–164.Link, Google Scholar
• Rajabi A, Eskandari M, Ghadi MJ, Li L, Zhang J, Siano P (2020) A comparative study of clustering techniques for electrical load pattern segmentation. Renewable Sustainable Energy Rev. 120:109628.Crossref, Google Scholar
• Rousseeuw PJ (1987) Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20:53–65.Crossref, Google Scholar
• Saxena A, Prasad M, Gupta A, Bharill N, Patel OP, Tiwari A, Er MJ, et al. (2017) A review of clustering techniques and developments. Neurocomputing 267:664–681.Crossref, Google Scholar
• Sunar N, Birge JR (2019) Strategic commitment to a production schedule with uncertain supply and demand: Renewable energy in day-ahead electricity markets. Management Sci. 65(2):714–734.Link, Google Scholar
• Sunar N, Swaminathan JM (2021) Net-metered distributed renewable energy: A peril for utilities? Management Sci. 67(11):6716–6733.Link, Google Scholar
• Sunar N, Yu S, Kulkarni V (2021) Competitive investment with Bayesian learning: Choice of business size and timing. Oper. Res. 69(5):1430–1449.Link, Google Scholar
• The Edison Foundation (2021) Electric company smart meter deployments: Foundation for a smart grid (2021 update). Accessed August 20, 2021, https://www.edisonfoundation.net/-/media/Files/IEI/publications/IEI_Smart_Meter_Report_April_2021.ashx.Google Scholar
• U.S. EIA (2014) Form EIA-923 detailed data with previous form data (EIA-906/920). Accessed September 4, 2023, https://www.eia.gov/electricity/data/eia923/.Google Scholar
• U.S. EIA (2020) Annual electric power industry report, Form EIA-861 detailed data files. Accessed July 22, 2021, https://www.eia.gov/electricity/data/eia861/.Google Scholar
• U.S. EIA (2021a) Annual electric power industry report, Form EIA-861 detailed data files. Accessed August 24, 2021, www.eia.gov/electricity/data/eia861/.Google Scholar
• U.S. EIA (2021b) Electric sales, revenue, and average price. Accessed August 20, 2021, www.eia.gov/electricity/sales_revenue_price/.Google Scholar
• U.S. HUD (2023) 2023 Texas income limit report. Accessed September 4, 2023, https://www.huduser.gov/portal/datasets/home-datasets/files/HOME_IncomeLmts_State_TX_2023.pdf.Google Scholar
• Utility Dive (2022) Utilities trying new strategies to boost dynamic pricing enrollments. Accessed December 15, 2022, https://www.utilitydive.com/spons/utilities-trying-new-strategies-to-boost-dynamic-pricing-enrollments/632799/.Google Scholar
• von Luxburg U (2007) A tutorial on spectral clustering. Statist. Comput. 17(4):395–416.Crossref, Google Scholar
• von Luxburg U, Belkin M, Bousquet O (2008) Consistency of spectral clustering. Ann. Statist. 36(2):555–586.Crossref, Google Scholar
• Wang Y, Chen Q, Kang C, Zhang M, Wang K, Zhao Y (2015) Load profiling and its application to demand response: A review. Tsinghua Sci. Tech. 20(2):117–129.Crossref, Google Scholar
• Ward JH Jr (1963) Hierarchical grouping to optimize an objective function. J. Amer. Statist. Assoc. 58(301):236–244.Crossref, Google Scholar
• Wedderburn RW (1974) Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method. Biometrika 61(3):439–447.Google Scholar
• Xoom Energy (2021) Get a custom energy pricing quote. Accessed August 24, 2021, https://xoomenergy.com/en/big-business-program.Google Scholar
• Zhang H (2022) Dynamic learning and decision making via basis weight vectors. Oper. Res. 70(3):1835–1853.Link, Google Scholar